2024-09-11T00:12:05.240 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T00:12:05.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T00:12:05.359 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899841 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/acls} email: hyelloji@redhat.com first_in_suite: false job_id: '7899841' kernel: flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: pid file: '' mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - Reduced data availability - Degraded data redundancy sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCz8s6bVpH4c4jc0g+mRNGRJ5foCl71tDivDI3uWV6ZS+pOPD+4yyOAixhA4WjD/H5DHHN+9oHgLxOZu75QLy/c= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAPbcB+wjZ326a8U/nemO2LY3FWaEfKanKqAF1E3sJaU6eVPwxLlTaU2LYK+BuOpyexJEMf73KXsIzz9TMf0I/A= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_acls teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T00:12:05.360 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-11T00:12:05.360 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-11T00:12:05.360 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T00:12:05.362 INFO:teuthology.task.internal:Checking packages... 2024-09-11T00:12:05.383 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-11T00:12:05.383 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T00:12:05.383 INFO:teuthology.packaging:ref: None 2024-09-11T00:12:05.383 INFO:teuthology.packaging:tag: None 2024-09-11T00:12:05.384 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-11T00:12:05.384 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:12:05.384 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-11T00:12:05.538 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-11T00:12:05.539 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T00:12:05.544 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T00:12:05.544 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T00:12:05.595 INFO:teuthology.task.internal:Saving configuration 2024-09-11T00:12:05.612 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T00:12:05.639 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T00:12:05.670 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899841', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 00:07:07.693000', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCz8s6bVpH4c4jc0g+mRNGRJ5foCl71tDivDI3uWV6ZS+pOPD+4yyOAixhA4WjD/H5DHHN+9oHgLxOZu75QLy/c='} 2024-09-11T00:12:05.701 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899841', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 00:07:07.694975', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAPbcB+wjZ326a8U/nemO2LY3FWaEfKanKqAF1E3sJaU6eVPwxLlTaU2LYK+BuOpyexJEMf73KXsIzz9TMf0I/A='} 2024-09-11T00:12:05.701 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T00:12:05.705 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-11T00:12:05.706 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-11T00:12:05.706 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T00:12:05.783 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f13a3f13be0>, signals=[15]) 2024-09-11T00:12:05.784 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T00:12:05.788 INFO:teuthology.task.internal:Opening connections... 2024-09-11T00:12:05.788 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T00:12:05.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:12:05.874 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-09-11T00:12:05.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:12:05.954 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T00:12:05.960 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2024-09-11T00:12:05.977 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2024-09-11T00:12:05.978 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-09-11T00:12:06.035 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2024-09-11T00:12:06.035 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2024-09-11T00:12:06.036 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2024-09-11T00:12:06.036 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2024-09-11T00:12:06.036 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2024-09-11T00:12:06.036 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2024-09-11T00:12:06.036 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T00:12:06.036 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-09-11T00:12:06.036 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2024-09-11T00:12:06.036 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T00:12:06.036 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2024-09-11T00:12:06.036 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T00:12:06.036 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T00:12:06.036 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T00:12:06.037 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-09-11T00:12:06.065 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-09-11T00:12:06.084 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-09-11T00:12:06.084 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-09-11T00:12:06.142 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-09-11T00:12:06.143 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-09-11T00:12:06.143 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-09-11T00:12:06.143 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-09-11T00:12:06.143 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-09-11T00:12:06.143 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-09-11T00:12:06.143 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T00:12:06.143 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-09-11T00:12:06.143 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-09-11T00:12:06.143 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T00:12:06.143 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-09-11T00:12:06.143 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T00:12:06.144 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T00:12:06.144 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T00:12:06.144 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-09-11T00:12:06.174 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T00:12:06.182 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T00:12:06.263 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T00:12:06.263 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2024-09-11T00:12:06.266 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-09-11T00:12:06.283 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T00:12:06.306 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T00:12:06.306 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2024-09-11T00:12:06.322 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-09-11T00:12:06.355 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T00:12:06.422 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T00:12:06.437 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-11T00:12:06.437 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'mon.b': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, timeout 300 2024-09-11T00:12:06.437 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T00:12:06.438 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T00:12:06.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:12:06.455 DEBUG:teuthology.task.kernel:sha1 for mon.a is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T00:12:06.455 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-11T00:12:06.455 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-09-11T00:12:06.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:12:06.456 DEBUG:teuthology.task.kernel:sha1 for mon.b is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T00:12:06.456 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-11T00:12:06.456 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-09-11T00:12:06.512 INFO:teuthology.orchestra.run.smithi040.stdout:5.14.0-503.el9.x86_64 2024-09-11T00:12:06.512 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T00:12:06.512 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-11T00:12:06.513 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T00:12:06.524 INFO:teuthology.orchestra.run.smithi175.stdout:5.14.0-503.el9.x86_64 2024-09-11T00:12:06.524 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T00:12:06.524 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-11T00:12:06.524 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T00:12:06.657 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum upgrade -y linux-firmware 2024-09-11T00:12:06.681 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum upgrade -y linux-firmware 2024-09-11T00:12:09.218 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 9.8 MB/s | 8.2 MB 00:00 2024-09-11T00:12:09.314 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - BaseOS 8.4 MB/s | 8.2 MB 00:00 2024-09-11T00:12:13.194 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 7.2 MB/s | 20 MB 00:02 2024-09-11T00:12:16.631 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - AppStream 3.3 MB/s | 20 MB 00:06 2024-09-11T00:12:18.969 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.5 MB 00:01 2024-09-11T00:12:20.395 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 86 kB/s | 19 kB 00:00 2024-09-11T00:12:21.123 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-11T00:12:21.532 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-11T00:12:22.641 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-11T00:12:23.587 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-11T00:12:26.971 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-11T00:12:29.135 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T00:12:29.136 INFO:teuthology.orchestra.run.smithi175.stdout:Nothing to do. 2024-09-11T00:12:29.136 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T00:12:29.176 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 49 kB/s | 1.7 kB 00:00 2024-09-11T00:12:29.245 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.b... 2024-09-11T00:12:29.245 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T00:12:29.403 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-11T00:12:29.403 DEBUG:teuthology.orchestra.run.smithi175:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-11T00:12:29.406 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi175.front.sepia.ceph.com to complete... 2024-09-11T00:12:31.381 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-09-11T00:12:31.382 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-09-11T00:12:31.382 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-09-11T00:12:31.485 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.a... 2024-09-11T00:12:31.486 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T00:12:31.640 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-11T00:12:31.640 DEBUG:teuthology.orchestra.run.smithi040:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-11T00:12:31.643 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi040.front.sepia.ceph.com to complete... 2024-09-11T00:12:38.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11 00:12:38 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-11T00:12:38.368 INFO:teuthology.orchestra.run.smithi175.stderr:FINISHED --2024-09-11 00:12:38-- 2024-09-11T00:12:38.368 INFO:teuthology.orchestra.run.smithi175.stderr:Total wall clock time: 8.9s 2024-09-11T00:12:38.368 INFO:teuthology.orchestra.run.smithi175.stderr:Downloaded: 1 files, 343M in 8.6s (39.7 MB/s) 2024-09-11T00:12:38.371 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.b... 2024-09-11T00:12:38.371 DEBUG:teuthology.orchestra.run.smithi175:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-11T00:12:40.521 INFO:teuthology.orchestra.run.smithi175.stdout:Verifying... ######################################## 2024-09-11T00:12:40.706 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing... ######################################## 2024-09-11T00:12:40.861 INFO:teuthology.orchestra.run.smithi175.stdout:Updating / installing... 2024-09-11T00:12:41.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11 00:12:41 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-11T00:12:41.687 INFO:teuthology.orchestra.run.smithi040.stderr:FINISHED --2024-09-11 00:12:41-- 2024-09-11T00:12:41.687 INFO:teuthology.orchestra.run.smithi040.stderr:Total wall clock time: 10s 2024-09-11T00:12:41.687 INFO:teuthology.orchestra.run.smithi040.stderr:Downloaded: 1 files, 343M in 9.6s (35.7 MB/s) 2024-09-11T00:12:41.690 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.a... 2024-09-11T00:12:41.690 DEBUG:teuthology.orchestra.run.smithi040:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-11T00:12:43.899 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying... ######################################## 2024-09-11T00:12:44.067 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing... ######################################## 2024-09-11T00:12:44.174 INFO:teuthology.orchestra.run.smithi040.stdout:Updating / installing... 2024-09-11T00:12:48.847 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-11T00:12:52.533 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-11T00:13:28.382 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi175.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-11T00:13:28.383 DEBUG:teuthology.orchestra.run.smithi175:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-11T00:13:28.473 INFO:teuthology.orchestra.run.smithi175.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:13:28.473 INFO:teuthology.orchestra.run.smithi175.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:13:28.473 INFO:teuthology.orchestra.run.smithi175.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:13:28.473 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:13:28.474 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-11T00:13:28.474 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-11T00:13:28.474 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-11T00:13:28.474 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-11T00:13:28.474 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-11T00:13:28.474 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-11T00:13:28.474 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-11T00:13:28.474 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-11T00:13:28.474 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-11T00:13:28.474 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-11T00:13:28.474 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-11T00:13:28.474 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-11T00:13:28.475 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-11T00:13:28.475 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-11T00:13:28.475 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-11T00:13:28.475 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-11T00:13:28.475 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-11T00:13:28.475 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-11T00:13:28.475 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-11T00:13:28.475 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-11T00:13:28.475 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-11T00:13:28.475 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-11T00:13:28.475 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-11T00:13:28.475 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-11T00:13:28.476 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-11T00:13:28.476 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-11T00:13:28.476 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-11T00:13:28.476 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-11T00:13:28.476 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-11T00:13:28.476 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-11T00:13:28.476 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-11T00:13:28.476 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-11T00:13:28.476 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-11T00:13:28.476 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-11T00:13:28.476 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-11T00:13:28.476 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-11T00:13:28.476 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-11T00:13:28.477 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-11T00:13:28.477 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-11T00:13:28.477 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-11T00:13:28.477 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-11T00:13:28.477 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-11T00:13:28.477 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-11T00:13:28.477 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-11T00:13:28.477 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-11T00:13:28.477 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-11T00:13:28.477 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-11T00:13:28.477 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-11T00:13:28.477 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-11T00:13:28.477 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-11T00:13:28.478 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-11T00:13:28.478 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-11T00:13:28.478 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-11T00:13:28.478 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-11T00:13:28.478 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-11T00:13:28.479 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-11T00:13:28.479 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-11T00:13:28.479 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-11T00:13:28.479 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-11T00:13:28.479 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-11T00:13:28.479 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-11T00:13:28.479 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-11T00:13:28.479 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-11T00:13:28.479 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-11T00:13:28.479 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-11T00:13:28.479 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-11T00:13:28.479 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-11T00:13:28.479 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-11T00:13:28.480 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-11T00:13:28.480 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-11T00:13:28.480 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-11T00:13:28.480 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-11T00:13:28.480 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-11T00:13:28.480 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-11T00:13:28.480 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-11T00:13:28.480 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-11T00:13:28.480 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-11T00:13:28.480 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-11T00:13:28.481 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-11T00:13:28.481 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-11T00:13:28.481 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-11T00:13:28.481 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-11T00:13:28.481 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-11T00:13:28.481 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-11T00:13:28.481 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-11T00:13:28.481 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-11T00:13:28.481 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-11T00:13:28.481 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-11T00:13:28.481 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-11T00:13:28.481 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-11T00:13:28.481 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-11T00:13:28.482 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-11T00:13:28.482 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-11T00:13:28.482 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-11T00:13:28.482 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-11T00:13:28.482 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-11T00:13:28.482 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-11T00:13:28.482 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-11T00:13:28.482 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-11T00:13:28.482 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-11T00:13:28.482 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-11T00:13:28.482 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-11T00:13:28.482 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-11T00:13:28.482 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-11T00:13:28.483 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-11T00:13:28.483 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-11T00:13:28.483 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-11T00:13:28.483 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-11T00:13:28.483 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-11T00:13:28.483 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-11T00:13:28.483 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-11T00:13:28.483 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-11T00:13:28.483 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-11T00:13:28.483 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-11T00:13:28.483 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-11T00:13:28.483 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-11T00:13:28.483 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-11T00:13:28.484 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-11T00:13:28.484 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-11T00:13:28.484 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-11T00:13:28.484 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-11T00:13:28.484 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-11T00:13:28.484 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-11T00:13:28.484 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-11T00:13:28.484 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-11T00:13:28.484 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-11T00:13:28.484 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-11T00:13:28.484 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-11T00:13:28.484 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-11T00:13:28.485 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-11T00:13:28.485 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-11T00:13:28.485 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-11T00:13:28.485 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-11T00:13:28.485 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-11T00:13:28.485 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-11T00:13:28.485 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-11T00:13:28.485 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-11T00:13:28.485 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-11T00:13:28.485 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-11T00:13:28.485 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-11T00:13:28.485 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-11T00:13:28.485 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-11T00:13:28.485 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-11T00:13:28.486 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-11T00:13:28.486 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-11T00:13:28.486 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-11T00:13:28.486 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-11T00:13:28.486 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-11T00:13:28.486 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-11T00:13:28.486 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-11T00:13:28.486 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-11T00:13:28.486 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-11T00:13:28.486 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-11T00:13:28.486 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-11T00:13:28.487 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-11T00:13:28.487 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-11T00:13:28.487 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-11T00:13:28.487 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-11T00:13:28.487 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-11T00:13:28.487 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-11T00:13:28.487 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-11T00:13:28.487 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-11T00:13:28.487 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-11T00:13:28.487 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-11T00:13:28.487 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-11T00:13:28.487 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-11T00:13:28.487 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-11T00:13:28.488 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-11T00:13:28.488 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-11T00:13:28.488 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-11T00:13:28.488 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-11T00:13:28.488 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-11T00:13:28.488 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-11T00:13:28.488 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-11T00:13:28.488 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-11T00:13:28.488 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-11T00:13:28.488 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-11T00:13:28.488 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-11T00:13:28.488 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-11T00:13:28.488 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-11T00:13:28.488 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-11T00:13:28.489 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-11T00:13:28.489 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-11T00:13:28.489 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-11T00:13:28.489 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-11T00:13:28.489 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-11T00:13:28.489 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-11T00:13:28.489 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-11T00:13:28.489 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-11T00:13:28.489 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-11T00:13:28.489 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-11T00:13:28.489 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-11T00:13:28.489 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-11T00:13:28.489 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-11T00:13:28.489 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-11T00:13:28.490 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-11T00:13:28.490 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-11T00:13:28.490 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-11T00:13:28.490 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-11T00:13:28.490 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-11T00:13:28.490 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-11T00:13:28.490 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-11T00:13:28.490 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-11T00:13:28.490 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-11T00:13:28.490 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-11T00:13:28.490 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-11T00:13:28.490 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-11T00:13:28.490 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-11T00:13:28.491 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-11T00:13:28.491 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-11T00:13:28.491 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-11T00:13:28.491 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-11T00:13:28.491 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-11T00:13:28.491 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-11T00:13:28.491 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-11T00:13:28.491 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-11T00:13:28.491 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-11T00:13:28.491 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-11T00:13:28.491 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-11T00:13:28.491 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-11T00:13:28.491 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-11T00:13:28.491 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-11T00:13:28.492 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-11T00:13:28.492 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-11T00:13:28.492 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-11T00:13:28.492 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-11T00:13:28.492 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-11T00:13:28.492 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-11T00:13:28.492 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-11T00:13:28.492 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-11T00:13:28.492 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-11T00:13:28.492 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-11T00:13:28.492 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-11T00:13:28.492 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-11T00:13:28.492 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-11T00:13:28.493 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-11T00:13:28.493 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-11T00:13:28.493 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-11T00:13:28.493 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-11T00:13:28.493 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-11T00:13:28.493 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-11T00:13:28.493 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-11T00:13:28.493 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-11T00:13:28.493 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-11T00:13:28.493 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-11T00:13:28.493 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-11T00:13:28.493 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-11T00:13:28.493 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-11T00:13:28.494 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-11T00:13:28.494 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-11T00:13:28.494 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-11T00:13:28.494 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-11T00:13:28.494 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-11T00:13:28.494 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-11T00:13:28.494 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-11T00:13:28.494 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-11T00:13:28.494 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-11T00:13:28.494 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-11T00:13:28.494 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-11T00:13:28.494 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-11T00:13:28.494 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-11T00:13:28.495 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-11T00:13:28.495 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-11T00:13:28.495 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-11T00:13:28.495 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-11T00:13:28.495 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-11T00:13:28.495 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-11T00:13:28.495 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-11T00:13:28.495 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-11T00:13:28.495 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-11T00:13:28.495 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-11T00:13:28.495 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-11T00:13:28.495 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-11T00:13:28.495 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-11T00:13:28.496 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-11T00:13:28.496 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-11T00:13:28.496 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-11T00:13:28.496 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-11T00:13:28.496 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-11T00:13:28.496 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-11T00:13:28.496 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-11T00:13:28.496 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-11T00:13:28.496 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-11T00:13:28.496 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-11T00:13:28.497 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-11T00:13:28.497 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-11T00:13:28.497 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-11T00:13:28.497 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-11T00:13:28.497 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-11T00:13:28.497 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-11T00:13:28.497 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-11T00:13:28.497 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-11T00:13:28.498 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-11T00:13:28.498 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-11T00:13:28.498 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-11T00:13:28.498 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-11T00:13:28.498 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-11T00:13:28.498 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-11T00:13:28.498 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-11T00:13:28.498 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-11T00:13:28.498 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-11T00:13:28.498 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-11T00:13:28.498 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-11T00:13:28.499 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-11T00:13:28.499 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-11T00:13:28.499 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-11T00:13:28.499 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-11T00:13:28.499 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-11T00:13:28.499 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-11T00:13:28.499 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-11T00:13:28.499 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-11T00:13:28.499 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-11T00:13:28.499 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-11T00:13:28.499 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-11T00:13:28.499 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-11T00:13:28.500 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-11T00:13:28.500 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-11T00:13:28.500 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-11T00:13:28.500 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-11T00:13:28.500 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-11T00:13:28.500 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-11T00:13:28.500 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-11T00:13:28.500 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-11T00:13:28.500 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-11T00:13:28.500 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-11T00:13:28.500 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-11T00:13:28.500 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-11T00:13:28.500 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-11T00:13:28.501 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-11T00:13:28.501 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-11T00:13:28.501 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-11T00:13:28.501 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-11T00:13:28.501 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-11T00:13:28.501 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-11T00:13:28.501 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-11T00:13:28.501 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-11T00:13:28.501 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-11T00:13:28.501 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-11T00:13:28.501 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-11T00:13:28.501 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-11T00:13:28.501 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-11T00:13:28.501 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-11T00:13:28.502 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-11T00:13:28.502 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-11T00:13:28.502 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-11T00:13:28.502 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-11T00:13:28.502 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-11T00:13:28.502 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-11T00:13:28.503 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-11T00:13:28.503 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-11T00:13:28.503 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-11T00:13:28.503 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-11T00:13:28.503 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-11T00:13:28.503 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-11T00:13:28.503 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-11T00:13:28.503 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-11T00:13:28.503 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-11T00:13:28.504 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-11T00:13:28.504 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-11T00:13:28.504 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-11T00:13:28.504 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-11T00:13:28.504 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-11T00:13:28.504 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-11T00:13:28.504 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-11T00:13:28.504 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-11T00:13:28.504 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-11T00:13:28.504 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-11T00:13:28.504 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-11T00:13:28.504 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-11T00:13:28.505 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-11T00:13:28.505 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-11T00:13:28.505 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-11T00:13:28.505 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-11T00:13:28.505 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-11T00:13:28.505 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-11T00:13:28.506 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-11T00:13:28.506 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-11T00:13:28.506 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-11T00:13:28.506 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-11T00:13:28.506 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-11T00:13:28.506 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-11T00:13:28.506 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-11T00:13:28.506 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-11T00:13:28.506 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-11T00:13:28.506 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-11T00:13:28.506 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-11T00:13:28.507 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-11T00:13:28.507 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-11T00:13:28.507 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-11T00:13:28.507 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-11T00:13:28.507 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-11T00:13:28.507 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-11T00:13:28.507 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-11T00:13:28.507 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-11T00:13:28.507 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-11T00:13:28.507 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-11T00:13:28.508 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-11T00:13:28.508 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-11T00:13:28.508 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-11T00:13:28.508 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-11T00:13:28.508 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-11T00:13:28.508 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-11T00:13:28.508 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-11T00:13:28.508 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-11T00:13:28.508 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-11T00:13:28.508 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-11T00:13:28.508 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-11T00:13:28.508 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-11T00:13:28.508 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-11T00:13:28.509 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-11T00:13:28.509 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-11T00:13:28.509 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-11T00:13:28.509 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-11T00:13:28.509 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-11T00:13:28.509 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-11T00:13:28.509 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-11T00:13:28.509 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-11T00:13:28.509 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-11T00:13:28.509 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-11T00:13:28.509 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-11T00:13:28.509 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-11T00:13:28.510 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-11T00:13:28.510 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-11T00:13:28.510 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-11T00:13:28.510 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-11T00:13:28.510 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-11T00:13:28.510 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-11T00:13:28.510 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-11T00:13:28.510 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-11T00:13:28.510 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-11T00:13:28.510 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-11T00:13:28.510 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-11T00:13:28.510 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-11T00:13:28.510 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-11T00:13:28.511 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-11T00:13:28.511 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-11T00:13:28.511 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-11T00:13:28.511 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-11T00:13:28.511 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-11T00:13:28.511 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-11T00:13:28.511 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-11T00:13:28.511 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-11T00:13:28.511 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-11T00:13:28.511 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-11T00:13:28.511 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-11T00:13:28.511 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-11T00:13:28.511 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-11T00:13:28.512 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-11T00:13:28.512 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-11T00:13:28.512 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-11T00:13:28.512 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-11T00:13:28.512 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-11T00:13:28.512 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-11T00:13:28.512 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-11T00:13:28.512 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-11T00:13:28.512 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-11T00:13:28.512 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-11T00:13:28.512 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-11T00:13:28.512 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-11T00:13:28.512 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-11T00:13:28.513 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-11T00:13:28.513 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-11T00:13:28.513 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-11T00:13:28.513 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-11T00:13:28.513 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-11T00:13:28.513 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-11T00:13:28.513 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-11T00:13:28.513 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-11T00:13:28.513 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-11T00:13:28.513 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-11T00:13:28.513 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-11T00:13:28.513 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-11T00:13:28.513 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-11T00:13:28.514 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-11T00:13:28.514 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-11T00:13:28.514 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-11T00:13:28.514 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-11T00:13:28.514 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-11T00:13:28.514 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-11T00:13:28.514 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-11T00:13:28.514 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-11T00:13:28.514 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-11T00:13:28.514 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-11T00:13:28.514 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-11T00:13:28.514 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-11T00:13:28.514 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-11T00:13:28.515 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-11T00:13:28.515 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-11T00:13:28.515 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-11T00:13:28.515 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-11T00:13:28.515 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-11T00:13:28.515 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-11T00:13:28.515 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-11T00:13:28.515 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-11T00:13:28.515 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-11T00:13:28.515 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-11T00:13:28.515 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-11T00:13:28.515 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-11T00:13:28.515 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-11T00:13:28.516 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-11T00:13:28.516 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-11T00:13:28.516 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-11T00:13:28.516 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-11T00:13:28.516 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-11T00:13:28.516 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-11T00:13:28.516 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-11T00:13:28.516 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-11T00:13:28.516 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-11T00:13:28.516 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-11T00:13:28.516 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-11T00:13:28.516 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-11T00:13:28.516 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-11T00:13:28.517 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-11T00:13:28.517 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-11T00:13:28.517 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-11T00:13:28.517 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-11T00:13:28.517 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-11T00:13:28.517 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-11T00:13:28.517 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-11T00:13:28.517 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-11T00:13:28.517 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-11T00:13:28.517 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-11T00:13:28.517 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-11T00:13:28.517 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-11T00:13:28.518 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-11T00:13:28.518 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-11T00:13:28.518 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-11T00:13:28.518 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-11T00:13:28.518 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-11T00:13:28.518 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-11T00:13:28.518 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-11T00:13:28.518 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-11T00:13:28.518 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-11T00:13:28.518 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-11T00:13:28.518 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-11T00:13:28.518 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-11T00:13:28.519 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-11T00:13:28.519 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-11T00:13:28.519 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-11T00:13:28.519 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-11T00:13:28.519 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-11T00:13:28.519 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-11T00:13:28.519 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-11T00:13:28.519 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-11T00:13:28.519 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-11T00:13:28.519 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-11T00:13:28.519 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-11T00:13:28.519 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-11T00:13:28.520 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-11T00:13:28.520 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-11T00:13:28.520 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-11T00:13:28.520 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-11T00:13:28.520 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-11T00:13:28.520 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-11T00:13:28.520 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-11T00:13:28.520 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-11T00:13:28.520 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-11T00:13:28.520 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-11T00:13:28.520 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-11T00:13:28.520 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-11T00:13:28.520 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-11T00:13:28.520 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-11T00:13:28.521 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-11T00:13:28.521 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-11T00:13:28.521 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-11T00:13:28.521 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-11T00:13:28.521 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-11T00:13:28.521 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-11T00:13:28.521 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-11T00:13:28.521 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-11T00:13:28.521 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-11T00:13:28.521 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-11T00:13:28.521 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-11T00:13:28.521 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-11T00:13:28.521 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-11T00:13:28.522 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-11T00:13:28.522 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-11T00:13:28.522 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-11T00:13:28.522 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-11T00:13:28.522 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-11T00:13:28.522 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-11T00:13:28.522 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-11T00:13:28.522 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-11T00:13:28.522 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-11T00:13:28.522 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-11T00:13:28.522 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-11T00:13:28.522 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-11T00:13:28.522 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-11T00:13:28.523 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-11T00:13:28.523 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-11T00:13:28.523 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-11T00:13:28.523 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-11T00:13:28.523 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-11T00:13:28.523 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-11T00:13:28.523 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-11T00:13:28.523 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-11T00:13:28.523 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-11T00:13:28.523 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-11T00:13:28.523 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-11T00:13:28.523 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-11T00:13:28.523 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-11T00:13:28.523 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-11T00:13:28.524 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-11T00:13:28.524 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-11T00:13:28.524 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-11T00:13:28.524 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-11T00:13:28.524 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-11T00:13:28.524 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-11T00:13:28.524 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-11T00:13:28.524 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-11T00:13:28.524 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-11T00:13:28.524 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-11T00:13:28.525 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-11T00:13:28.525 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-11T00:13:28.525 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-11T00:13:28.525 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-11T00:13:28.525 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-11T00:13:28.525 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-11T00:13:28.525 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-11T00:13:28.525 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-11T00:13:28.525 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-11T00:13:28.525 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-11T00:13:28.525 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-11T00:13:28.526 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-11T00:13:28.526 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-11T00:13:28.526 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-11T00:13:28.526 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-11T00:13:28.526 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-11T00:13:28.526 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-11T00:13:28.526 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-11T00:13:28.526 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-11T00:13:28.526 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-11T00:13:28.526 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-11T00:13:28.526 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-11T00:13:28.526 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-11T00:13:28.526 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-11T00:13:28.526 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-11T00:13:28.527 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-11T00:13:28.527 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-11T00:13:28.527 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-11T00:13:28.527 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-11T00:13:28.527 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-11T00:13:28.527 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-11T00:13:28.527 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-11T00:13:28.527 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-11T00:13:28.527 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-11T00:13:28.527 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-11T00:13:28.527 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-11T00:13:28.528 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-11T00:13:28.528 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-11T00:13:28.528 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-11T00:13:28.528 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-11T00:13:28.528 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-11T00:13:28.528 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-11T00:13:28.528 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-11T00:13:28.528 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-11T00:13:28.528 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-11T00:13:28.528 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-11T00:13:28.528 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-11T00:13:28.528 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-11T00:13:28.529 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-11T00:13:28.529 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-11T00:13:28.529 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-11T00:13:28.529 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-11T00:13:28.529 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-11T00:13:28.529 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-11T00:13:28.529 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-11T00:13:28.529 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-11T00:13:28.529 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-11T00:13:28.529 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-11T00:13:28.529 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-11T00:13:28.529 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-11T00:13:28.529 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-11T00:13:28.530 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-11T00:13:28.530 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-11T00:13:28.530 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-11T00:13:28.530 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-11T00:13:28.530 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-11T00:13:28.530 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-11T00:13:28.530 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-11T00:13:28.530 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-11T00:13:28.530 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-11T00:13:28.530 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-11T00:13:28.530 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-11T00:13:28.531 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-11T00:13:28.531 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-11T00:13:28.531 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-11T00:13:28.531 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-11T00:13:28.531 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-11T00:13:28.531 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-11T00:13:28.531 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-11T00:13:28.531 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-11T00:13:28.531 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-11T00:13:28.531 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-11T00:13:28.531 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-11T00:13:28.531 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-11T00:13:28.531 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-11T00:13:28.531 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-11T00:13:28.532 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-11T00:13:28.532 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-11T00:13:28.532 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-11T00:13:28.532 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-11T00:13:28.532 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-11T00:13:28.532 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-11T00:13:28.532 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-11T00:13:28.532 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-11T00:13:28.532 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-11T00:13:28.532 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-11T00:13:28.532 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-11T00:13:28.532 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-11T00:13:28.532 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-11T00:13:28.533 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-11T00:13:28.533 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-11T00:13:28.533 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-11T00:13:28.533 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-11T00:13:28.533 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-11T00:13:28.533 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-11T00:13:28.533 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-11T00:13:28.533 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-11T00:13:28.533 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-11T00:13:28.533 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-11T00:13:28.533 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-11T00:13:28.533 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-11T00:13:28.533 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-11T00:13:28.533 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-11T00:13:28.534 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-11T00:13:28.534 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-11T00:13:28.534 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-11T00:13:28.534 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-11T00:13:28.534 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-11T00:13:28.534 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-11T00:13:28.534 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-11T00:13:28.534 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-11T00:13:28.534 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-11T00:13:28.534 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-11T00:13:28.534 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-11T00:13:28.534 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-11T00:13:28.534 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-11T00:13:28.534 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-11T00:13:28.535 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-11T00:13:28.535 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-11T00:13:28.535 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-11T00:13:28.535 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-11T00:13:28.535 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-11T00:13:28.535 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-11T00:13:28.535 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-11T00:13:28.535 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-11T00:13:28.535 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-11T00:13:28.535 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-11T00:13:28.535 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-11T00:13:28.535 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-11T00:13:28.535 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-11T00:13:28.536 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-11T00:13:28.536 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-11T00:13:28.536 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-11T00:13:28.536 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-11T00:13:28.536 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-11T00:13:28.536 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-11T00:13:28.536 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-11T00:13:28.536 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-11T00:13:28.536 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-11T00:13:28.536 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-11T00:13:28.536 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-11T00:13:28.536 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-11T00:13:28.536 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-11T00:13:28.537 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-11T00:13:28.537 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-11T00:13:28.537 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-11T00:13:28.537 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-11T00:13:28.537 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-11T00:13:28.537 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-11T00:13:28.537 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-11T00:13:28.537 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-11T00:13:28.537 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-11T00:13:28.537 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-11T00:13:28.537 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-11T00:13:28.537 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-11T00:13:28.537 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-11T00:13:28.538 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-11T00:13:28.538 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-11T00:13:28.538 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-11T00:13:28.538 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-11T00:13:28.538 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-11T00:13:28.538 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-11T00:13:28.538 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-11T00:13:28.538 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-11T00:13:28.538 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-11T00:13:28.538 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-11T00:13:28.538 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-11T00:13:28.538 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-11T00:13:28.538 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-11T00:13:28.539 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-11T00:13:28.539 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-11T00:13:28.539 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-11T00:13:28.539 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-11T00:13:28.539 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-11T00:13:28.539 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-11T00:13:28.539 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-11T00:13:28.539 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-11T00:13:28.539 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-11T00:13:28.539 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-11T00:13:28.539 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-11T00:13:28.539 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-11T00:13:28.539 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-11T00:13:28.539 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-11T00:13:28.540 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-11T00:13:28.540 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-11T00:13:28.540 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-11T00:13:28.540 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-11T00:13:28.540 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-11T00:13:28.540 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-11T00:13:28.540 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-11T00:13:28.540 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-11T00:13:28.540 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-11T00:13:28.540 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-11T00:13:28.540 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-11T00:13:28.540 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-11T00:13:28.540 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-11T00:13:28.540 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-11T00:13:28.541 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-11T00:13:28.541 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-11T00:13:28.541 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-11T00:13:28.541 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-11T00:13:28.541 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-11T00:13:28.541 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-11T00:13:28.541 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-11T00:13:28.541 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-11T00:13:28.541 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-11T00:13:28.541 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-11T00:13:28.541 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-11T00:13:28.541 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-11T00:13:28.542 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-11T00:13:28.542 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-11T00:13:28.542 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-11T00:13:28.542 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-11T00:13:28.542 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-11T00:13:28.542 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-11T00:13:28.542 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-11T00:13:28.542 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-11T00:13:28.542 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-11T00:13:28.542 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-11T00:13:28.542 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-11T00:13:28.542 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-11T00:13:28.542 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-11T00:13:28.542 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-11T00:13:28.543 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-11T00:13:28.543 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-11T00:13:28.543 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-11T00:13:28.543 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-11T00:13:28.543 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-11T00:13:28.543 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-11T00:13:28.543 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-11T00:13:28.543 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-11T00:13:28.543 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-11T00:13:28.543 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-11T00:13:28.543 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-11T00:13:28.543 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-11T00:13:28.543 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-11T00:13:28.544 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-11T00:13:28.544 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-11T00:13:28.544 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-11T00:13:28.544 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-11T00:13:28.544 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-11T00:13:28.544 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-11T00:13:28.544 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-11T00:13:28.544 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-11T00:13:28.544 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-11T00:13:28.544 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-11T00:13:28.544 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-11T00:13:28.545 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-11T00:13:28.545 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-11T00:13:28.545 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-11T00:13:28.545 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-11T00:13:28.545 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-11T00:13:28.545 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-11T00:13:28.545 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-11T00:13:28.545 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-11T00:13:28.545 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-11T00:13:28.545 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-11T00:13:28.545 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-11T00:13:28.545 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-11T00:13:28.545 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-11T00:13:28.545 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-11T00:13:28.546 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-11T00:13:28.546 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-11T00:13:28.546 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-11T00:13:28.546 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-11T00:13:28.546 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-11T00:13:28.546 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-11T00:13:28.546 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-11T00:13:28.546 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-11T00:13:28.546 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-11T00:13:28.546 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-11T00:13:28.546 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-11T00:13:28.546 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-11T00:13:28.546 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-11T00:13:28.546 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-11T00:13:28.547 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-11T00:13:28.547 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-11T00:13:28.547 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-11T00:13:28.547 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-11T00:13:28.547 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-11T00:13:28.547 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-11T00:13:28.547 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-11T00:13:28.547 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-11T00:13:28.548 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-11T00:13:28.548 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-11T00:13:28.548 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-11T00:13:28.548 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-11T00:13:28.548 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-11T00:13:28.548 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-11T00:13:28.548 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-11T00:13:28.548 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-11T00:13:28.548 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-11T00:13:28.548 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-11T00:13:28.548 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-11T00:13:28.548 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-11T00:13:28.548 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-11T00:13:28.549 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-11T00:13:28.549 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-11T00:13:28.549 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-11T00:13:28.549 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-11T00:13:28.549 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-11T00:13:28.549 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-11T00:13:28.549 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-11T00:13:28.549 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-11T00:13:28.549 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-11T00:13:28.549 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-11T00:13:28.549 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-11T00:13:28.549 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-11T00:13:28.549 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-11T00:13:28.549 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-11T00:13:28.550 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-11T00:13:28.550 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-11T00:13:28.550 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-11T00:13:28.550 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-11T00:13:28.550 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-11T00:13:28.550 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-11T00:13:28.550 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-11T00:13:28.550 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-11T00:13:28.550 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-11T00:13:28.550 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-11T00:13:28.550 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-11T00:13:28.550 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-11T00:13:28.551 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-11T00:13:28.551 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-11T00:13:28.551 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-11T00:13:28.551 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-11T00:13:28.551 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-11T00:13:28.551 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-11T00:13:28.551 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-11T00:13:28.551 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-11T00:13:28.551 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-11T00:13:28.551 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-11T00:13:28.551 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-11T00:13:28.551 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-11T00:13:28.551 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-11T00:13:28.551 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-11T00:13:28.552 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-11T00:13:28.552 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-11T00:13:28.552 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-11T00:13:28.552 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-11T00:13:28.552 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-11T00:13:28.552 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-11T00:13:28.552 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-11T00:13:28.552 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-11T00:13:28.552 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-11T00:13:28.552 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-11T00:13:28.552 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-11T00:13:28.552 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-11T00:13:28.552 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-11T00:13:28.553 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-11T00:13:28.553 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-11T00:13:28.553 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-11T00:13:28.553 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-11T00:13:28.553 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-11T00:13:28.553 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-11T00:13:28.553 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-11T00:13:28.553 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-11T00:13:28.553 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-11T00:13:28.553 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-11T00:13:28.553 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-11T00:13:28.553 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-11T00:13:28.553 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-11T00:13:28.553 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-11T00:13:28.554 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-11T00:13:28.554 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-11T00:13:28.554 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-11T00:13:28.554 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-11T00:13:28.554 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-11T00:13:28.554 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-11T00:13:28.554 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-11T00:13:28.554 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-11T00:13:28.554 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-11T00:13:28.554 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-11T00:13:28.554 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-11T00:13:28.554 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-11T00:13:28.554 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-11T00:13:28.554 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-11T00:13:28.554 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-11T00:13:28.555 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-11T00:13:28.555 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-11T00:13:28.555 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-11T00:13:28.555 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-11T00:13:28.555 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-11T00:13:28.555 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-11T00:13:28.555 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-11T00:13:28.555 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-11T00:13:28.555 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-11T00:13:28.555 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-11T00:13:28.555 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-11T00:13:28.555 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-11T00:13:28.555 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-11T00:13:28.555 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-11T00:13:28.556 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-11T00:13:28.556 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-11T00:13:28.556 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-11T00:13:28.556 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-11T00:13:28.556 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-11T00:13:28.556 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-11T00:13:28.556 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-11T00:13:28.556 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-11T00:13:28.556 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-11T00:13:28.556 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-11T00:13:28.556 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-11T00:13:28.556 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-11T00:13:28.556 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-11T00:13:28.556 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-11T00:13:28.557 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-11T00:13:28.557 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-11T00:13:28.557 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-11T00:13:28.557 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-11T00:13:28.557 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-11T00:13:28.557 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-11T00:13:28.557 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-11T00:13:28.557 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-11T00:13:28.557 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-11T00:13:28.557 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-11T00:13:28.557 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-11T00:13:28.557 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-11T00:13:28.558 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-11T00:13:28.558 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-11T00:13:28.558 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-11T00:13:28.558 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-11T00:13:28.558 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-11T00:13:28.558 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-11T00:13:28.558 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-11T00:13:28.558 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-11T00:13:28.558 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-11T00:13:28.558 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-11T00:13:28.558 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-11T00:13:28.558 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-11T00:13:28.558 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-11T00:13:28.559 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-11T00:13:28.559 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-11T00:13:28.559 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-11T00:13:28.559 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-11T00:13:28.559 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-11T00:13:28.559 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-11T00:13:28.559 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-11T00:13:28.559 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-11T00:13:28.559 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-11T00:13:28.559 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-11T00:13:28.559 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-11T00:13:28.559 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-11T00:13:28.559 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-11T00:13:28.559 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-11T00:13:28.560 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-11T00:13:28.560 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-11T00:13:28.560 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-11T00:13:28.560 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-11T00:13:28.560 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-11T00:13:28.560 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-11T00:13:28.560 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-11T00:13:28.560 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-11T00:13:28.560 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-11T00:13:28.560 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-11T00:13:28.560 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-11T00:13:28.560 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-11T00:13:28.560 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-11T00:13:28.561 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-11T00:13:28.561 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-11T00:13:28.561 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-11T00:13:28.561 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-11T00:13:28.561 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-11T00:13:28.561 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-11T00:13:28.561 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-11T00:13:28.561 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-11T00:13:28.561 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-11T00:13:28.561 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-11T00:13:28.561 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-11T00:13:28.561 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-11T00:13:28.561 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-11T00:13:28.561 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-11T00:13:28.562 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-11T00:13:28.562 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-11T00:13:28.562 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-11T00:13:28.562 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-11T00:13:28.562 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-11T00:13:28.562 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-11T00:13:28.562 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-11T00:13:28.562 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-11T00:13:28.562 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-11T00:13:28.562 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-11T00:13:28.562 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-11T00:13:28.562 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-11T00:13:28.562 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-11T00:13:28.562 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-11T00:13:28.563 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-11T00:13:28.563 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-11T00:13:28.563 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-11T00:13:28.563 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-11T00:13:28.563 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-11T00:13:28.563 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-11T00:13:28.563 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-11T00:13:28.563 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-11T00:13:28.563 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-11T00:13:28.563 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-11T00:13:28.563 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-11T00:13:28.563 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-11T00:13:28.563 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-11T00:13:28.563 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-11T00:13:28.564 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-11T00:13:28.564 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-11T00:13:28.564 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-11T00:13:28.564 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-11T00:13:28.564 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-11T00:13:28.564 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-11T00:13:28.564 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-11T00:13:28.564 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-11T00:13:28.564 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-11T00:13:28.564 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-11T00:13:28.564 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-11T00:13:28.564 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-11T00:13:28.564 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-11T00:13:28.565 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-11T00:13:28.565 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-11T00:13:28.565 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-11T00:13:28.565 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-11T00:13:28.565 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-11T00:13:28.565 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-11T00:13:28.565 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-11T00:13:28.565 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-11T00:13:28.565 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-11T00:13:28.565 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-11T00:13:28.565 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-11T00:13:28.565 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-11T00:13:28.565 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-11T00:13:28.565 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-11T00:13:28.566 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-11T00:13:28.566 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-11T00:13:28.566 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-11T00:13:28.566 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-11T00:13:28.566 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-11T00:13:28.566 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-11T00:13:28.566 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-11T00:13:28.566 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-11T00:13:28.566 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-11T00:13:28.566 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-11T00:13:28.566 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-11T00:13:28.566 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-11T00:13:28.566 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-11T00:13:28.566 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-11T00:13:28.567 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-11T00:13:28.567 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-11T00:13:28.567 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-11T00:13:28.567 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-11T00:13:28.567 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-11T00:13:28.567 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-11T00:13:28.567 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-11T00:13:28.567 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-11T00:13:28.567 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-11T00:13:28.567 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-11T00:13:28.567 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-11T00:13:28.567 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-11T00:13:28.567 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-11T00:13:28.567 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-11T00:13:28.567 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-11T00:13:28.568 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-11T00:13:28.568 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-11T00:13:28.568 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-11T00:13:28.568 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-11T00:13:28.568 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-11T00:13:28.568 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-11T00:13:28.568 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-11T00:13:28.568 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-11T00:13:28.568 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-11T00:13:28.568 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-11T00:13:28.568 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-11T00:13:28.568 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-11T00:13:28.568 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-11T00:13:28.568 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-11T00:13:28.569 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-11T00:13:28.569 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-11T00:13:28.569 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-11T00:13:28.569 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-11T00:13:28.569 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-11T00:13:28.569 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-11T00:13:28.569 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-11T00:13:28.569 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-11T00:13:28.569 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-11T00:13:28.569 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-11T00:13:28.569 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-11T00:13:28.569 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-11T00:13:28.569 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-11T00:13:28.569 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-11T00:13:28.570 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-11T00:13:28.570 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-11T00:13:28.570 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-11T00:13:28.570 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-11T00:13:28.570 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-11T00:13:28.570 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-11T00:13:28.570 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-11T00:13:28.570 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-11T00:13:28.570 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-11T00:13:28.570 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-11T00:13:28.570 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-11T00:13:28.570 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-11T00:13:28.570 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-11T00:13:28.570 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-11T00:13:28.570 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-11T00:13:28.571 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-11T00:13:28.571 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-11T00:13:28.571 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-11T00:13:28.571 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-11T00:13:28.571 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-11T00:13:28.571 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-11T00:13:28.571 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-11T00:13:28.571 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-11T00:13:28.571 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-11T00:13:28.571 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-11T00:13:28.571 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-11T00:13:28.571 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-11T00:13:28.571 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-11T00:13:28.572 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-11T00:13:28.572 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-11T00:13:28.572 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-11T00:13:28.572 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-11T00:13:28.572 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-11T00:13:28.572 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-11T00:13:28.572 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-11T00:13:28.572 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-11T00:13:28.572 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-11T00:13:28.572 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-11T00:13:28.572 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-11T00:13:28.572 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-11T00:13:28.572 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-11T00:13:28.572 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-11T00:13:28.573 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-11T00:13:28.573 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-11T00:13:28.573 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-11T00:13:28.573 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-11T00:13:28.573 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-11T00:13:28.573 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-11T00:13:28.573 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-11T00:13:28.573 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-11T00:13:28.573 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-11T00:13:28.573 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-11T00:13:28.573 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-11T00:13:28.573 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-11T00:13:28.573 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-11T00:13:28.573 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-11T00:13:28.574 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-11T00:13:28.574 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-11T00:13:28.574 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-11T00:13:28.574 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-11T00:13:28.574 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-11T00:13:28.574 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-11T00:13:28.574 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-11T00:13:28.574 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-11T00:13:28.574 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-11T00:13:28.574 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-11T00:13:28.574 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-11T00:13:28.574 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-11T00:13:28.574 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-11T00:13:28.574 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-11T00:13:28.575 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-11T00:13:28.575 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-11T00:13:28.575 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-11T00:13:28.575 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-11T00:13:28.575 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-11T00:13:28.575 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-11T00:13:28.575 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-11T00:13:28.575 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-11T00:13:28.575 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-11T00:13:28.575 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-11T00:13:28.575 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-11T00:13:28.575 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-11T00:13:28.575 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-11T00:13:28.575 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-11T00:13:28.576 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-11T00:13:28.576 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-11T00:13:28.576 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-11T00:13:28.576 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-11T00:13:28.576 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-11T00:13:28.576 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-11T00:13:28.576 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-11T00:13:28.576 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-11T00:13:28.576 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-11T00:13:28.576 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-11T00:13:28.576 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-11T00:13:28.576 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-11T00:13:28.576 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-11T00:13:28.576 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-11T00:13:28.577 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-11T00:13:28.577 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-11T00:13:28.577 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-11T00:13:28.577 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-11T00:13:28.577 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-11T00:13:28.577 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-11T00:13:28.577 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-11T00:13:28.577 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-11T00:13:28.577 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-11T00:13:28.577 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-11T00:13:28.577 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-11T00:13:28.577 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-11T00:13:28.577 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-11T00:13:28.578 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-11T00:13:28.578 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-11T00:13:28.578 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-11T00:13:28.578 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-11T00:13:28.578 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-11T00:13:28.578 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-11T00:13:28.578 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-11T00:13:28.578 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-11T00:13:28.578 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-11T00:13:28.578 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-11T00:13:28.578 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-11T00:13:28.578 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-11T00:13:28.578 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-11T00:13:28.578 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-11T00:13:28.579 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-11T00:13:28.579 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-11T00:13:28.579 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-11T00:13:28.579 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-11T00:13:28.579 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-11T00:13:28.579 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-11T00:13:28.579 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-11T00:13:28.579 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-11T00:13:28.579 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-11T00:13:28.579 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-11T00:13:28.579 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-11T00:13:28.579 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-11T00:13:28.579 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-11T00:13:28.580 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-11T00:13:28.580 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-11T00:13:28.580 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-11T00:13:28.580 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-11T00:13:28.580 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-11T00:13:28.580 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-11T00:13:28.580 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-11T00:13:28.580 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-11T00:13:28.580 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-11T00:13:28.580 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-11T00:13:28.580 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-11T00:13:28.580 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-11T00:13:28.580 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-11T00:13:28.581 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-11T00:13:28.581 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-11T00:13:28.581 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-11T00:13:28.581 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-11T00:13:28.581 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-11T00:13:28.581 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-11T00:13:28.581 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-11T00:13:28.581 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-11T00:13:28.581 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-11T00:13:28.581 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-11T00:13:28.581 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-11T00:13:28.581 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-11T00:13:28.581 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-11T00:13:28.582 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-11T00:13:28.582 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-11T00:13:28.582 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-11T00:13:28.582 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-11T00:13:28.582 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-11T00:13:28.582 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-11T00:13:28.582 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-11T00:13:28.582 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-11T00:13:28.582 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-11T00:13:28.582 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-11T00:13:28.582 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-11T00:13:28.582 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-11T00:13:28.582 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-11T00:13:28.582 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-11T00:13:28.583 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-11T00:13:28.583 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-11T00:13:28.583 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-11T00:13:28.583 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-11T00:13:28.583 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-11T00:13:28.583 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-11T00:13:28.583 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-11T00:13:28.584 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-11T00:13:28.584 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-11T00:13:28.584 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-11T00:13:28.584 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-11T00:13:28.584 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-11T00:13:28.584 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-11T00:13:28.584 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-11T00:13:28.584 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-11T00:13:28.585 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-11T00:13:28.585 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-11T00:13:28.585 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-11T00:13:28.585 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-11T00:13:28.585 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-11T00:13:28.585 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-11T00:13:28.585 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-11T00:13:28.585 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-11T00:13:28.585 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-11T00:13:28.585 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-11T00:13:28.585 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-11T00:13:28.585 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-11T00:13:28.585 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-11T00:13:28.585 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-11T00:13:28.586 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-11T00:13:28.586 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-11T00:13:28.586 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-11T00:13:28.586 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-11T00:13:28.586 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-11T00:13:28.586 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-11T00:13:28.586 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-11T00:13:28.586 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-11T00:13:28.586 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-11T00:13:28.586 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-11T00:13:28.586 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-11T00:13:28.587 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-11T00:13:28.587 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-11T00:13:28.587 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-11T00:13:28.587 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-11T00:13:28.587 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-11T00:13:28.587 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-11T00:13:28.587 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-11T00:13:28.587 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-11T00:13:28.587 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-11T00:13:28.587 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-11T00:13:28.587 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-11T00:13:28.587 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-11T00:13:28.587 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-11T00:13:28.588 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-11T00:13:28.588 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-11T00:13:28.588 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-11T00:13:28.588 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-11T00:13:28.588 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-11T00:13:28.588 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-11T00:13:28.588 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-11T00:13:28.588 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-11T00:13:28.588 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-11T00:13:28.588 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-11T00:13:28.588 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-11T00:13:28.588 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-11T00:13:28.588 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-11T00:13:28.588 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-11T00:13:28.589 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-11T00:13:28.589 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-11T00:13:28.589 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-11T00:13:28.589 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-11T00:13:28.589 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-11T00:13:28.589 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-11T00:13:28.589 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-11T00:13:28.589 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-11T00:13:28.589 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-11T00:13:28.589 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-11T00:13:28.589 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-11T00:13:28.589 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-11T00:13:28.589 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-11T00:13:28.589 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-11T00:13:28.590 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-11T00:13:28.590 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-11T00:13:28.590 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-11T00:13:28.590 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-11T00:13:28.590 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-11T00:13:28.590 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-11T00:13:28.590 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-11T00:13:28.590 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-11T00:13:28.590 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-11T00:13:28.590 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-11T00:13:28.590 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-11T00:13:28.590 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-11T00:13:28.590 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-11T00:13:28.590 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-11T00:13:28.591 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-11T00:13:28.591 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-11T00:13:28.591 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-11T00:13:28.591 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-11T00:13:28.591 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-11T00:13:28.591 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-11T00:13:28.591 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-11T00:13:28.591 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-11T00:13:28.591 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-11T00:13:28.591 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-11T00:13:28.591 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-11T00:13:28.591 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-11T00:13:28.591 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-11T00:13:28.591 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-11T00:13:28.592 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-11T00:13:28.592 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-11T00:13:28.592 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-11T00:13:28.592 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-11T00:13:28.592 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-11T00:13:28.592 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-11T00:13:28.592 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-11T00:13:28.592 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-11T00:13:28.592 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-11T00:13:28.592 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-11T00:13:28.592 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-11T00:13:28.592 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-11T00:13:28.592 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-11T00:13:28.593 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-11T00:13:28.593 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-11T00:13:28.593 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-11T00:13:28.593 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-11T00:13:28.593 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-11T00:13:28.593 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-11T00:13:28.593 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-11T00:13:28.593 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-11T00:13:28.593 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-11T00:13:28.593 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-11T00:13:28.593 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-11T00:13:28.593 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-11T00:13:28.594 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-11T00:13:28.594 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-11T00:13:28.594 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-11T00:13:28.594 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-11T00:13:28.594 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-11T00:13:28.594 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-11T00:13:28.594 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-11T00:13:28.594 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-11T00:13:28.594 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-11T00:13:28.594 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-11T00:13:28.594 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-11T00:13:28.594 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-11T00:13:28.594 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-11T00:13:28.595 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-11T00:13:28.595 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-11T00:13:28.595 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-11T00:13:28.595 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-11T00:13:28.595 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-11T00:13:28.595 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-11T00:13:28.595 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-11T00:13:28.595 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-11T00:13:28.595 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-11T00:13:28.595 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-11T00:13:28.595 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-11T00:13:28.595 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-11T00:13:28.595 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-11T00:13:28.595 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-11T00:13:28.596 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-11T00:13:28.596 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-11T00:13:28.596 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-11T00:13:28.596 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-11T00:13:28.596 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-11T00:13:28.596 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-11T00:13:28.596 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-11T00:13:28.596 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-11T00:13:28.596 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-11T00:13:28.596 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-11T00:13:28.596 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-11T00:13:28.596 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-11T00:13:28.596 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-11T00:13:28.597 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-11T00:13:28.597 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-11T00:13:28.597 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-11T00:13:28.597 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-11T00:13:28.597 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-11T00:13:28.597 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-11T00:13:28.597 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-11T00:13:28.597 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-11T00:13:28.600 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-11T00:13:28.600 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-11T00:13:28.600 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-11T00:13:28.600 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-11T00:13:28.600 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-11T00:13:28.600 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-11T00:13:28.600 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-11T00:13:28.600 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-11T00:13:28.600 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-11T00:13:28.600 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-11T00:13:28.600 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-11T00:13:28.600 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-11T00:13:28.600 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-11T00:13:28.601 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-11T00:13:28.601 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-11T00:13:28.601 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-11T00:13:28.601 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-11T00:13:28.601 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-11T00:13:28.601 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-11T00:13:28.601 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-11T00:13:28.601 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-11T00:13:28.601 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-11T00:13:28.601 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-11T00:13:28.601 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-11T00:13:28.601 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-11T00:13:28.601 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-11T00:13:28.601 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-11T00:13:28.602 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-11T00:13:28.602 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-11T00:13:28.602 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-11T00:13:28.602 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-11T00:13:28.602 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-11T00:13:28.602 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-11T00:13:28.602 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-11T00:13:28.602 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-11T00:13:28.602 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-11T00:13:28.602 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-11T00:13:28.602 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-11T00:13:28.602 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-11T00:13:28.602 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-11T00:13:28.602 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-11T00:13:28.603 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-11T00:13:28.603 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-11T00:13:28.603 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-11T00:13:28.603 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-11T00:13:28.603 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-11T00:13:28.603 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-11T00:13:28.603 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-11T00:13:28.603 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-11T00:13:28.603 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-11T00:13:28.603 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-11T00:13:28.603 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-11T00:13:28.603 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-11T00:13:28.603 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-11T00:13:28.604 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-11T00:13:28.604 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-11T00:13:28.604 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-11T00:13:28.604 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-11T00:13:28.604 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-11T00:13:28.604 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-11T00:13:28.604 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-11T00:13:28.604 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-11T00:13:28.604 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-11T00:13:28.604 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-11T00:13:28.604 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-11T00:13:28.604 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-11T00:13:28.604 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-11T00:13:28.604 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-11T00:13:28.605 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-11T00:13:28.605 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-11T00:13:28.605 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-11T00:13:28.605 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-11T00:13:28.605 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-11T00:13:28.605 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-11T00:13:28.605 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-11T00:13:28.605 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-11T00:13:28.605 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-11T00:13:28.605 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-11T00:13:28.605 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-11T00:13:28.605 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-11T00:13:28.605 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-11T00:13:28.605 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-11T00:13:28.606 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-11T00:13:28.606 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-11T00:13:28.606 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-11T00:13:28.606 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-11T00:13:28.606 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-11T00:13:28.606 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-11T00:13:28.606 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-11T00:13:28.606 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-11T00:13:28.606 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-11T00:13:28.606 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-11T00:13:28.606 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-11T00:13:28.606 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-11T00:13:28.606 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-11T00:13:28.606 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-11T00:13:28.607 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-11T00:13:28.607 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-11T00:13:28.607 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-11T00:13:28.607 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-11T00:13:28.607 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-11T00:13:28.607 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-11T00:13:28.607 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-11T00:13:28.607 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-11T00:13:28.607 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-11T00:13:28.607 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-11T00:13:28.607 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-11T00:13:28.607 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-11T00:13:28.607 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-11T00:13:28.607 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-11T00:13:28.608 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-11T00:13:28.608 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-11T00:13:28.608 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-11T00:13:28.608 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-11T00:13:28.608 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-11T00:13:28.608 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-11T00:13:28.608 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-11T00:13:28.608 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-11T00:13:28.608 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-11T00:13:28.608 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-11T00:13:28.608 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-11T00:13:28.608 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-11T00:13:28.608 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-11T00:13:28.608 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-11T00:13:28.608 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-11T00:13:28.609 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-11T00:13:28.609 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-11T00:13:28.609 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-11T00:13:28.609 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-11T00:13:28.609 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-11T00:13:28.609 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-11T00:13:28.609 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-11T00:13:28.609 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-11T00:13:28.609 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-11T00:13:28.609 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-11T00:13:28.609 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-11T00:13:28.609 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-11T00:13:28.610 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-11T00:13:28.610 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-11T00:13:28.610 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-11T00:13:28.610 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-11T00:13:28.610 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-11T00:13:28.610 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-11T00:13:28.610 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-11T00:13:28.610 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-11T00:13:28.610 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-11T00:13:28.610 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-11T00:13:28.610 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-11T00:13:28.610 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-11T00:13:28.610 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-11T00:13:28.610 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-11T00:13:28.610 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-11T00:13:28.611 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-11T00:13:28.611 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-11T00:13:28.611 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-11T00:13:28.611 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-11T00:13:28.611 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-11T00:13:28.611 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-11T00:13:28.611 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-11T00:13:28.611 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-11T00:13:28.611 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-11T00:13:28.611 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-11T00:13:28.611 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-11T00:13:28.611 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-11T00:13:28.612 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-11T00:13:28.612 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-11T00:13:28.612 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-11T00:13:28.612 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-11T00:13:28.612 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-11T00:13:28.613 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-11T00:13:28.613 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-11T00:13:28.613 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-11T00:13:28.613 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-11T00:13:28.614 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-11T00:13:28.615 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-11T00:13:28.615 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-11T00:13:28.615 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-11T00:13:28.615 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-11T00:13:28.615 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-11T00:13:28.616 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-11T00:13:28.616 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-11T00:13:28.616 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-11T00:13:28.616 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-11T00:13:28.616 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-11T00:13:28.616 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-11T00:13:28.616 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-11T00:13:28.616 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-11T00:13:28.616 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-11T00:13:28.616 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-11T00:13:28.616 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-11T00:13:28.616 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-11T00:13:28.616 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-11T00:13:28.617 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-11T00:13:28.617 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-11T00:13:28.617 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-11T00:13:28.617 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-11T00:13:28.617 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-11T00:13:28.617 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-11T00:13:28.617 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-11T00:13:28.617 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-11T00:13:28.617 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-11T00:13:28.617 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-11T00:13:28.617 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-11T00:13:28.617 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-11T00:13:28.617 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-11T00:13:28.618 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-11T00:13:28.618 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-11T00:13:28.618 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-11T00:13:28.618 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-11T00:13:28.618 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-11T00:13:28.618 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-11T00:13:28.618 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-11T00:13:28.618 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-11T00:13:28.618 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-11T00:13:28.618 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-11T00:13:28.618 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-11T00:13:28.618 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-11T00:13:28.618 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-11T00:13:28.618 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-11T00:13:28.619 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-11T00:13:28.619 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-11T00:13:28.619 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-11T00:13:28.619 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-11T00:13:28.619 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-11T00:13:28.619 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-11T00:13:28.619 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-11T00:13:28.619 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-11T00:13:28.619 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-11T00:13:28.619 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-11T00:13:28.619 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-11T00:13:28.619 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-11T00:13:28.619 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-11T00:13:28.619 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-11T00:13:28.620 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-11T00:13:28.620 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-11T00:13:28.620 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-11T00:13:28.620 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-11T00:13:28.620 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-11T00:13:28.620 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-11T00:13:28.620 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-11T00:13:28.620 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-11T00:13:28.620 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-11T00:13:28.620 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-11T00:13:28.620 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-11T00:13:28.620 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-11T00:13:28.620 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-11T00:13:28.621 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-11T00:13:28.621 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-11T00:13:28.621 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-11T00:13:28.621 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-11T00:13:28.621 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-11T00:13:28.621 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-11T00:13:28.621 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-11T00:13:28.621 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-11T00:13:28.621 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-11T00:13:28.621 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-11T00:13:28.621 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-11T00:13:28.621 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-11T00:13:28.621 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-11T00:13:28.621 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-11T00:13:28.622 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-11T00:13:28.622 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-11T00:13:28.622 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-11T00:13:28.622 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-11T00:13:28.622 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-11T00:13:28.622 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-11T00:13:28.622 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-11T00:13:28.622 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-11T00:13:28.622 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-11T00:13:28.622 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-11T00:13:28.622 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-11T00:13:28.622 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-11T00:13:28.622 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-11T00:13:28.622 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-11T00:13:28.623 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-11T00:13:28.623 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-11T00:13:28.623 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-11T00:13:28.623 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-11T00:13:28.623 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-11T00:13:28.623 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-11T00:13:28.623 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-11T00:13:28.623 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-11T00:13:28.623 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-11T00:13:28.623 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-11T00:13:28.623 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-11T00:13:28.623 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-11T00:13:28.624 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-11T00:13:28.624 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-11T00:13:28.624 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-11T00:13:28.624 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-11T00:13:28.624 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-11T00:13:28.624 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-11T00:13:28.624 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-11T00:13:28.624 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-11T00:13:28.624 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-11T00:13:28.624 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-11T00:13:28.624 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-11T00:13:28.624 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-11T00:13:28.624 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-11T00:13:28.625 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-11T00:13:28.625 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-11T00:13:28.625 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-11T00:13:28.625 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-11T00:13:28.625 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-11T00:13:28.625 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-11T00:13:28.625 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-11T00:13:28.625 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-11T00:13:28.625 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-11T00:13:28.625 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-11T00:13:28.625 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-11T00:13:28.625 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-11T00:13:28.625 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-11T00:13:28.625 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-11T00:13:28.626 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-11T00:13:28.626 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-11T00:13:28.626 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-11T00:13:28.626 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-11T00:13:28.626 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-11T00:13:28.626 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-11T00:13:28.626 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-11T00:13:28.626 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-11T00:13:28.626 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-11T00:13:28.626 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-11T00:13:28.626 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-11T00:13:28.626 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-11T00:13:28.626 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-11T00:13:28.626 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-11T00:13:28.627 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-11T00:13:28.627 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-11T00:13:28.627 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-11T00:13:28.627 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-11T00:13:28.627 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-11T00:13:28.627 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-11T00:13:28.627 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-11T00:13:28.627 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-11T00:13:28.627 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-11T00:13:28.627 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-11T00:13:28.627 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-11T00:13:28.627 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-11T00:13:28.627 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-11T00:13:28.627 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-11T00:13:28.628 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-11T00:13:28.628 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-11T00:13:28.628 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-11T00:13:28.628 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-11T00:13:28.628 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-11T00:13:28.628 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-11T00:13:28.628 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-11T00:13:28.628 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-11T00:13:28.628 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-11T00:13:28.628 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-11T00:13:28.628 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-11T00:13:28.628 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-11T00:13:28.628 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-11T00:13:28.628 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-11T00:13:28.629 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-11T00:13:28.629 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-11T00:13:28.629 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-11T00:13:28.629 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-11T00:13:28.629 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-11T00:13:28.629 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-11T00:13:28.629 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-11T00:13:28.629 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-11T00:13:28.629 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-11T00:13:28.629 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-11T00:13:28.629 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-11T00:13:28.629 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-11T00:13:28.629 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-11T00:13:28.629 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-11T00:13:28.630 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-11T00:13:28.630 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-11T00:13:28.630 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-11T00:13:28.630 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-11T00:13:28.630 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-11T00:13:28.630 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-11T00:13:28.630 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-11T00:13:28.630 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-11T00:13:28.630 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-11T00:13:28.630 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-11T00:13:28.630 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-11T00:13:28.630 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-11T00:13:28.630 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-11T00:13:28.630 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-11T00:13:28.630 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-11T00:13:28.631 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-11T00:13:28.635 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:13:28.635 DEBUG:teuthology.orchestra.run.smithi175:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-11T00:13:28.659 INFO:teuthology.orchestra.run.smithi175.stdout:postinstall scriptlet (using /bin/sh): 2024-09-11T00:13:28.659 INFO:teuthology.orchestra.run.smithi175.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-11T00:13:28.659 INFO:teuthology.orchestra.run.smithi175.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-11T00:13:28.659 INFO:teuthology.orchestra.run.smithi175.stdout:fi 2024-09-11T00:13:28.659 INFO:teuthology.orchestra.run.smithi175.stdout:for file in vmlinuz System.map config; do 2024-09-11T00:13:28.659 INFO:teuthology.orchestra.run.smithi175.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-11T00:13:28.659 INFO:teuthology.orchestra.run.smithi175.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T00:13:28.659 INFO:teuthology.orchestra.run.smithi175.stdout: fi 2024-09-11T00:13:28.659 INFO:teuthology.orchestra.run.smithi175.stdout:done 2024-09-11T00:13:28.659 INFO:teuthology.orchestra.run.smithi175.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-11T00:13:28.660 INFO:teuthology.orchestra.run.smithi175.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-11T00:13:28.660 INFO:teuthology.orchestra.run.smithi175.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T00:13:28.660 INFO:teuthology.orchestra.run.smithi175.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T00:13:28.660 INFO:teuthology.orchestra.run.smithi175.stdout:fi 2024-09-11T00:13:28.660 INFO:teuthology.orchestra.run.smithi175.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-11T00:13:28.660 INFO:teuthology.orchestra.run.smithi175.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:13:28.660 INFO:teuthology.orchestra.run.smithi175.stdout:fi 2024-09-11T00:13:28.660 INFO:teuthology.orchestra.run.smithi175.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-11T00:13:28.660 INFO:teuthology.orchestra.run.smithi175.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-11T00:13:28.660 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:13:28.660 INFO:teuthology.orchestra.run.smithi175.stdout:fi 2024-09-11T00:13:28.661 DEBUG:teuthology.orchestra.run.smithi175:> sudo rpm -qi grub2-tools 2024-09-11T00:13:28.735 INFO:teuthology.orchestra.run.smithi175.stdout:Name : grub2-tools 2024-09-11T00:13:28.735 INFO:teuthology.orchestra.run.smithi175.stdout:Epoch : 1 2024-09-11T00:13:28.735 INFO:teuthology.orchestra.run.smithi175.stdout:Version : 2.06 2024-09-11T00:13:28.735 INFO:teuthology.orchestra.run.smithi175.stdout:Release : 82.el9 2024-09-11T00:13:28.736 INFO:teuthology.orchestra.run.smithi175.stdout:Architecture: x86_64 2024-09-11T00:13:28.736 INFO:teuthology.orchestra.run.smithi175.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T00:13:28.736 INFO:teuthology.orchestra.run.smithi175.stdout:Group : Unspecified 2024-09-11T00:13:28.736 INFO:teuthology.orchestra.run.smithi175.stdout:Size : 8274670 2024-09-11T00:13:28.736 INFO:teuthology.orchestra.run.smithi175.stdout:License : GPLv3+ 2024-09-11T00:13:28.736 INFO:teuthology.orchestra.run.smithi175.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T00:13:28.736 INFO:teuthology.orchestra.run.smithi175.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T00:13:28.736 INFO:teuthology.orchestra.run.smithi175.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T00:13:28.736 INFO:teuthology.orchestra.run.smithi175.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T00:13:28.736 INFO:teuthology.orchestra.run.smithi175.stdout:Packager : builder@centos.org 2024-09-11T00:13:28.736 INFO:teuthology.orchestra.run.smithi175.stdout:Vendor : CentOS 2024-09-11T00:13:28.736 INFO:teuthology.orchestra.run.smithi175.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T00:13:28.736 INFO:teuthology.orchestra.run.smithi175.stdout:Summary : Support tools for GRUB. 2024-09-11T00:13:28.736 INFO:teuthology.orchestra.run.smithi175.stdout:Description : 2024-09-11T00:13:28.737 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:13:28.737 INFO:teuthology.orchestra.run.smithi175.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T00:13:28.737 INFO:teuthology.orchestra.run.smithi175.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T00:13:28.737 INFO:teuthology.orchestra.run.smithi175.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T00:13:28.737 INFO:teuthology.orchestra.run.smithi175.stdout:hardware devices. 2024-09-11T00:13:28.737 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:13:28.737 INFO:teuthology.orchestra.run.smithi175.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T00:13:28.738 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T00:13:28.738 INFO:teuthology.task.kernel:Updating grub on smithi175 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:13:28.738 DEBUG:teuthology.orchestra.run.smithi175:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T00:13:29.337 INFO:teuthology.orchestra.run.smithi175.stderr:Generating grub configuration file ... 2024-09-11T00:13:30.810 INFO:teuthology.orchestra.run.smithi175.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T00:13:30.829 INFO:teuthology.orchestra.run.smithi175.stderr:done 2024-09-11T00:13:30.832 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-09-11T00:13:30.847 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.I1bzDWZf72 2024-09-11T00:13:30.847 DEBUG:teuthology.orchestra.run.smithi175:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.I1bzDWZf72 2024-09-11T00:13:30.923 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.I1bzDWZf72 2024-09-11T00:13:31.061 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.I1bzDWZf72 is 6KB 2024-09-11T00:13:31.082 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.I1bzDWZf72 2024-09-11T00:13:31.097 DEBUG:teuthology.orchestra.run.smithi175:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T00:13:31.167 INFO:teuthology.orchestra.run.smithi175.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T00:13:31.168 INFO:teuthology.orchestra.run.smithi175.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T00:13:31.168 INFO:teuthology.orchestra.run.smithi175.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T00:13:31.168 INFO:teuthology.orchestra.run.smithi175.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-11T00:13:31.169 DEBUG:teuthology.orchestra.run.smithi175:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:13:31.331 DEBUG:teuthology.orchestra.run.smithi175:> sudo shutdown -r now 2024-09-11T00:13:32.868 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi040.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-11T00:13:32.868 DEBUG:teuthology.orchestra.run.smithi040:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-11T00:13:32.953 INFO:teuthology.orchestra.run.smithi040.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:13:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:13:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:13:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:13:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-11T00:13:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-11T00:13:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-11T00:13:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-11T00:13:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-11T00:13:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-11T00:13:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-11T00:13:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-11T00:13:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-11T00:13:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-11T00:13:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-11T00:13:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-11T00:13:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-11T00:13:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-11T00:13:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-11T00:13:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-11T00:13:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-11T00:13:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-11T00:13:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-11T00:13:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-11T00:13:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-11T00:13:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-11T00:13:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-11T00:13:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-11T00:13:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-11T00:13:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-11T00:13:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-11T00:13:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-11T00:13:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-11T00:13:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-11T00:13:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-11T00:13:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-11T00:13:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-11T00:13:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-11T00:13:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-11T00:13:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-11T00:13:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-11T00:13:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-11T00:13:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-11T00:13:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-11T00:13:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-11T00:13:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-11T00:13:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-11T00:13:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-11T00:13:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-11T00:13:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-11T00:13:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-11T00:13:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-11T00:13:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-11T00:13:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-11T00:13:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-11T00:13:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-11T00:13:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-11T00:13:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-11T00:13:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-11T00:13:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-11T00:13:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-11T00:13:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-11T00:13:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-11T00:13:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-11T00:13:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-11T00:13:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-11T00:13:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-11T00:13:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-11T00:13:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-11T00:13:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-11T00:13:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-11T00:13:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-11T00:13:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-11T00:13:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-11T00:13:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-11T00:13:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-11T00:13:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-11T00:13:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-11T00:13:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-11T00:13:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-11T00:13:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-11T00:13:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-11T00:13:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-11T00:13:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-11T00:13:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-11T00:13:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-11T00:13:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-11T00:13:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-11T00:13:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-11T00:13:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-11T00:13:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-11T00:13:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-11T00:13:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-11T00:13:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-11T00:13:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-11T00:13:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-11T00:13:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-11T00:13:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-11T00:13:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-11T00:13:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-11T00:13:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-11T00:13:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-11T00:13:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-11T00:13:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-11T00:13:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-11T00:13:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-11T00:13:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-11T00:13:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-11T00:13:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-11T00:13:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-11T00:13:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-11T00:13:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-11T00:13:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-11T00:13:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-11T00:13:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-11T00:13:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-11T00:13:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-11T00:13:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-11T00:13:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-11T00:13:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-11T00:13:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-11T00:13:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-11T00:13:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-11T00:13:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-11T00:13:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-11T00:13:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-11T00:13:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-11T00:13:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-11T00:13:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-11T00:13:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-11T00:13:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-11T00:13:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-11T00:13:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-11T00:13:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-11T00:13:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-11T00:13:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-11T00:13:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-11T00:13:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-11T00:13:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-11T00:13:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-11T00:13:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-11T00:13:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-11T00:13:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-11T00:13:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-11T00:13:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-11T00:13:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-11T00:13:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-11T00:13:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-11T00:13:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-11T00:13:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-11T00:13:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-11T00:13:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-11T00:13:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-11T00:13:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-11T00:13:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-11T00:13:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-11T00:13:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-11T00:13:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-11T00:13:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-11T00:13:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-11T00:13:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-11T00:13:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-11T00:13:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-11T00:13:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-11T00:13:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-11T00:13:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-11T00:13:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-11T00:13:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-11T00:13:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-11T00:13:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-11T00:13:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-11T00:13:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-11T00:13:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-11T00:13:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-11T00:13:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-11T00:13:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-11T00:13:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-11T00:13:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-11T00:13:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-11T00:13:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-11T00:13:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-11T00:13:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-11T00:13:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-11T00:13:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-11T00:13:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-11T00:13:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-11T00:13:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-11T00:13:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-11T00:13:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-11T00:13:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-11T00:13:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-11T00:13:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-11T00:13:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-11T00:13:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-11T00:13:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-11T00:13:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-11T00:13:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-11T00:13:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-11T00:13:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-11T00:13:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-11T00:13:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-11T00:13:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-11T00:13:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-11T00:13:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-11T00:13:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-11T00:13:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-11T00:13:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-11T00:13:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-11T00:13:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-11T00:13:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-11T00:13:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-11T00:13:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-11T00:13:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-11T00:13:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-11T00:13:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-11T00:13:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-11T00:13:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-11T00:13:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-11T00:13:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-11T00:13:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-11T00:13:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-11T00:13:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-11T00:13:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-11T00:13:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-11T00:13:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-11T00:13:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-11T00:13:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-11T00:13:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-11T00:13:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-11T00:13:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-11T00:13:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-11T00:13:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-11T00:13:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-11T00:13:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-11T00:13:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-11T00:13:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-11T00:13:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-11T00:13:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-11T00:13:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-11T00:13:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-11T00:13:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-11T00:13:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-11T00:13:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-11T00:13:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-11T00:13:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-11T00:13:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-11T00:13:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-11T00:13:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-11T00:13:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-11T00:13:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-11T00:13:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-11T00:13:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-11T00:13:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-11T00:13:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-11T00:13:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-11T00:13:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-11T00:13:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-11T00:13:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-11T00:13:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-11T00:13:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-11T00:13:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-11T00:13:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-11T00:13:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-11T00:13:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-11T00:13:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-11T00:13:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-11T00:13:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-11T00:13:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-11T00:13:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-11T00:13:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-11T00:13:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-11T00:13:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-11T00:13:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-11T00:13:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-11T00:13:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-11T00:13:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-11T00:13:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-11T00:13:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-11T00:13:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-11T00:13:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-11T00:13:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-11T00:13:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-11T00:13:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-11T00:13:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-11T00:13:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-11T00:13:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-11T00:13:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-11T00:13:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-11T00:13:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-11T00:13:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-11T00:13:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-11T00:13:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-11T00:13:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-11T00:13:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-11T00:13:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-11T00:13:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-11T00:13:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-11T00:13:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-11T00:13:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-11T00:13:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-11T00:13:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-11T00:13:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-11T00:13:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-11T00:13:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-11T00:13:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-11T00:13:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-11T00:13:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-11T00:13:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-11T00:13:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-11T00:13:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-11T00:13:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-11T00:13:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-11T00:13:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-11T00:13:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-11T00:13:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-11T00:13:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-11T00:13:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-11T00:13:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-11T00:13:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-11T00:13:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-11T00:13:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-11T00:13:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-11T00:13:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-11T00:13:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-11T00:13:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-11T00:13:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-11T00:13:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-11T00:13:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-11T00:13:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-11T00:13:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-11T00:13:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-11T00:13:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-11T00:13:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-11T00:13:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-11T00:13:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-11T00:13:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-11T00:13:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-11T00:13:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-11T00:13:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-11T00:13:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-11T00:13:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-11T00:13:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-11T00:13:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-11T00:13:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-11T00:13:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-11T00:13:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-11T00:13:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-11T00:13:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-11T00:13:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-11T00:13:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-11T00:13:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-11T00:13:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-11T00:13:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-11T00:13:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-11T00:13:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-11T00:13:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-11T00:13:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-11T00:13:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-11T00:13:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-11T00:13:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-11T00:13:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-11T00:13:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-11T00:13:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-11T00:13:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-11T00:13:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-11T00:13:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-11T00:13:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-11T00:13:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-11T00:13:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-11T00:13:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-11T00:13:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-11T00:13:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-11T00:13:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-11T00:13:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-11T00:13:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-11T00:13:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-11T00:13:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-11T00:13:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-11T00:13:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-11T00:13:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-11T00:13:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-11T00:13:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-11T00:13:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-11T00:13:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-11T00:13:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-11T00:13:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-11T00:13:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-11T00:13:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-11T00:13:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-11T00:13:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-11T00:13:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-11T00:13:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-11T00:13:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-11T00:13:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-11T00:13:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-11T00:13:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-11T00:13:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-11T00:13:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-11T00:13:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-11T00:13:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-11T00:13:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-11T00:13:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-11T00:13:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-11T00:13:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-11T00:13:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-11T00:13:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-11T00:13:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-11T00:13:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-11T00:13:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-11T00:13:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-11T00:13:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-11T00:13:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-11T00:13:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-11T00:13:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-11T00:13:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-11T00:13:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-11T00:13:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-11T00:13:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-11T00:13:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-11T00:13:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-11T00:13:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-11T00:13:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-11T00:13:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-11T00:13:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-11T00:13:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-11T00:13:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-11T00:13:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-11T00:13:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-11T00:13:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-11T00:13:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-11T00:13:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-11T00:13:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-11T00:13:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-11T00:13:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-11T00:13:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-11T00:13:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-11T00:13:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-11T00:13:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-11T00:13:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-11T00:13:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-11T00:13:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-11T00:13:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-11T00:13:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-11T00:13:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-11T00:13:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-11T00:13:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-11T00:13:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-11T00:13:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-11T00:13:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-11T00:13:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-11T00:13:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-11T00:13:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-11T00:13:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-11T00:13:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-11T00:13:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-11T00:13:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-11T00:13:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-11T00:13:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-11T00:13:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-11T00:13:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-11T00:13:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-11T00:13:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-11T00:13:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-11T00:13:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-11T00:13:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-11T00:13:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-11T00:13:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-11T00:13:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-11T00:13:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-11T00:13:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-11T00:13:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-11T00:13:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-11T00:13:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-11T00:13:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-11T00:13:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-11T00:13:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-11T00:13:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-11T00:13:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-11T00:13:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-11T00:13:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-11T00:13:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-11T00:13:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-11T00:13:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-11T00:13:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-11T00:13:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-11T00:13:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-11T00:13:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-11T00:13:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-11T00:13:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-11T00:13:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-11T00:13:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-11T00:13:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-11T00:13:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-11T00:13:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-11T00:13:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-11T00:13:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-11T00:13:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-11T00:13:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-11T00:13:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-11T00:13:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-11T00:13:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-11T00:13:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-11T00:13:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-11T00:13:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-11T00:13:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-11T00:13:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-11T00:13:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-11T00:13:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-11T00:13:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-11T00:13:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-11T00:13:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-11T00:13:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-11T00:13:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-11T00:13:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-11T00:13:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-11T00:13:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-11T00:13:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-11T00:13:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-11T00:13:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-11T00:13:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-11T00:13:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-11T00:13:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-11T00:13:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-11T00:13:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-11T00:13:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-11T00:13:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-11T00:13:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-11T00:13:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-11T00:13:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-11T00:13:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-11T00:13:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-11T00:13:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-11T00:13:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-11T00:13:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-11T00:13:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-11T00:13:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-11T00:13:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-11T00:13:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-11T00:13:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-11T00:13:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-11T00:13:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-11T00:13:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-11T00:13:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-11T00:13:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-11T00:13:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-11T00:13:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-11T00:13:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-11T00:13:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-11T00:13:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-11T00:13:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-11T00:13:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-11T00:13:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-11T00:13:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-11T00:13:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-11T00:13:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-11T00:13:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-11T00:13:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-11T00:13:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-11T00:13:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-11T00:13:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-11T00:13:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-11T00:13:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-11T00:13:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-11T00:13:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-11T00:13:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-11T00:13:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-11T00:13:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-11T00:13:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-11T00:13:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-11T00:13:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-11T00:13:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-11T00:13:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-11T00:13:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-11T00:13:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-11T00:13:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-11T00:13:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-11T00:13:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-11T00:13:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-11T00:13:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-11T00:13:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-11T00:13:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-11T00:13:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-11T00:13:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-11T00:13:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-11T00:13:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-11T00:13:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-11T00:13:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-11T00:13:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-11T00:13:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-11T00:13:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-11T00:13:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-11T00:13:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-11T00:13:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-11T00:13:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-11T00:13:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-11T00:13:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-11T00:13:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-11T00:13:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-11T00:13:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-11T00:13:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-11T00:13:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-11T00:13:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-11T00:13:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-11T00:13:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-11T00:13:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-11T00:13:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-11T00:13:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-11T00:13:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-11T00:13:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-11T00:13:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-11T00:13:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-11T00:13:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-11T00:13:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-11T00:13:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-11T00:13:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-11T00:13:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-11T00:13:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-11T00:13:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-11T00:13:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-11T00:13:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-11T00:13:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-11T00:13:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-11T00:13:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-11T00:13:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-11T00:13:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-11T00:13:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-11T00:13:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-11T00:13:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-11T00:13:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-11T00:13:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-11T00:13:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-11T00:13:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-11T00:13:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-11T00:13:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-11T00:13:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-11T00:13:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-11T00:13:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-11T00:13:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-11T00:13:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-11T00:13:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-11T00:13:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-11T00:13:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-11T00:13:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-11T00:13:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-11T00:13:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-11T00:13:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-11T00:13:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-11T00:13:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-11T00:13:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-11T00:13:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-11T00:13:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-11T00:13:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-11T00:13:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-11T00:13:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-11T00:13:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-11T00:13:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-11T00:13:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-11T00:13:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-11T00:13:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-11T00:13:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-11T00:13:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-11T00:13:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-11T00:13:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-11T00:13:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-11T00:13:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-11T00:13:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-11T00:13:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-11T00:13:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-11T00:13:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-11T00:13:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-11T00:13:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-11T00:13:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-11T00:13:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-11T00:13:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-11T00:13:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-11T00:13:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-11T00:13:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-11T00:13:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-11T00:13:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-11T00:13:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-11T00:13:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-11T00:13:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-11T00:13:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-11T00:13:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-11T00:13:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-11T00:13:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-11T00:13:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-11T00:13:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-11T00:13:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-11T00:13:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-11T00:13:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-11T00:13:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-11T00:13:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-11T00:13:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-11T00:13:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-11T00:13:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-11T00:13:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-11T00:13:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-11T00:13:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-11T00:13:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-11T00:13:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-11T00:13:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-11T00:13:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-11T00:13:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-11T00:13:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-11T00:13:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-11T00:13:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-11T00:13:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-11T00:13:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-11T00:13:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-11T00:13:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-11T00:13:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-11T00:13:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-11T00:13:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-11T00:13:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-11T00:13:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-11T00:13:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-11T00:13:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-11T00:13:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-11T00:13:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-11T00:13:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-11T00:13:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-11T00:13:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-11T00:13:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-11T00:13:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-11T00:13:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-11T00:13:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-11T00:13:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-11T00:13:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-11T00:13:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-11T00:13:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-11T00:13:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-11T00:13:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-11T00:13:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-11T00:13:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-11T00:13:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-11T00:13:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-11T00:13:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-11T00:13:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-11T00:13:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-11T00:13:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-11T00:13:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-11T00:13:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-11T00:13:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-11T00:13:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-11T00:13:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-11T00:13:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-11T00:13:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-11T00:13:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-11T00:13:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-11T00:13:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-11T00:13:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-11T00:13:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-11T00:13:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-11T00:13:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-11T00:13:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-11T00:13:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-11T00:13:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-11T00:13:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-11T00:13:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-11T00:13:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-11T00:13:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-11T00:13:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-11T00:13:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-11T00:13:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-11T00:13:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-11T00:13:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-11T00:13:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-11T00:13:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-11T00:13:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-11T00:13:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-11T00:13:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-11T00:13:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-11T00:13:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-11T00:13:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-11T00:13:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-11T00:13:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-11T00:13:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-11T00:13:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-11T00:13:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-11T00:13:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-11T00:13:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-11T00:13:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-11T00:13:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-11T00:13:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-11T00:13:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-11T00:13:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-11T00:13:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-11T00:13:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-11T00:13:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-11T00:13:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-11T00:13:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-11T00:13:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-11T00:13:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-11T00:13:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-11T00:13:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-11T00:13:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-11T00:13:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-11T00:13:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-11T00:13:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-11T00:13:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-11T00:13:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-11T00:13:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-11T00:13:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-11T00:13:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-11T00:13:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-11T00:13:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-11T00:13:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-11T00:13:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-11T00:13:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-11T00:13:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-11T00:13:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-11T00:13:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-11T00:13:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-11T00:13:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-11T00:13:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-11T00:13:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-11T00:13:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-11T00:13:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-11T00:13:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-11T00:13:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-11T00:13:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-11T00:13:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-11T00:13:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-11T00:13:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-11T00:13:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-11T00:13:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-11T00:13:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-11T00:13:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-11T00:13:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-11T00:13:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-11T00:13:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-11T00:13:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-11T00:13:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-11T00:13:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-11T00:13:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-11T00:13:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-11T00:13:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-11T00:13:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-11T00:13:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-11T00:13:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-11T00:13:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-11T00:13:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-11T00:13:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-11T00:13:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-11T00:13:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-11T00:13:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-11T00:13:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-11T00:13:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-11T00:13:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-11T00:13:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-11T00:13:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-11T00:13:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-11T00:13:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-11T00:13:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-11T00:13:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-11T00:13:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-11T00:13:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-11T00:13:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-11T00:13:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-11T00:13:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-11T00:13:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-11T00:13:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-11T00:13:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-11T00:13:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-11T00:13:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-11T00:13:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-11T00:13:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-11T00:13:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-11T00:13:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-11T00:13:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-11T00:13:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-11T00:13:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-11T00:13:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-11T00:13:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-11T00:13:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-11T00:13:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-11T00:13:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-11T00:13:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-11T00:13:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-11T00:13:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-11T00:13:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-11T00:13:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-11T00:13:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-11T00:13:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-11T00:13:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-11T00:13:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-11T00:13:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-11T00:13:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-11T00:13:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-11T00:13:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-11T00:13:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-11T00:13:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-11T00:13:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-11T00:13:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-11T00:13:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-11T00:13:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-11T00:13:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-11T00:13:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-11T00:13:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-11T00:13:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-11T00:13:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-11T00:13:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-11T00:13:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-11T00:13:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-11T00:13:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-11T00:13:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-11T00:13:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-11T00:13:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-11T00:13:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-11T00:13:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-11T00:13:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-11T00:13:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-11T00:13:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-11T00:13:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-11T00:13:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-11T00:13:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-11T00:13:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-11T00:13:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-11T00:13:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-11T00:13:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-11T00:13:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-11T00:13:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-11T00:13:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-11T00:13:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-11T00:13:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-11T00:13:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-11T00:13:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-11T00:13:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-11T00:13:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-11T00:13:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-11T00:13:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-11T00:13:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-11T00:13:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-11T00:13:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-11T00:13:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-11T00:13:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-11T00:13:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-11T00:13:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-11T00:13:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-11T00:13:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-11T00:13:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-11T00:13:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-11T00:13:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-11T00:13:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-11T00:13:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-11T00:13:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-11T00:13:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-11T00:13:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-11T00:13:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-11T00:13:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-11T00:13:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-11T00:13:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-11T00:13:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-11T00:13:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-11T00:13:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-11T00:13:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-11T00:13:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-11T00:13:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-11T00:13:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-11T00:13:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-11T00:13:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-11T00:13:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-11T00:13:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-11T00:13:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-11T00:13:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-11T00:13:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-11T00:13:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-11T00:13:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-11T00:13:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-11T00:13:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-11T00:13:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-11T00:13:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-11T00:13:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-11T00:13:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-11T00:13:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-11T00:13:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-11T00:13:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-11T00:13:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-11T00:13:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-11T00:13:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-11T00:13:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-11T00:13:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-11T00:13:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-11T00:13:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-11T00:13:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-11T00:13:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-11T00:13:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-11T00:13:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-11T00:13:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-11T00:13:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-11T00:13:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-11T00:13:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-11T00:13:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-11T00:13:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-11T00:13:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-11T00:13:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-11T00:13:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-11T00:13:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-11T00:13:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-11T00:13:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-11T00:13:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-11T00:13:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-11T00:13:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-11T00:13:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-11T00:13:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-11T00:13:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-11T00:13:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-11T00:13:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-11T00:13:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-11T00:13:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-11T00:13:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-11T00:13:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-11T00:13:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-11T00:13:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-11T00:13:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-11T00:13:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-11T00:13:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-11T00:13:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-11T00:13:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-11T00:13:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-11T00:13:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-11T00:13:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-11T00:13:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-11T00:13:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-11T00:13:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-11T00:13:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-11T00:13:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-11T00:13:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-11T00:13:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-11T00:13:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-11T00:13:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-11T00:13:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-11T00:13:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-11T00:13:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-11T00:13:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-11T00:13:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-11T00:13:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-11T00:13:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-11T00:13:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-11T00:13:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-11T00:13:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-11T00:13:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-11T00:13:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-11T00:13:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-11T00:13:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-11T00:13:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-11T00:13:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-11T00:13:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-11T00:13:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-11T00:13:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-11T00:13:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-11T00:13:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-11T00:13:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-11T00:13:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-11T00:13:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-11T00:13:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-11T00:13:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-11T00:13:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-11T00:13:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-11T00:13:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-11T00:13:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-11T00:13:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-11T00:13:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-11T00:13:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-11T00:13:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-11T00:13:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-11T00:13:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-11T00:13:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-11T00:13:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-11T00:13:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-11T00:13:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-11T00:13:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-11T00:13:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-11T00:13:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-11T00:13:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-11T00:13:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-11T00:13:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-11T00:13:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-11T00:13:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-11T00:13:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-11T00:13:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-11T00:13:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-11T00:13:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-11T00:13:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-11T00:13:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-11T00:13:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-11T00:13:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-11T00:13:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-11T00:13:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-11T00:13:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-11T00:13:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-11T00:13:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-11T00:13:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-11T00:13:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-11T00:13:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-11T00:13:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-11T00:13:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-11T00:13:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-11T00:13:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-11T00:13:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-11T00:13:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-11T00:13:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-11T00:13:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-11T00:13:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-11T00:13:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-11T00:13:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-11T00:13:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-11T00:13:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-11T00:13:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-11T00:13:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-11T00:13:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-11T00:13:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-11T00:13:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-11T00:13:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-11T00:13:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-11T00:13:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-11T00:13:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-11T00:13:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-11T00:13:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-11T00:13:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-11T00:13:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-11T00:13:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-11T00:13:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-11T00:13:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-11T00:13:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-11T00:13:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-11T00:13:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-11T00:13:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-11T00:13:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-11T00:13:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-11T00:13:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-11T00:13:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-11T00:13:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-11T00:13:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-11T00:13:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-11T00:13:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-11T00:13:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-11T00:13:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-11T00:13:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-11T00:13:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-11T00:13:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-11T00:13:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-11T00:13:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-11T00:13:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-11T00:13:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-11T00:13:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-11T00:13:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-11T00:13:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-11T00:13:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-11T00:13:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-11T00:13:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-11T00:13:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-11T00:13:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-11T00:13:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-11T00:13:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-11T00:13:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-11T00:13:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-11T00:13:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-11T00:13:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-11T00:13:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-11T00:13:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-11T00:13:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-11T00:13:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-11T00:13:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-11T00:13:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-11T00:13:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-11T00:13:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-11T00:13:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-11T00:13:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-11T00:13:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-11T00:13:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-11T00:13:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-11T00:13:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-11T00:13:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-11T00:13:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-11T00:13:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-11T00:13:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-11T00:13:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-11T00:13:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-11T00:13:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-11T00:13:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-11T00:13:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-11T00:13:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-11T00:13:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-11T00:13:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-11T00:13:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-11T00:13:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-11T00:13:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-11T00:13:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-11T00:13:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-11T00:13:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-11T00:13:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-11T00:13:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-11T00:13:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-11T00:13:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-11T00:13:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-11T00:13:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-11T00:13:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-11T00:13:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-11T00:13:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-11T00:13:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-11T00:13:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-11T00:13:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-11T00:13:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-11T00:13:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-11T00:13:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-11T00:13:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-11T00:13:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-11T00:13:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-11T00:13:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-11T00:13:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-11T00:13:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-11T00:13:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-11T00:13:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-11T00:13:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-11T00:13:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-11T00:13:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-11T00:13:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-11T00:13:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-11T00:13:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-11T00:13:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-11T00:13:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-11T00:13:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-11T00:13:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-11T00:13:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-11T00:13:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-11T00:13:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-11T00:13:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-11T00:13:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-11T00:13:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-11T00:13:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-11T00:13:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-11T00:13:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-11T00:13:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-11T00:13:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-11T00:13:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-11T00:13:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-11T00:13:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-11T00:13:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-11T00:13:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-11T00:13:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-11T00:13:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-11T00:13:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-11T00:13:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-11T00:13:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-11T00:13:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-11T00:13:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-11T00:13:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-11T00:13:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-11T00:13:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-11T00:13:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-11T00:13:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-11T00:13:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-11T00:13:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-11T00:13:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-11T00:13:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-11T00:13:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-11T00:13:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-11T00:13:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-11T00:13:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-11T00:13:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-11T00:13:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-11T00:13:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-11T00:13:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-11T00:13:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-11T00:13:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-11T00:13:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-11T00:13:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-11T00:13:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-11T00:13:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-11T00:13:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-11T00:13:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-11T00:13:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-11T00:13:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-11T00:13:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-11T00:13:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-11T00:13:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-11T00:13:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-11T00:13:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-11T00:13:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-11T00:13:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-11T00:13:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-11T00:13:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-11T00:13:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-11T00:13:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-11T00:13:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-11T00:13:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-11T00:13:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-11T00:13:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-11T00:13:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-11T00:13:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-11T00:13:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-11T00:13:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-11T00:13:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-11T00:13:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-11T00:13:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-11T00:13:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-11T00:13:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-11T00:13:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-11T00:13:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-11T00:13:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-11T00:13:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-11T00:13:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-11T00:13:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-11T00:13:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-11T00:13:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-11T00:13:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-11T00:13:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-11T00:13:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-11T00:13:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-11T00:13:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-11T00:13:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-11T00:13:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-11T00:13:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-11T00:13:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-11T00:13:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-11T00:13:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-11T00:13:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-11T00:13:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-11T00:13:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-11T00:13:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-11T00:13:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-11T00:13:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-11T00:13:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-11T00:13:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-11T00:13:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-11T00:13:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-11T00:13:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-11T00:13:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-11T00:13:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-11T00:13:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-11T00:13:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-11T00:13:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-11T00:13:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-11T00:13:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-11T00:13:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-11T00:13:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-11T00:13:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-11T00:13:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-11T00:13:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-11T00:13:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-11T00:13:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-11T00:13:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-11T00:13:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-11T00:13:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-11T00:13:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-11T00:13:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-11T00:13:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-11T00:13:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-11T00:13:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-11T00:13:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-11T00:13:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-11T00:13:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-11T00:13:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-11T00:13:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-11T00:13:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-11T00:13:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-11T00:13:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-11T00:13:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-11T00:13:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-11T00:13:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-11T00:13:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-11T00:13:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-11T00:13:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-11T00:13:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-11T00:13:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-11T00:13:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-11T00:13:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-11T00:13:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-11T00:13:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-11T00:13:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-11T00:13:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-11T00:13:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-11T00:13:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-11T00:13:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-11T00:13:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-11T00:13:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-11T00:13:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-11T00:13:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-11T00:13:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-11T00:13:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-11T00:13:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-11T00:13:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-11T00:13:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-11T00:13:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-11T00:13:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-11T00:13:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-11T00:13:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-11T00:13:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-11T00:13:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-11T00:13:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-11T00:13:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-11T00:13:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-11T00:13:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-11T00:13:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-11T00:13:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-11T00:13:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-11T00:13:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-11T00:13:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-11T00:13:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-11T00:13:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-11T00:13:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-11T00:13:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-11T00:13:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-11T00:13:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-11T00:13:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-11T00:13:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-11T00:13:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-11T00:13:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-11T00:13:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-11T00:13:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-11T00:13:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-11T00:13:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-11T00:13:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-11T00:13:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-11T00:13:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-11T00:13:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-11T00:13:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-11T00:13:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-11T00:13:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-11T00:13:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-11T00:13:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-11T00:13:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-11T00:13:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-11T00:13:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-11T00:13:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-11T00:13:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-11T00:13:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-11T00:13:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-11T00:13:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-11T00:13:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-11T00:13:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-11T00:13:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-11T00:13:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-11T00:13:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-11T00:13:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-11T00:13:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-11T00:13:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-11T00:13:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-11T00:13:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-11T00:13:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-11T00:13:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-11T00:13:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-11T00:13:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-11T00:13:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-11T00:13:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-11T00:13:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-11T00:13:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-11T00:13:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-11T00:13:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-11T00:13:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-11T00:13:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-11T00:13:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-11T00:13:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-11T00:13:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-11T00:13:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-11T00:13:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-11T00:13:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-11T00:13:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-11T00:13:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-11T00:13:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-11T00:13:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-11T00:13:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-11T00:13:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-11T00:13:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-11T00:13:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-11T00:13:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-11T00:13:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-11T00:13:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-11T00:13:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-11T00:13:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-11T00:13:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-11T00:13:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-11T00:13:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-11T00:13:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-11T00:13:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-11T00:13:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-11T00:13:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-11T00:13:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-11T00:13:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-11T00:13:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-11T00:13:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-11T00:13:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-11T00:13:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-11T00:13:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-11T00:13:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-11T00:13:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-11T00:13:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-11T00:13:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-11T00:13:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-11T00:13:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-11T00:13:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-11T00:13:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-11T00:13:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-11T00:13:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-11T00:13:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-11T00:13:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-11T00:13:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-11T00:13:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-11T00:13:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-11T00:13:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-11T00:13:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-11T00:13:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-11T00:13:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-11T00:13:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-11T00:13:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-11T00:13:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-11T00:13:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-11T00:13:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-11T00:13:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-11T00:13:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-11T00:13:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-11T00:13:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-11T00:13:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-11T00:13:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-11T00:13:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-11T00:13:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-11T00:13:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-11T00:13:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-11T00:13:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-11T00:13:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-11T00:13:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-11T00:13:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-11T00:13:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-11T00:13:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-11T00:13:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-11T00:13:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-11T00:13:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-11T00:13:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-11T00:13:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-11T00:13:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-11T00:13:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-11T00:13:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-11T00:13:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-11T00:13:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-11T00:13:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-11T00:13:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-11T00:13:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-11T00:13:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-11T00:13:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-11T00:13:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-11T00:13:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-11T00:13:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-11T00:13:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-11T00:13:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-11T00:13:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-11T00:13:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-11T00:13:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-11T00:13:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-11T00:13:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-11T00:13:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-11T00:13:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-11T00:13:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-11T00:13:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-11T00:13:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-11T00:13:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-11T00:13:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-11T00:13:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-11T00:13:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-11T00:13:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-11T00:13:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-11T00:13:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-11T00:13:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-11T00:13:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-11T00:13:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-11T00:13:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-11T00:13:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-11T00:13:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-11T00:13:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-11T00:13:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-11T00:13:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-11T00:13:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-11T00:13:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-11T00:13:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-11T00:13:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-11T00:13:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-11T00:13:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-11T00:13:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-11T00:13:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-11T00:13:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-11T00:13:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-11T00:13:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-11T00:13:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-11T00:13:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-11T00:13:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-11T00:13:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-11T00:13:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-11T00:13:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-11T00:13:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-11T00:13:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-11T00:13:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-11T00:13:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-11T00:13:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-11T00:13:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-11T00:13:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-11T00:13:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-11T00:13:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-11T00:13:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-11T00:13:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-11T00:13:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-11T00:13:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-11T00:13:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-11T00:13:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-11T00:13:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-11T00:13:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-11T00:13:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-11T00:13:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-11T00:13:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-11T00:13:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-11T00:13:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-11T00:13:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-11T00:13:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-11T00:13:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-11T00:13:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-11T00:13:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-11T00:13:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-11T00:13:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-11T00:13:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-11T00:13:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-11T00:13:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-11T00:13:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-11T00:13:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-11T00:13:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-11T00:13:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-11T00:13:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-11T00:13:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-11T00:13:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-11T00:13:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-11T00:13:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-11T00:13:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-11T00:13:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-11T00:13:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-11T00:13:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-11T00:13:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-11T00:13:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-11T00:13:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-11T00:13:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-11T00:13:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-11T00:13:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-11T00:13:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-11T00:13:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-11T00:13:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-11T00:13:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-11T00:13:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-11T00:13:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-11T00:13:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-11T00:13:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-11T00:13:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-11T00:13:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-11T00:13:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-11T00:13:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-11T00:13:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-11T00:13:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-11T00:13:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-11T00:13:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-11T00:13:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-11T00:13:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-11T00:13:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-11T00:13:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-11T00:13:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-11T00:13:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-11T00:13:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-11T00:13:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-11T00:13:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-11T00:13:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-11T00:13:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-11T00:13:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-11T00:13:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-11T00:13:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-11T00:13:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-11T00:13:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-11T00:13:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-11T00:13:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-11T00:13:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-11T00:13:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-11T00:13:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-11T00:13:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-11T00:13:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-11T00:13:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-11T00:13:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-11T00:13:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-11T00:13:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-11T00:13:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-11T00:13:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-11T00:13:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-11T00:13:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-11T00:13:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-11T00:13:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-11T00:13:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-11T00:13:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-11T00:13:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-11T00:13:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-11T00:13:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-11T00:13:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-11T00:13:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-11T00:13:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-11T00:13:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-11T00:13:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-11T00:13:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-11T00:13:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-11T00:13:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-11T00:13:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-11T00:13:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-11T00:13:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-11T00:13:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-11T00:13:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-11T00:13:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-11T00:13:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-11T00:13:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-11T00:13:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-11T00:13:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-11T00:13:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-11T00:13:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-11T00:13:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-11T00:13:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-11T00:13:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-11T00:13:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-11T00:13:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-11T00:13:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-11T00:13:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-11T00:13:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-11T00:13:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-11T00:13:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-11T00:13:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-11T00:13:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-11T00:13:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-11T00:13:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-11T00:13:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-11T00:13:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-11T00:13:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-11T00:13:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-11T00:13:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-11T00:13:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-11T00:13:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-11T00:13:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-11T00:13:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-11T00:13:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-11T00:13:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-11T00:13:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-11T00:13:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-11T00:13:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-11T00:13:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-11T00:13:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-11T00:13:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-11T00:13:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-11T00:13:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-11T00:13:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-11T00:13:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-11T00:13:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-11T00:13:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-11T00:13:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-11T00:13:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-11T00:13:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-11T00:13:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-11T00:13:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-11T00:13:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-11T00:13:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-11T00:13:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-11T00:13:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-11T00:13:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-11T00:13:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-11T00:13:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-11T00:13:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-11T00:13:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-11T00:13:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-11T00:13:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-11T00:13:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-11T00:13:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-11T00:13:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-11T00:13:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-11T00:13:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-11T00:13:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-11T00:13:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-11T00:13:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-11T00:13:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-11T00:13:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-11T00:13:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-11T00:13:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-11T00:13:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-11T00:13:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-11T00:13:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-11T00:13:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-11T00:13:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-11T00:13:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-11T00:13:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-11T00:13:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-11T00:13:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-11T00:13:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-11T00:13:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-11T00:13:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-11T00:13:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-11T00:13:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-11T00:13:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-11T00:13:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-11T00:13:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-11T00:13:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-11T00:13:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-11T00:13:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-11T00:13:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-11T00:13:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-11T00:13:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-11T00:13:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-11T00:13:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-11T00:13:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-11T00:13:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-11T00:13:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-11T00:13:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-11T00:13:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-11T00:13:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-11T00:13:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-11T00:13:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-11T00:13:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-11T00:13:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-11T00:13:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-11T00:13:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-11T00:13:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-11T00:13:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-11T00:13:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-11T00:13:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-11T00:13:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-11T00:13:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-11T00:13:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-11T00:13:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-11T00:13:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-11T00:13:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-11T00:13:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-11T00:13:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-11T00:13:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-11T00:13:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-11T00:13:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-11T00:13:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-11T00:13:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-11T00:13:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-11T00:13:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-11T00:13:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-11T00:13:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-11T00:13:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-11T00:13:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-11T00:13:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-11T00:13:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-11T00:13:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-11T00:13:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-11T00:13:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-11T00:13:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-11T00:13:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-11T00:13:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-11T00:13:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-11T00:13:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-11T00:13:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-11T00:13:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-11T00:13:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-11T00:13:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-11T00:13:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-11T00:13:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-11T00:13:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-11T00:13:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-11T00:13:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-11T00:13:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-11T00:13:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-11T00:13:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-11T00:13:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-11T00:13:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-11T00:13:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-11T00:13:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-11T00:13:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-11T00:13:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-11T00:13:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-11T00:13:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-11T00:13:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-11T00:13:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-11T00:13:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-11T00:13:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-11T00:13:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-11T00:13:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-11T00:13:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-11T00:13:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-11T00:13:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-11T00:13:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-11T00:13:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-11T00:13:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-11T00:13:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-11T00:13:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-11T00:13:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-11T00:13:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-11T00:13:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-11T00:13:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-11T00:13:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-11T00:13:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-11T00:13:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-11T00:13:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-11T00:13:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-11T00:13:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-11T00:13:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-11T00:13:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-11T00:13:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-11T00:13:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-11T00:13:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-11T00:13:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-11T00:13:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-11T00:13:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-11T00:13:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-11T00:13:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-11T00:13:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-11T00:13:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-11T00:13:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-11T00:13:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-11T00:13:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-11T00:13:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-11T00:13:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-11T00:13:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-11T00:13:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-11T00:13:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-11T00:13:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-11T00:13:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-11T00:13:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-11T00:13:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-11T00:13:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-11T00:13:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-11T00:13:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-11T00:13:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-11T00:13:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-11T00:13:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-11T00:13:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-11T00:13:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-11T00:13:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-11T00:13:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-11T00:13:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-11T00:13:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-11T00:13:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-11T00:13:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-11T00:13:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-11T00:13:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-11T00:13:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-11T00:13:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-11T00:13:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-11T00:13:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-11T00:13:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-11T00:13:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-11T00:13:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-11T00:13:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-11T00:13:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-11T00:13:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-11T00:13:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-11T00:13:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-11T00:13:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-11T00:13:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-11T00:13:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-11T00:13:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-11T00:13:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-11T00:13:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-11T00:13:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-11T00:13:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-11T00:13:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-11T00:13:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-11T00:13:33.093 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:13:33.094 DEBUG:teuthology.orchestra.run.smithi040:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-11T00:13:33.117 INFO:teuthology.orchestra.run.smithi040.stdout:postinstall scriptlet (using /bin/sh): 2024-09-11T00:13:33.117 INFO:teuthology.orchestra.run.smithi040.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-11T00:13:33.117 INFO:teuthology.orchestra.run.smithi040.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-11T00:13:33.117 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2024-09-11T00:13:33.117 INFO:teuthology.orchestra.run.smithi040.stdout:for file in vmlinuz System.map config; do 2024-09-11T00:13:33.117 INFO:teuthology.orchestra.run.smithi040.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-11T00:13:33.117 INFO:teuthology.orchestra.run.smithi040.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T00:13:33.117 INFO:teuthology.orchestra.run.smithi040.stdout: fi 2024-09-11T00:13:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:done 2024-09-11T00:13:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-11T00:13:33.118 INFO:teuthology.orchestra.run.smithi040.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-11T00:13:33.118 INFO:teuthology.orchestra.run.smithi040.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T00:13:33.118 INFO:teuthology.orchestra.run.smithi040.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T00:13:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2024-09-11T00:13:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-11T00:13:33.118 INFO:teuthology.orchestra.run.smithi040.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:13:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2024-09-11T00:13:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-11T00:13:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-11T00:13:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:13:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2024-09-11T00:13:33.119 DEBUG:teuthology.orchestra.run.smithi040:> sudo rpm -qi grub2-tools 2024-09-11T00:13:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:Name : grub2-tools 2024-09-11T00:13:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:Epoch : 1 2024-09-11T00:13:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:Version : 2.06 2024-09-11T00:13:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:Release : 82.el9 2024-09-11T00:13:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: x86_64 2024-09-11T00:13:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T00:13:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:Group : Unspecified 2024-09-11T00:13:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:Size : 8274670 2024-09-11T00:13:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:License : GPLv3+ 2024-09-11T00:13:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T00:13:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T00:13:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T00:13:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T00:13:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:Packager : builder@centos.org 2024-09-11T00:13:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:Vendor : CentOS 2024-09-11T00:13:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T00:13:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:Summary : Support tools for GRUB. 2024-09-11T00:13:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:Description : 2024-09-11T00:13:33.194 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:13:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T00:13:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T00:13:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T00:13:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:hardware devices. 2024-09-11T00:13:33.194 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:13:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T00:13:33.195 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T00:13:33.195 INFO:teuthology.task.kernel:Updating grub on smithi040 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:13:33.195 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T00:13:33.798 INFO:teuthology.orchestra.run.smithi040.stderr:Generating grub configuration file ... 2024-09-11T00:13:35.158 INFO:teuthology.orchestra.run.smithi040.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T00:13:35.205 INFO:teuthology.orchestra.run.smithi040.stderr:done 2024-09-11T00:13:35.207 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2024-09-11T00:13:35.222 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.XtuFuW4jNr 2024-09-11T00:13:35.222 DEBUG:teuthology.orchestra.run.smithi040:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XtuFuW4jNr 2024-09-11T00:13:35.298 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.XtuFuW4jNr 2024-09-11T00:13:35.436 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.XtuFuW4jNr is 6KB 2024-09-11T00:13:35.486 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.XtuFuW4jNr 2024-09-11T00:13:35.501 DEBUG:teuthology.orchestra.run.smithi040:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T00:13:35.562 INFO:teuthology.orchestra.run.smithi040.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T00:13:35.563 INFO:teuthology.orchestra.run.smithi040.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T00:13:35.563 INFO:teuthology.orchestra.run.smithi040.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T00:13:35.563 INFO:teuthology.orchestra.run.smithi040.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-11T00:13:35.564 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:13:35.726 DEBUG:teuthology.orchestra.run.smithi040:> sudo shutdown -r now 2024-09-11T00:14:01.357 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-11T00:14:01.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-11T00:14:01.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:14:05.733 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T00:14:05.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-11T00:14:05.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:14:24.317 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-09-11T00:14:33.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-11T00:14:33.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:14:35.837 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-09-11T00:14:44.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-11T00:14:44.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:15:03.233 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-09-11T00:15:15.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-11T00:15:15.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:15:17.137 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-09-11T00:15:17.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-11T00:15:17.705 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-11T00:15:17.706 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-09-11T00:15:17.743 INFO:teuthology.orchestra.run.smithi175.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:15:17.743 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:15:17.743 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T00:15:17.743 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T00:15:18.744 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-11T00:15:18.744 DEBUG:teuthology.orchestra.run.smithi175:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T00:15:18.882 INFO:teuthology.orchestra.run.smithi175.stdout:ttyS1 2024-09-11T00:15:18.912 DEBUG:teuthology.parallel:result is None 2024-09-11T00:15:33.337 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T00:15:45.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-11T00:15:45.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:15:45.754 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-09-11T00:15:46.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-11T00:15:46.234 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-11T00:15:46.234 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-09-11T00:15:46.272 INFO:teuthology.orchestra.run.smithi040.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:15:46.272 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:15:46.272 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T00:15:46.272 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T00:15:47.273 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T00:15:47.274 DEBUG:teuthology.orchestra.run.smithi040:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T00:15:47.382 INFO:teuthology.orchestra.run.smithi040.stdout:ttyS1 2024-09-11T00:15:47.423 DEBUG:teuthology.parallel:result is None 2024-09-11T00:15:47.423 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T00:15:47.431 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T00:15:47.431 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T00:15:47.435 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T00:15:47.476 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T00:15:47.484 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T00:15:47.493 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T00:15:47.493 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T00:15:47.512 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T00:15:47.567 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T00:15:47.574 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T00:15:47.574 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T00:15:47.594 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T00:15:47.656 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T00:15:47.663 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T00:15:47.679 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T00:15:47.686 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T00:15:47.690 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T00:15:47.697 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T00:15:47.697 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T00:15:47.701 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T00:15:47.757 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T00:15:47.794 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T00:15:47.795 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T00:15:47.799 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T00:15:47.833 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T00:15:47.944 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T00:15:48.054 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T00:15:48.125 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T00:15:48.188 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:15:48.188 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T00:15:48.242 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T00:15:48.313 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T00:15:48.427 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T00:15:48.499 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T00:15:48.560 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:15:48.560 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T00:15:48.614 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2024-09-11T00:15:48.618 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-09-11T00:15:48.701 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:15:48.763 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:15:49.117 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T00:15:49.125 INFO:teuthology.task.internal:Starting timer... 2024-09-11T00:15:49.125 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T00:15:49.139 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T00:15:49.148 DEBUG:teuthology.orchestra.run.smithi040:> sudo service auditd rotate 2024-09-11T00:15:49.283 INFO:teuthology.orchestra.run.smithi040.stdout:Rotating logs: 2024-09-11T00:15:49.287 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2024-09-11T00:15:49.395 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: 2024-09-11T00:15:49.398 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T00:15:49.398 DEBUG:teuthology.orchestra.run.smithi040:> /usr/sbin/getenforce 2024-09-11T00:15:49.444 INFO:teuthology.orchestra.run.smithi040.stdout:Permissive 2024-09-11T00:15:49.445 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2024-09-11T00:15:49.487 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2024-09-11T00:15:49.487 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi040.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive'} 2024-09-11T00:15:49.488 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T00:15:49.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:15:49.547 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T00:15:49.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:15:49.606 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T00:15:49.606 DEBUG:teuthology.orchestra.run.smithi040:> sudo /usr/sbin/setenforce permissive 2024-09-11T00:15:49.671 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2024-09-11T00:15:49.755 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T00:15:49.765 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-11T00:15:49.768 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-11T00:15:49.962 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T00:15:49.973 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T00:15:49.974 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi040.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T00:20:28.507 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi040.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2024-09-11T00:20:28.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-11T00:20:28.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:20:28.607 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-09-11T00:20:28.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-11T00:20:28.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-11T00:20:28.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:20:28.827 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-09-11T00:20:28.931 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-11T00:20:28.931 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T00:20:28.942 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T00:20:28.942 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T00:20:28.943 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:20:28.947 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T00:20:28.947 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:20:29.004 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T00:20:29.031 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T00:20:29.035 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T00:20:29.061 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T00:20:29.087 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: ntpd: command not found 2024-09-11T00:20:29.111 INFO:teuthology.orchestra.run.smithi040.stdout:506 Cannot talk to daemon 2024-09-11T00:20:29.112 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2024-09-11T00:20:29.135 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2024-09-11T00:20:29.141 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T00:20:29.164 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T00:20:29.171 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T00:20:29.193 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T00:20:29.277 INFO:teuthology.orchestra.run.smithi040.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:20:29.284 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:20:29.284 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2024-09-11T00:20:29.284 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:20:29.285 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:20:29.285 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:20:29.285 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:20:29.288 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:20:29.295 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:20:29.296 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-09-11T00:20:29.296 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:20:29.296 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:20:29.296 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:20:29.296 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:20:29.297 INFO:teuthology.run_tasks:Running task install... 2024-09-11T00:20:29.305 DEBUG:teuthology.task.install:project ceph 2024-09-11T00:20:29.305 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-11T00:20:29.305 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-11T00:20:29.305 INFO:teuthology.task.install:Using flavor: default 2024-09-11T00:20:29.311 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T00:20:29.311 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-11T00:20:29.312 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-11T00:20:29.312 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:20:29.314 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-11T00:20:29.314 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:20:29.465 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-11T00:20:29.466 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-11T00:20:29.480 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-11T00:20:29.480 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-11T00:20:29.588 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T00:20:29.588 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:20:29.588 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T00:20:29.600 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T00:20:29.600 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:20:29.600 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T00:20:29.645 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T00:20:29.645 DEBUG:teuthology.orchestra.run.smithi040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T00:20:29.655 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T00:20:29.655 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T00:20:29.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T00:20:29.752 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T00:20:29.821 DEBUG:teuthology.orchestra.run.smithi040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T00:20:29.830 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T00:20:29.876 INFO:teuthology.orchestra.run.smithi040.stdout:check_obsoletes = 1 2024-09-11T00:20:29.879 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum clean all 2024-09-11T00:20:29.884 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2024-09-11T00:20:29.888 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2024-09-11T00:20:30.149 INFO:teuthology.orchestra.run.smithi175.stdout:45 files removed 2024-09-11T00:20:30.154 INFO:teuthology.orchestra.run.smithi040.stdout:45 files removed 2024-09-11T00:20:30.181 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T00:20:30.189 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T00:20:30.885 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 271 kB/s | 84 kB 00:00 2024-09-11T00:20:30.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph packages for x86_64 267 kB/s | 84 kB 00:00 2024-09-11T00:20:31.194 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 91 kB/s | 24 kB 00:00 2024-09-11T00:20:31.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph noarch packages 89 kB/s | 24 kB 00:00 2024-09-11T00:20:31.469 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-11T00:20:31.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-11T00:20:32.156 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-11T00:20:33.344 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-09-11T00:20:33.908 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - AppStream 36 MB/s | 20 MB 00:00 2024-09-11T00:20:38.145 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 5.6 MB/s | 20 MB 00:03 2024-09-11T00:20:41.509 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - CRB 1.9 MB/s | 6.5 MB 00:03 2024-09-11T00:20:43.037 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 7.8 MB/s | 6.5 MB 00:00 2024-09-11T00:20:43.701 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 19 kB 00:00 2024-09-11T00:20:44.871 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 19 kB 00:00 2024-09-11T00:20:44.972 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-11T00:20:45.767 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-11T00:20:51.569 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-09-11T00:20:52.114 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-11T00:20:54.249 INFO:teuthology.orchestra.run.smithi040.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:20:54.250 INFO:teuthology.orchestra.run.smithi040.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:20:54.262 INFO:teuthology.orchestra.run.smithi040.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T00:20:54.263 INFO:teuthology.orchestra.run.smithi040.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T00:20:54.264 INFO:teuthology.orchestra.run.smithi040.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T00:20:54.265 INFO:teuthology.orchestra.run.smithi040.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T00:20:54.267 INFO:teuthology.orchestra.run.smithi040.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T00:20:54.269 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T00:20:54.270 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T00:20:54.341 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-09-11T00:20:54.362 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================= 2024-09-11T00:20:54.362 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-09-11T00:20:54.362 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================= 2024-09-11T00:20:54.362 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-09-11T00:20:54.362 INFO:teuthology.orchestra.run.smithi040.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T00:20:54.363 INFO:teuthology.orchestra.run.smithi040.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-11T00:20:54.363 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:20:54.363 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-11T00:20:54.363 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-11T00:20:54.363 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-11T00:20:54.363 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-11T00:20:54.363 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-11T00:20:54.363 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-11T00:20:54.363 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-11T00:20:54.363 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-11T00:20:54.363 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-11T00:20:54.363 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-11T00:20:54.364 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-11T00:20:54.364 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-11T00:20:54.364 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-11T00:20:54.364 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-11T00:20:54.364 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T00:20:54.364 INFO:teuthology.orchestra.run.smithi040.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T00:20:54.364 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T00:20:54.364 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-11T00:20:54.364 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-11T00:20:54.364 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-11T00:20:54.364 INFO:teuthology.orchestra.run.smithi040.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T00:20:54.364 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T00:20:54.365 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T00:20:54.365 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T00:20:54.365 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T00:20:54.365 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T00:20:54.365 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-11T00:20:54.365 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-11T00:20:54.365 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-11T00:20:54.365 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-11T00:20:54.365 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-11T00:20:54.365 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:20:54.365 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-11T00:20:54.365 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T00:20:54.366 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2024-09-11T00:20:54.366 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T00:20:54.366 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T00:20:54.366 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T00:20:54.366 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T00:20:54.366 INFO:teuthology.orchestra.run.smithi040.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-11T00:20:54.366 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:20:54.366 INFO:teuthology.orchestra.run.smithi040.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T00:20:54.366 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T00:20:54.366 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-09-11T00:20:54.366 INFO:teuthology.orchestra.run.smithi040.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T00:20:54.366 INFO:teuthology.orchestra.run.smithi040.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T00:20:54.366 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T00:20:54.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-11T00:20:54.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-11T00:20:54.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-11T00:20:54.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-11T00:20:54.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-11T00:20:54.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-11T00:20:54.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-11T00:20:54.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-11T00:20:54.367 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T00:20:54.367 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T00:20:54.367 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T00:20:54.367 INFO:teuthology.orchestra.run.smithi040.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T00:20:54.368 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T00:20:54.368 INFO:teuthology.orchestra.run.smithi040.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T00:20:54.368 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T00:20:54.368 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T00:20:54.368 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-11T00:20:54.368 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T00:20:54.368 INFO:teuthology.orchestra.run.smithi040.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T00:20:54.368 INFO:teuthology.orchestra.run.smithi040.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T00:20:54.368 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T00:20:54.368 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T00:20:54.368 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T00:20:54.368 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-11T00:20:54.368 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T00:20:54.369 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:20:54.369 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T00:20:54.369 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T00:20:54.369 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T00:20:54.369 INFO:teuthology.orchestra.run.smithi040.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T00:20:54.369 INFO:teuthology.orchestra.run.smithi040.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T00:20:54.369 INFO:teuthology.orchestra.run.smithi040.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T00:20:54.370 INFO:teuthology.orchestra.run.smithi040.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T00:20:54.370 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T00:20:54.370 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T00:20:54.370 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T00:20:54.370 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T00:20:54.370 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T00:20:54.370 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T00:20:54.370 INFO:teuthology.orchestra.run.smithi040.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T00:20:54.370 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T00:20:54.370 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T00:20:54.370 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T00:20:54.370 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-11T00:20:54.371 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-11T00:20:54.371 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T00:20:54.371 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T00:20:54.371 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T00:20:54.371 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T00:20:54.371 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T00:20:54.371 INFO:teuthology.orchestra.run.smithi040.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T00:20:54.371 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T00:20:54.371 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T00:20:54.371 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T00:20:54.371 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T00:20:54.371 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T00:20:54.371 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T00:20:54.371 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T00:20:54.372 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T00:20:54.372 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T00:20:54.372 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T00:20:54.372 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T00:20:54.372 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T00:20:54.372 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T00:20:54.372 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T00:20:54.372 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T00:20:54.372 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T00:20:54.372 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T00:20:54.372 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T00:20:54.372 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T00:20:54.372 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T00:20:54.373 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T00:20:54.373 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T00:20:54.373 INFO:teuthology.orchestra.run.smithi040.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T00:20:54.373 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T00:20:54.373 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T00:20:54.373 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T00:20:54.373 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T00:20:54.373 INFO:teuthology.orchestra.run.smithi040.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T00:20:54.373 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T00:20:54.373 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T00:20:54.373 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T00:20:54.373 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T00:20:54.374 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T00:20:54.374 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T00:20:54.374 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T00:20:54.374 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T00:20:54.374 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T00:20:54.374 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T00:20:54.374 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T00:20:54.374 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T00:20:54.374 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T00:20:54.374 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T00:20:54.374 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T00:20:54.374 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T00:20:54.374 INFO:teuthology.orchestra.run.smithi040.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T00:20:54.375 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T00:20:54.375 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T00:20:54.375 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T00:20:54.375 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T00:20:54.375 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T00:20:54.375 INFO:teuthology.orchestra.run.smithi040.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T00:20:54.375 INFO:teuthology.orchestra.run.smithi040.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T00:20:54.375 INFO:teuthology.orchestra.run.smithi040.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T00:20:54.375 INFO:teuthology.orchestra.run.smithi040.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T00:20:54.375 INFO:teuthology.orchestra.run.smithi040.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T00:20:54.375 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T00:20:54.375 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T00:20:54.375 INFO:teuthology.orchestra.run.smithi040.stdout:Installing weak dependencies: 2024-09-11T00:20:54.376 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T00:20:54.376 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:20:54.376 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-09-11T00:20:54.376 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================= 2024-09-11T00:20:54.376 INFO:teuthology.orchestra.run.smithi040.stdout:Install 149 Packages 2024-09-11T00:20:54.376 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 8 Packages 2024-09-11T00:20:54.376 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:20:54.376 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 240 M 2024-09-11T00:20:54.377 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-09-11T00:20:54.618 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:20:54.619 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:20:54.631 INFO:teuthology.orchestra.run.smithi175.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T00:20:54.632 INFO:teuthology.orchestra.run.smithi175.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T00:20:54.632 INFO:teuthology.orchestra.run.smithi175.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T00:20:54.633 INFO:teuthology.orchestra.run.smithi175.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T00:20:54.635 INFO:teuthology.orchestra.run.smithi175.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T00:20:54.638 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T00:20:54.638 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T00:20:54.704 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-11T00:20:54.726 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-09-11T00:20:54.726 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-09-11T00:20:54.726 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-09-11T00:20:54.726 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-11T00:20:54.726 INFO:teuthology.orchestra.run.smithi175.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T00:20:54.726 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-11T00:20:54.726 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:20:54.726 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-11T00:20:54.726 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-11T00:20:54.726 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-11T00:20:54.726 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-11T00:20:54.726 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-11T00:20:54.727 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-11T00:20:54.727 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-11T00:20:54.727 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-11T00:20:54.727 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-11T00:20:54.727 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-11T00:20:54.727 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-11T00:20:54.727 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-11T00:20:54.727 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-11T00:20:54.727 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-11T00:20:54.727 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T00:20:54.727 INFO:teuthology.orchestra.run.smithi175.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T00:20:54.727 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T00:20:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-11T00:20:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-11T00:20:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-11T00:20:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T00:20:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T00:20:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T00:20:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T00:20:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T00:20:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T00:20:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-11T00:20:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-11T00:20:54.728 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-11T00:20:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-11T00:20:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-11T00:20:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:20:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-11T00:20:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T00:20:54.729 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2024-09-11T00:20:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T00:20:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T00:20:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T00:20:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T00:20:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-11T00:20:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:20:54.729 INFO:teuthology.orchestra.run.smithi175.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T00:20:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T00:20:54.730 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-09-11T00:20:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T00:20:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T00:20:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T00:20:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-11T00:20:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-11T00:20:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-11T00:20:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-11T00:20:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-11T00:20:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-11T00:20:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-11T00:20:54.730 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-11T00:20:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T00:20:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T00:20:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T00:20:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T00:20:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T00:20:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T00:20:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T00:20:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T00:20:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-11T00:20:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T00:20:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T00:20:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T00:20:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T00:20:54.731 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T00:20:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T00:20:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-11T00:20:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T00:20:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:20:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T00:20:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T00:20:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T00:20:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T00:20:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T00:20:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T00:20:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T00:20:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T00:20:54.732 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T00:20:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T00:20:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T00:20:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T00:20:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T00:20:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T00:20:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T00:20:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T00:20:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T00:20:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-11T00:20:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-11T00:20:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T00:20:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T00:20:54.733 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T00:20:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T00:20:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T00:20:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T00:20:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T00:20:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T00:20:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T00:20:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T00:20:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T00:20:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T00:20:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T00:20:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T00:20:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T00:20:54.734 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T00:20:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T00:20:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T00:20:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T00:20:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T00:20:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T00:20:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T00:20:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T00:20:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T00:20:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T00:20:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T00:20:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T00:20:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T00:20:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T00:20:54.735 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T00:20:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T00:20:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T00:20:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T00:20:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T00:20:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T00:20:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T00:20:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T00:20:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T00:20:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T00:20:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T00:20:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T00:20:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T00:20:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T00:20:54.736 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T00:20:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T00:20:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T00:20:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T00:20:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T00:20:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T00:20:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T00:20:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T00:20:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T00:20:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T00:20:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T00:20:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T00:20:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T00:20:54.737 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T00:20:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T00:20:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T00:20:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T00:20:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T00:20:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T00:20:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T00:20:54.738 INFO:teuthology.orchestra.run.smithi175.stdout:Installing weak dependencies: 2024-09-11T00:20:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T00:20:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:20:54.738 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-11T00:20:54.738 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-09-11T00:20:54.738 INFO:teuthology.orchestra.run.smithi175.stdout:Install 149 Packages 2024-09-11T00:20:54.738 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 8 Packages 2024-09-11T00:20:54.738 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:20:54.739 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 240 M 2024-09-11T00:20:54.739 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-11T00:20:55.366 INFO:teuthology.orchestra.run.smithi175.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 54 kB/s | 6.6 kB 00:00 2024-09-11T00:20:55.532 INFO:teuthology.orchestra.run.smithi175.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 5.3 MB/s | 900 kB 00:00 2024-09-11T00:20:55.591 INFO:teuthology.orchestra.run.smithi175.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 2.4 MB/s | 145 kB 00:00 2024-09-11T00:20:55.758 INFO:teuthology.orchestra.run.smithi175.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-11T00:20:55.817 INFO:teuthology.orchestra.run.smithi175.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 11 MB/s | 2.4 MB 00:00 2024-09-11T00:20:55.883 INFO:teuthology.orchestra.run.smithi175.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 12 MB/s | 1.5 MB 00:00 2024-09-11T00:20:55.912 INFO:teuthology.orchestra.run.smithi040.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 37 kB/s | 6.6 kB 00:00 2024-09-11T00:20:56.176 INFO:teuthology.orchestra.run.smithi175.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 13 MB/s | 4.8 MB 00:00 2024-09-11T00:20:56.504 INFO:teuthology.orchestra.run.smithi040.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 1.5 MB/s | 900 kB 00:00 2024-09-11T00:20:56.712 INFO:teuthology.orchestra.run.smithi040.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 698 kB/s | 145 kB 00:00 2024-09-11T00:20:56.934 INFO:teuthology.orchestra.run.smithi175.stdout:(8/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x86 16 MB/s | 17 MB 00:01 2024-09-11T00:20:57.080 INFO:teuthology.orchestra.run.smithi040.stdout:(4/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 6.5 MB/s | 2.4 MB 00:00 2024-09-11T00:20:57.159 INFO:teuthology.orchestra.run.smithi175.stdout:(9/157): ceph-common-19.3.0-4854.g8f219c47.el9. 11 MB/s | 22 MB 00:01 2024-09-11T00:20:57.176 INFO:teuthology.orchestra.run.smithi175.stdout:(10/157): ceph-selinux-19.3.0-4854.g8f219c47.el 104 kB/s | 25 kB 00:00 2024-09-11T00:20:57.255 INFO:teuthology.orchestra.run.smithi040.stdout:(5/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 8.7 MB/s | 1.5 MB 00:00 2024-09-11T00:20:57.326 INFO:teuthology.orchestra.run.smithi175.stdout:(11/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 9.5 MB/s | 11 MB 00:01 2024-09-11T00:20:57.360 INFO:teuthology.orchestra.run.smithi175.stdout:(12/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 1.2 MB/s | 225 kB 00:00 2024-09-11T00:20:57.385 INFO:teuthology.orchestra.run.smithi175.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 466 kB/s | 27 kB 00:00 2024-09-11T00:20:57.410 INFO:teuthology.orchestra.run.smithi175.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 636 kB/s | 32 kB 00:00 2024-09-11T00:20:57.461 INFO:teuthology.orchestra.run.smithi175.stdout:(15/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 9.8 MB/s | 755 kB 00:00 2024-09-11T00:20:57.486 INFO:teuthology.orchestra.run.smithi175.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.1 MB/s | 162 kB 00:00 2024-09-11T00:20:57.520 INFO:teuthology.orchestra.run.smithi175.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 2.1 MB/s | 127 kB 00:00 2024-09-11T00:20:57.561 INFO:teuthology.orchestra.run.smithi175.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 6.6 MB/s | 507 kB 00:00 2024-09-11T00:20:57.622 INFO:teuthology.orchestra.run.smithi040.stdout:(6/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 13 MB/s | 4.8 MB 00:00 2024-09-11T00:20:57.650 INFO:teuthology.orchestra.run.smithi175.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 514 kB/s | 45 kB 00:00 2024-09-11T00:20:57.721 INFO:teuthology.orchestra.run.smithi175.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 2.0 MB/s | 143 kB 00:00 2024-09-11T00:20:57.722 INFO:teuthology.orchestra.run.smithi040.stdout:(7/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 2.8 MB/s | 5.5 MB 00:01 2024-09-11T00:20:57.846 INFO:teuthology.orchestra.run.smithi175.stdout:(21/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 17 MB/s | 5.5 MB 00:00 2024-09-11T00:20:57.871 INFO:teuthology.orchestra.run.smithi175.stdout:(22/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.0 MB/s | 161 kB 00:00 2024-09-11T00:20:57.913 INFO:teuthology.orchestra.run.smithi175.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 4.7 MB/s | 321 kB 00:00 2024-09-11T00:20:57.947 INFO:teuthology.orchestra.run.smithi175.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 4.0 MB/s | 306 kB 00:00 2024-09-11T00:20:57.980 INFO:teuthology.orchestra.run.smithi175.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.5 MB/s | 99 kB 00:00 2024-09-11T00:20:58.014 INFO:teuthology.orchestra.run.smithi175.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.2 MB/s | 85 kB 00:00 2024-09-11T00:20:58.114 INFO:teuthology.orchestra.run.smithi175.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 1.7 MB/s | 171 kB 00:00 2024-09-11T00:20:58.240 INFO:teuthology.orchestra.run.smithi175.stdout:(28/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 12 MB/s | 3.2 MB 00:00 2024-09-11T00:20:58.265 INFO:teuthology.orchestra.run.smithi175.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 228 kB/s | 34 kB 00:00 2024-09-11T00:20:58.307 INFO:teuthology.orchestra.run.smithi175.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.3 MB/s | 154 kB 00:00 2024-09-11T00:20:58.698 INFO:teuthology.orchestra.run.smithi040.stdout:(8/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x86 16 MB/s | 17 MB 00:01 2024-09-11T00:20:58.781 INFO:teuthology.orchestra.run.smithi040.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 303 kB/s | 25 kB 00:00 2024-09-11T00:20:58.832 INFO:teuthology.orchestra.run.smithi175.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 14 MB/s | 7.4 MB 00:00 2024-09-11T00:20:58.960 INFO:teuthology.orchestra.run.smithi175.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 2.2 MB/s | 291 kB 00:00 2024-09-11T00:20:59.066 INFO:teuthology.orchestra.run.smithi175.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 469 kB/s | 49 kB 00:00 2024-09-11T00:20:59.174 INFO:teuthology.orchestra.run.smithi175.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 152 kB/s | 16 kB 00:00 2024-09-11T00:20:59.275 INFO:teuthology.orchestra.run.smithi175.stdout:(35/157): ceph-volume-19.3.0-4854.g8f219c47.el9 2.8 MB/s | 285 kB 00:00 2024-09-11T00:20:59.775 INFO:teuthology.orchestra.run.smithi175.stdout:(36/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 9.4 MB/s | 14 MB 00:01 2024-09-11T00:20:59.867 INFO:teuthology.orchestra.run.smithi175.stdout:(37/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 200 kB/s | 18 kB 00:00 2024-09-11T00:20:59.967 INFO:teuthology.orchestra.run.smithi175.stdout:(38/157): fuse-2.9.9-16.el9.x86_64.rpm 799 kB/s | 80 kB 00:00 2024-09-11T00:21:00.068 INFO:teuthology.orchestra.run.smithi175.stdout:(39/157): libgfortran-11.5.0-2.el9.x86_64.rpm 7.8 MB/s | 801 kB 00:00 2024-09-11T00:21:00.101 INFO:teuthology.orchestra.run.smithi175.stdout:(40/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 948 kB/s | 783 kB 00:00 2024-09-11T00:21:00.126 INFO:teuthology.orchestra.run.smithi175.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-11T00:21:00.194 INFO:teuthology.orchestra.run.smithi175.stdout:(42/157): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-09-11T00:21:00.260 INFO:teuthology.orchestra.run.smithi175.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-11T00:21:00.286 INFO:teuthology.orchestra.run.smithi175.stdout:(44/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-11T00:21:00.311 INFO:teuthology.orchestra.run.smithi175.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-11T00:21:00.336 INFO:teuthology.orchestra.run.smithi175.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-11T00:21:00.361 INFO:teuthology.orchestra.run.smithi175.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-11T00:21:00.740 INFO:teuthology.orchestra.run.smithi040.stdout:(10/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 26 MB/s | 50 MB 00:01 2024-09-11T00:21:00.790 INFO:teuthology.orchestra.run.smithi040.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 4.5 MB/s | 225 kB 00:00 2024-09-11T00:21:00.840 INFO:teuthology.orchestra.run.smithi040.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 544 kB/s | 27 kB 00:00 2024-09-11T00:21:00.856 INFO:teuthology.orchestra.run.smithi175.stdout:(48/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 14 MB/s | 50 MB 00:03 2024-09-11T00:21:00.890 INFO:teuthology.orchestra.run.smithi040.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 640 kB/s | 32 kB 00:00 2024-09-11T00:21:00.966 INFO:teuthology.orchestra.run.smithi040.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 9.9 MB/s | 755 kB 00:00 2024-09-11T00:21:01.024 INFO:teuthology.orchestra.run.smithi040.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.7 MB/s | 162 kB 00:00 2024-09-11T00:21:01.075 INFO:teuthology.orchestra.run.smithi040.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-11T00:21:01.125 INFO:teuthology.orchestra.run.smithi040.stdout:(17/157): libradosstriper1-19.3.0-4854.g8f219c4 9.9 MB/s | 507 kB 00:00 2024-09-11T00:21:01.350 INFO:teuthology.orchestra.run.smithi040.stdout:(18/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 25 MB/s | 5.5 MB 00:00 2024-09-11T00:21:01.392 INFO:teuthology.orchestra.run.smithi040.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 1.1 MB/s | 45 kB 00:00 2024-09-11T00:21:01.443 INFO:teuthology.orchestra.run.smithi040.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 2.8 MB/s | 143 kB 00:00 2024-09-11T00:21:01.445 INFO:teuthology.orchestra.run.smithi175.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 181 kB/s | 107 kB 00:00 2024-09-11T00:21:01.568 INFO:teuthology.orchestra.run.smithi040.stdout:(21/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 2.8 MB/s | 11 MB 00:03 2024-09-11T00:21:01.593 INFO:teuthology.orchestra.run.smithi040.stdout:(22/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.1 MB/s | 161 kB 00:00 2024-09-11T00:21:01.596 INFO:teuthology.orchestra.run.smithi175.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 145 kB/s | 22 kB 00:00 2024-09-11T00:21:01.660 INFO:teuthology.orchestra.run.smithi040.stdout:(23/157): python3-rbd-19.3.0-4854.g8f219c47.el9 4.5 MB/s | 306 kB 00:00 2024-09-11T00:21:01.685 INFO:teuthology.orchestra.run.smithi040.stdout:(24/157): python3-rados-19.3.0-4854.g8f219c47.e 2.7 MB/s | 321 kB 00:00 2024-09-11T00:21:01.711 INFO:teuthology.orchestra.run.smithi040.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.9 MB/s | 99 kB 00:00 2024-09-11T00:21:01.736 INFO:teuthology.orchestra.run.smithi040.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-11T00:21:01.779 INFO:teuthology.orchestra.run.smithi175.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 477 kB/s | 689 kB 00:01 2024-09-11T00:21:01.836 INFO:teuthology.orchestra.run.smithi040.stdout:(27/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 25 MB/s | 3.2 MB 00:00 2024-09-11T00:21:01.861 INFO:teuthology.orchestra.run.smithi040.stdout:(28/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 1.3 MB/s | 171 kB 00:00 2024-09-11T00:21:01.863 INFO:teuthology.orchestra.run.smithi175.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-09-11T00:21:01.878 INFO:teuthology.orchestra.run.smithi040.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 822 kB/s | 34 kB 00:00 2024-09-11T00:21:01.905 INFO:teuthology.orchestra.run.smithi175.stdout:(53/157): bison-3.7.4-5.el9.x86_64.rpm 611 kB/s | 943 kB 00:01 2024-09-11T00:21:01.937 INFO:teuthology.orchestra.run.smithi040.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.0 MB/s | 154 kB 00:00 2024-09-11T00:21:01.947 INFO:teuthology.orchestra.run.smithi175.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 195 kB/s | 33 kB 00:00 2024-09-11T00:21:02.097 INFO:teuthology.orchestra.run.smithi175.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 95 kB/s | 18 kB 00:00 2024-09-11T00:21:02.139 INFO:teuthology.orchestra.run.smithi175.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 58 kB/s | 11 kB 00:00 2024-09-11T00:21:02.248 INFO:teuthology.orchestra.run.smithi175.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.1 MB/s | 171 kB 00:00 2024-09-11T00:21:02.290 INFO:teuthology.orchestra.run.smithi175.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-11T00:21:02.343 INFO:teuthology.orchestra.run.smithi040.stdout:(31/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 30 MB/s | 14 MB 00:00 2024-09-11T00:21:02.396 INFO:teuthology.orchestra.run.smithi040.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 5.5 MB/s | 291 kB 00:00 2024-09-11T00:21:02.415 INFO:teuthology.orchestra.run.smithi175.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 271 kB/s | 45 kB 00:00 2024-09-11T00:21:02.438 INFO:teuthology.orchestra.run.smithi040.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 1.2 MB/s | 49 kB 00:00 2024-09-11T00:21:02.471 INFO:teuthology.orchestra.run.smithi040.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 494 kB/s | 16 kB 00:00 2024-09-11T00:21:02.522 INFO:teuthology.orchestra.run.smithi040.stdout:(35/157): ceph-volume-19.3.0-4854.g8f219c47.el9 5.6 MB/s | 285 kB 00:00 2024-09-11T00:21:02.540 INFO:teuthology.orchestra.run.smithi175.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 2.6 MB/s | 662 kB 00:00 2024-09-11T00:21:02.581 INFO:teuthology.orchestra.run.smithi040.stdout:(36/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 13 MB/s | 783 kB 00:00 2024-09-11T00:21:02.616 INFO:teuthology.orchestra.run.smithi175.stdout:(61/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.0 MB/s | 3.0 MB 00:00 2024-09-11T00:21:02.631 INFO:teuthology.orchestra.run.smithi040.stdout:(37/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 367 kB/s | 18 kB 00:00 2024-09-11T00:21:02.649 INFO:teuthology.orchestra.run.smithi175.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 2.4 MB/s | 581 kB 00:00 2024-09-11T00:21:02.691 INFO:teuthology.orchestra.run.smithi175.stdout:(63/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 163 kB/s | 24 kB 00:00 2024-09-11T00:21:02.758 INFO:teuthology.orchestra.run.smithi175.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 334 kB/s | 47 kB 00:00 2024-09-11T00:21:02.785 INFO:teuthology.orchestra.run.smithi175.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-11T00:21:02.825 INFO:teuthology.orchestra.run.smithi175.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-11T00:21:02.848 INFO:teuthology.orchestra.run.smithi040.stdout:(38/157): ceph-common-19.3.0-4854.g8f219c47.el9 3.1 MB/s | 22 MB 00:07 2024-09-11T00:21:02.909 INFO:teuthology.orchestra.run.smithi175.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 256 kB/s | 38 kB 00:00 2024-09-11T00:21:02.931 INFO:teuthology.orchestra.run.smithi040.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 266 kB/s | 80 kB 00:00 2024-09-11T00:21:02.998 INFO:teuthology.orchestra.run.smithi040.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-11T00:21:03.074 INFO:teuthology.orchestra.run.smithi040.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-11T00:21:03.076 INFO:teuthology.orchestra.run.smithi175.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-09-11T00:21:03.099 INFO:teuthology.orchestra.run.smithi040.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-09-11T00:21:03.149 INFO:teuthology.orchestra.run.smithi040.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-11T00:21:03.183 INFO:teuthology.orchestra.run.smithi040.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-11T00:21:03.208 INFO:teuthology.orchestra.run.smithi040.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-11T00:21:03.226 INFO:teuthology.orchestra.run.smithi175.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 5.9 MB/s | 910 kB 00:00 2024-09-11T00:21:03.233 INFO:teuthology.orchestra.run.smithi040.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-11T00:21:03.259 INFO:teuthology.orchestra.run.smithi040.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-11T00:21:03.390 INFO:teuthology.orchestra.run.smithi175.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 841 kB/s | 137 kB 00:00 2024-09-11T00:21:03.460 INFO:teuthology.orchestra.run.smithi175.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 7.0 MB/s | 4.4 MB 00:00 2024-09-11T00:21:03.527 INFO:teuthology.orchestra.run.smithi175.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 6.6 MB/s | 4.9 MB 00:00 2024-09-11T00:21:03.567 INFO:teuthology.orchestra.run.smithi040.stdout:(48/157): ceph-mgr-diskprediction-local-19.3.0- 4.5 MB/s | 7.4 MB 00:01 2024-09-11T00:21:03.602 INFO:teuthology.orchestra.run.smithi175.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 7.1 MB/s | 1.0 MB 00:00 2024-09-11T00:21:03.652 INFO:teuthology.orchestra.run.smithi175.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 700 kB/s | 87 kB 00:00 2024-09-11T00:21:03.794 INFO:teuthology.orchestra.run.smithi175.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 432 kB/s | 61 kB 00:00 2024-09-11T00:21:03.919 INFO:teuthology.orchestra.run.smithi175.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-11T00:21:04.045 INFO:teuthology.orchestra.run.smithi175.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-09-11T00:21:04.187 INFO:teuthology.orchestra.run.smithi175.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 181 kB/s | 26 kB 00:00 2024-09-11T00:21:04.268 INFO:teuthology.orchestra.run.smithi040.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 155 kB/s | 107 kB 00:00 2024-09-11T00:21:04.329 INFO:teuthology.orchestra.run.smithi175.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 135 kB/s | 19 kB 00:00 2024-09-11T00:21:04.454 INFO:teuthology.orchestra.run.smithi175.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-11T00:21:04.604 INFO:teuthology.orchestra.run.smithi175.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 232 kB/s | 35 kB 00:00 2024-09-11T00:21:04.626 INFO:teuthology.orchestra.run.smithi040.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 495 kB/s | 689 kB 00:01 2024-09-11T00:21:04.827 INFO:teuthology.orchestra.run.smithi040.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 39 kB/s | 22 kB 00:00 2024-09-11T00:21:05.021 INFO:teuthology.orchestra.run.smithi175.stdout:(82/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-11T00:21:05.155 INFO:teuthology.orchestra.run.smithi175.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 250 kB 00:00 2024-09-11T00:21:05.177 INFO:teuthology.orchestra.run.smithi040.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 492 kB/s | 943 kB 00:01 2024-09-11T00:21:05.289 INFO:teuthology.orchestra.run.smithi175.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.6 MB/s | 222 kB 00:00 2024-09-11T00:21:05.431 INFO:teuthology.orchestra.run.smithi175.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 544 kB/s | 77 kB 00:00 2024-09-11T00:21:05.452 INFO:teuthology.orchestra.run.smithi040.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 52 kB/s | 33 kB 00:00 2024-09-11T00:21:05.589 INFO:teuthology.orchestra.run.smithi175.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 268 kB/s | 42 kB 00:00 2024-09-11T00:21:05.627 INFO:teuthology.orchestra.run.smithi040.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 313 kB/s | 313 kB 00:01 2024-09-11T00:21:05.714 INFO:teuthology.orchestra.run.smithi175.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-09-11T00:21:05.840 INFO:teuthology.orchestra.run.smithi175.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-11T00:21:05.969 INFO:teuthology.orchestra.run.smithi040.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 35 kB/s | 18 kB 00:00 2024-09-11T00:21:05.983 INFO:teuthology.orchestra.run.smithi175.stdout:(89/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.9 MB/s | 279 kB 00:00 2024-09-11T00:21:06.123 INFO:teuthology.orchestra.run.smithi175.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 365 kB/s | 51 kB 00:00 2024-09-11T00:21:06.169 INFO:teuthology.orchestra.run.smithi040.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 21 kB/s | 11 kB 00:00 2024-09-11T00:21:06.265 INFO:teuthology.orchestra.run.smithi175.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 379 kB/s | 54 kB 00:00 2024-09-11T00:21:06.778 INFO:teuthology.orchestra.run.smithi040.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 211 kB/s | 171 kB 00:00 2024-09-11T00:21:06.953 INFO:teuthology.orchestra.run.smithi040.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 204 kB/s | 160 kB 00:00 2024-09-11T00:21:07.049 INFO:teuthology.orchestra.run.smithi175.stdout:(92/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-11T00:21:07.182 INFO:teuthology.orchestra.run.smithi175.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 313 kB/s | 42 kB 00:00 2024-09-11T00:21:07.354 INFO:teuthology.orchestra.run.smithi040.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 79 kB/s | 45 kB 00:00 2024-09-11T00:21:07.383 INFO:teuthology.orchestra.run.smithi175.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 221 kB/s | 44 kB 00:00 2024-09-11T00:21:07.508 INFO:teuthology.orchestra.run.smithi175.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-11T00:21:07.642 INFO:teuthology.orchestra.run.smithi175.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 269 kB/s | 36 kB 00:00 2024-09-11T00:21:07.784 INFO:teuthology.orchestra.run.smithi175.stdout:(97/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 335 kB/s | 47 kB 00:00 2024-09-11T00:21:07.917 INFO:teuthology.orchestra.run.smithi175.stdout:(98/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.2 MB/s | 304 kB 00:00 2024-09-11T00:21:08.051 INFO:teuthology.orchestra.run.smithi175.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 433 kB/s | 58 kB 00:00 2024-09-11T00:21:08.176 INFO:teuthology.orchestra.run.smithi175.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 766 kB/s | 96 kB 00:00 2024-09-11T00:21:08.246 INFO:teuthology.orchestra.run.smithi040.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 513 kB/s | 662 kB 00:01 2024-09-11T00:21:08.310 INFO:teuthology.orchestra.run.smithi175.stdout:(101/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 479 kB/s | 64 kB 00:00 2024-09-11T00:21:08.443 INFO:teuthology.orchestra.run.smithi175.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 336 kB/s | 45 kB 00:00 2024-09-11T00:21:08.519 INFO:teuthology.orchestra.run.smithi175.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 298 kB/s | 22 kB 00:00 2024-09-11T00:21:08.562 INFO:teuthology.orchestra.run.smithi040.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 481 kB/s | 581 kB 00:01 2024-09-11T00:21:08.669 INFO:teuthology.orchestra.run.smithi175.stdout:(104/157): protobuf-compiler-3.14.0-13.el9.x86_ 5.6 MB/s | 863 kB 00:00 2024-09-11T00:21:08.745 INFO:teuthology.orchestra.run.smithi175.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-11T00:21:08.778 INFO:teuthology.orchestra.run.smithi175.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-11T00:21:08.813 INFO:teuthology.orchestra.run.smithi040.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 43 kB/s | 24 kB 00:00 2024-09-11T00:21:08.820 INFO:teuthology.orchestra.run.smithi175.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 471 kB/s | 19 kB 00:00 2024-09-11T00:21:08.937 INFO:teuthology.orchestra.run.smithi175.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-11T00:21:08.979 INFO:teuthology.orchestra.run.smithi175.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 626 kB/s | 26 kB 00:00 2024-09-11T00:21:08.988 INFO:teuthology.orchestra.run.smithi040.stdout:(63/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 804 kB/s | 3.0 MB 00:03 2024-09-11T00:21:09.046 INFO:teuthology.orchestra.run.smithi175.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 731 kB/s | 49 kB 00:00 2024-09-11T00:21:09.071 INFO:teuthology.orchestra.run.smithi175.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-11T00:21:09.096 INFO:teuthology.orchestra.run.smithi175.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-11T00:21:09.146 INFO:teuthology.orchestra.run.smithi040.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 81 kB/s | 47 kB 00:00 2024-09-11T00:21:09.147 INFO:teuthology.orchestra.run.smithi175.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-11T00:21:09.189 INFO:teuthology.orchestra.run.smithi175.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-11T00:21:09.231 INFO:teuthology.orchestra.run.smithi175.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-09-11T00:21:09.273 INFO:teuthology.orchestra.run.smithi175.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 776 kB/s | 32 kB 00:00 2024-09-11T00:21:09.314 INFO:teuthology.orchestra.run.smithi175.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 340 kB/s | 14 kB 00:00 2024-09-11T00:21:09.340 INFO:teuthology.orchestra.run.smithi175.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-11T00:21:09.382 INFO:teuthology.orchestra.run.smithi175.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 8.4 MB/s | 358 kB 00:00 2024-09-11T00:21:09.440 INFO:teuthology.orchestra.run.smithi175.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-11T00:21:09.466 INFO:teuthology.orchestra.run.smithi175.stdout:(121/157): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-11T00:21:09.558 INFO:teuthology.orchestra.run.smithi175.stdout:(122/157): python3-grpcio-1.46.7-10.el9.x86_64. 22 MB/s | 2.0 MB 00:00 2024-09-11T00:21:09.583 INFO:teuthology.orchestra.run.smithi175.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-11T00:21:09.633 INFO:teuthology.orchestra.run.smithi175.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-09-11T00:21:09.691 INFO:teuthology.orchestra.run.smithi175.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 306 kB/s | 18 kB 00:00 2024-09-11T00:21:09.722 INFO:teuthology.orchestra.run.smithi040.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 322 kB/s | 292 kB 00:00 2024-09-11T00:21:09.741 INFO:teuthology.orchestra.run.smithi175.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 465 kB/s | 23 kB 00:00 2024-09-11T00:21:09.747 INFO:teuthology.orchestra.run.smithi040.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 64 kB/s | 38 kB 00:00 2024-09-11T00:21:09.789 INFO:teuthology.orchestra.run.smithi040.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 235 kB/s | 188 kB 00:00 2024-09-11T00:21:09.791 INFO:teuthology.orchestra.run.smithi175.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-09-11T00:21:09.850 INFO:teuthology.orchestra.run.smithi175.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 337 kB/s | 20 kB 00:00 2024-09-11T00:21:09.909 INFO:teuthology.orchestra.run.smithi175.stdout:(129/157): python3-kubernetes-26.1.0-2.el9.noar 17 MB/s | 1.0 MB 00:00 2024-09-11T00:21:09.934 INFO:teuthology.orchestra.run.smithi175.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T00:21:09.959 INFO:teuthology.orchestra.run.smithi175.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T00:21:09.985 INFO:teuthology.orchestra.run.smithi175.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T00:21:10.010 INFO:teuthology.orchestra.run.smithi175.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-09-11T00:21:10.035 INFO:teuthology.orchestra.run.smithi175.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 666 kB/s | 16 kB 00:00 2024-09-11T00:21:10.069 INFO:teuthology.orchestra.run.smithi175.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.6 MB/s | 90 kB 00:00 2024-09-11T00:21:10.094 INFO:teuthology.orchestra.run.smithi175.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-11T00:21:10.119 INFO:teuthology.orchestra.run.smithi175.stdout:(137/157): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-11T00:21:10.145 INFO:teuthology.orchestra.run.smithi175.stdout:(138/157): python3-routes-2.5.1-5.el9.noarch.rp 7.4 MB/s | 188 kB 00:00 2024-09-11T00:21:10.170 INFO:teuthology.orchestra.run.smithi175.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T00:21:10.187 INFO:teuthology.orchestra.run.smithi175.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 2.1 MB/s | 36 kB 00:00 2024-09-11T00:21:10.212 INFO:teuthology.orchestra.run.smithi175.stdout:(141/157): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-11T00:21:10.254 INFO:teuthology.orchestra.run.smithi175.stdout:(142/157): python3-webob-1.8.8-2.el9.noarch.rpm 5.4 MB/s | 230 kB 00:00 2024-09-11T00:21:10.363 INFO:teuthology.orchestra.run.smithi175.stdout:(143/157): postgresql-server-13.16-1.el9.x86_64 848 kB/s | 5.8 MB 00:06 2024-09-11T00:21:10.396 INFO:teuthology.orchestra.run.smithi175.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 633 kB/s | 90 kB 00:00 2024-09-11T00:21:10.422 INFO:teuthology.orchestra.run.smithi175.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 872 kB/s | 20 kB 00:00 2024-09-11T00:21:10.455 INFO:teuthology.orchestra.run.smithi175.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-11T00:21:10.489 INFO:teuthology.orchestra.run.smithi175.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-11T00:21:10.539 INFO:teuthology.orchestra.run.smithi175.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-11T00:21:10.665 INFO:teuthology.orchestra.run.smithi175.stdout:(149/157): python3-babel-2.9.1-2.el9.noarch.rpm 865 kB/s | 6.0 MB 00:07 2024-09-11T00:21:10.890 INFO:teuthology.orchestra.run.smithi175.stdout:(150/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 9.3 MB/s | 3.2 MB 00:00 2024-09-11T00:21:10.941 INFO:teuthology.orchestra.run.smithi175.stdout:(151/157): NetworkManager-1.49.90-1.el9.x86_64. 8.4 MB/s | 2.3 MB 00:00 2024-09-11T00:21:10.982 INFO:teuthology.orchestra.run.smithi175.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 993 kB/s | 41 kB 00:00 2024-09-11T00:21:11.024 INFO:teuthology.orchestra.run.smithi175.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 5.9 MB/s | 249 kB 00:00 2024-09-11T00:21:11.083 INFO:teuthology.orchestra.run.smithi175.stdout:(154/157): NetworkManager-libnm-1.49.90-1.el9.x 9.4 MB/s | 1.8 MB 00:00 2024-09-11T00:21:11.125 INFO:teuthology.orchestra.run.smithi175.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-09-11T00:21:11.209 INFO:teuthology.orchestra.run.smithi175.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 19 MB/s | 2.4 MB 00:00 2024-09-11T00:21:11.573 INFO:teuthology.orchestra.run.smithi040.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 911 kB/s | 1.6 MB 00:01 2024-09-11T00:21:11.592 INFO:teuthology.orchestra.run.smithi175.stdout:(157/157): librados2-19.3.0-4854.g8f219c47.el9. 3.1 MB/s | 3.5 MB 00:01 2024-09-11T00:21:11.596 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-11T00:21:11.596 INFO:teuthology.orchestra.run.smithi175.stdout:Total 14 MB/s | 240 MB 00:16 2024-09-11T00:21:11.973 INFO:teuthology.orchestra.run.smithi040.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 4.4 MB 00:02 2024-09-11T00:21:12.665 INFO:teuthology.orchestra.run.smithi040.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 199 kB/s | 137 kB 00:00 2024-09-11T00:21:13.215 INFO:teuthology.orchestra.run.smithi040.stdout:(71/157): postgresql-contrib-13.16-1.el9.x86_64 554 kB/s | 910 kB 00:01 2024-09-11T00:21:13.687 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-11T00:21:13.867 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-11T00:21:13.867 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-11T00:21:14.615 INFO:teuthology.orchestra.run.smithi040.stdout:(72/157): postgresql-server-13.16-1.el9.x86_64. 3.0 MB/s | 5.8 MB 00:01 2024-09-11T00:21:14.957 INFO:teuthology.orchestra.run.smithi040.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 593 kB/s | 1.0 MB 00:01 2024-09-11T00:21:15.282 INFO:teuthology.orchestra.run.smithi040.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 131 kB/s | 87 kB 00:00 2024-09-11T00:21:15.891 INFO:teuthology.orchestra.run.smithi040.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 101 kB/s | 61 kB 00:00 2024-09-11T00:21:16.191 INFO:teuthology.orchestra.run.smithi040.stdout:(76/157): openblas-openmp-0.3.26-2.el9.x86_64.r 782 kB/s | 4.9 MB 00:06 2024-09-11T00:21:16.383 INFO:teuthology.orchestra.run.smithi040.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 4.2 MB/s | 6.0 MB 00:01 2024-09-11T00:21:16.511 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-11T00:21:16.511 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-11T00:21:16.833 INFO:teuthology.orchestra.run.smithi040.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 260 kB/s | 245 kB 00:00 2024-09-11T00:21:16.992 INFO:teuthology.orchestra.run.smithi040.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 42 kB/s | 26 kB 00:00 2024-09-11T00:21:17.034 INFO:teuthology.orchestra.run.smithi040.stdout:(80/157): python3-jinja2-2.11.3-6.el9.noarch.rp 299 kB/s | 248 kB 00:00 2024-09-11T00:21:17.351 INFO:teuthology.orchestra.run.smithi040.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 37 kB/s | 19 kB 00:00 2024-09-11T00:21:17.609 INFO:teuthology.orchestra.run.smithi040.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 60 kB/s | 35 kB 00:00 2024-09-11T00:21:17.701 INFO:teuthology.orchestra.run.smithi040.stdout:(83/157): python3-mako-1.1.4-6.el9.noarch.rpm 243 kB/s | 172 kB 00:00 2024-09-11T00:21:18.360 INFO:teuthology.orchestra.run.smithi040.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 334 kB/s | 250 kB 00:00 2024-09-11T00:21:18.460 INFO:teuthology.orchestra.run.smithi040.stdout:(85/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.6 MB/s | 5.1 MB 00:01 2024-09-11T00:21:18.485 INFO:teuthology.orchestra.run.smithi040.stdout:(86/157): python3-oauthlib-3.1.1-5.el9.noarch.r 284 kB/s | 222 kB 00:00 2024-09-11T00:21:19.061 INFO:teuthology.orchestra.run.smithi040.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 70 kB/s | 42 kB 00:00 2024-09-11T00:21:19.085 INFO:teuthology.orchestra.run.smithi040.stdout:(88/157): python3-packaging-20.9-5.el9.noarch.r 106 kB/s | 77 kB 00:00 2024-09-11T00:21:19.253 INFO:teuthology.orchestra.run.smithi040.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 351 kB/s | 269 kB 00:00 2024-09-11T00:21:19.761 INFO:teuthology.orchestra.run.smithi040.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 227 kB/s | 159 kB 00:00 2024-09-11T00:21:19.862 INFO:teuthology.orchestra.run.smithi040.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 84 kB/s | 51 kB 00:00 2024-09-11T00:21:19.887 INFO:teuthology.orchestra.run.smithi040.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 348 kB/s | 279 kB 00:00 2024-09-11T00:21:20.396 INFO:teuthology.orchestra.run.smithi040.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 85 kB/s | 54 kB 00:00 2024-09-11T00:21:20.504 INFO:teuthology.orchestra.run.smithi040.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 67 kB/s | 42 kB 00:00 2024-09-11T00:21:21.013 INFO:teuthology.orchestra.run.smithi040.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 72 kB/s | 44 kB 00:00 2024-09-11T00:21:21.313 INFO:teuthology.orchestra.run.smithi040.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 273 kB/s | 221 kB 00:00 2024-09-11T00:21:21.630 INFO:teuthology.orchestra.run.smithi040.stdout:(97/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.2 MB/s | 16 MB 00:01 2024-09-11T00:21:21.655 INFO:teuthology.orchestra.run.smithi040.stdout:(98/157): qatlib-service-24.02.0-1.el9.x86_64.r 56 kB/s | 36 kB 00:00 2024-09-11T00:21:22.073 INFO:teuthology.orchestra.run.smithi040.stdout:(99/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 62 kB/s | 47 kB 00:00 2024-09-11T00:21:22.265 INFO:teuthology.orchestra.run.smithi040.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 95 kB/s | 58 kB 00:00 2024-09-11T00:21:22.415 INFO:teuthology.orchestra.run.smithi040.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 388 kB/s | 304 kB 00:00 2024-09-11T00:21:22.757 INFO:teuthology.orchestra.run.smithi040.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 140 kB/s | 96 kB 00:00 2024-09-11T00:21:22.899 INFO:teuthology.orchestra.run.smithi040.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 160 kB/s | 22 kB 00:00 2024-09-11T00:21:22.923 INFO:teuthology.orchestra.run.smithi040.stdout:(104/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 97 kB/s | 64 kB 00:00 2024-09-11T00:21:22.991 INFO:teuthology.orchestra.run.smithi040.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-11T00:21:23.024 INFO:teuthology.orchestra.run.smithi040.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-11T00:21:23.049 INFO:teuthology.orchestra.run.smithi040.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 786 kB/s | 19 kB 00:00 2024-09-11T00:21:23.083 INFO:teuthology.orchestra.run.smithi040.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.6 MB/s | 863 kB 00:00 2024-09-11T00:21:23.108 INFO:teuthology.orchestra.run.smithi040.stdout:(109/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 65 kB/s | 45 kB 00:00 2024-09-11T00:21:23.159 INFO:teuthology.orchestra.run.smithi040.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 347 kB/s | 26 kB 00:00 2024-09-11T00:21:23.192 INFO:teuthology.orchestra.run.smithi040.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 674 kB/s | 49 kB 00:00 2024-09-11T00:21:23.217 INFO:teuthology.orchestra.run.smithi040.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.2 MB/s | 67 kB 00:00 2024-09-11T00:21:23.243 INFO:teuthology.orchestra.run.smithi040.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-11T00:21:23.310 INFO:teuthology.orchestra.run.smithi040.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-11T00:21:23.325 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-11T00:21:23.343 INFO:teuthology.orchestra.run.smithi040.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-11T00:21:23.377 INFO:teuthology.orchestra.run.smithi040.stdout:(116/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.2 MB/s | 839 kB 00:00 2024-09-11T00:21:23.402 INFO:teuthology.orchestra.run.smithi040.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 550 kB/s | 32 kB 00:00 2024-09-11T00:21:23.427 INFO:teuthology.orchestra.run.smithi040.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-11T00:21:23.478 INFO:teuthology.orchestra.run.smithi040.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-09-11T00:21:23.497 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-11T00:21:23.520 INFO:teuthology.orchestra.run.smithi040.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-11T00:21:23.553 INFO:teuthology.orchestra.run.smithi040.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-11T00:21:23.580 INFO:teuthology.orchestra.run.smithi040.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-11T00:21:23.654 INFO:teuthology.orchestra.run.smithi040.stdout:(123/157): libarrow-9.0.0-11.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2024-09-11T00:21:23.679 INFO:teuthology.orchestra.run.smithi040.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-09-11T00:21:23.747 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-11T00:21:23.769 INFO:teuthology.orchestra.run.smithi040.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 93 kB/s | 11 kB 00:00 2024-09-11T00:21:23.815 INFO:teuthology.orchestra.run.smithi040.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 131 kB/s | 18 kB 00:00 2024-09-11T00:21:23.840 INFO:teuthology.orchestra.run.smithi040.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 330 kB/s | 23 kB 00:00 2024-09-11T00:21:23.866 INFO:teuthology.orchestra.run.smithi040.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 385 kB/s | 19 kB 00:00 2024-09-11T00:21:23.891 INFO:teuthology.orchestra.run.smithi040.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-11T00:21:23.912 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-11T00:21:23.924 INFO:teuthology.orchestra.run.smithi040.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-11T00:21:23.950 INFO:teuthology.orchestra.run.smithi040.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T00:21:23.957 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-11T00:21:23.983 INFO:teuthology.orchestra.run.smithi040.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-11T00:21:23.989 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-11T00:21:24.034 INFO:teuthology.orchestra.run.smithi040.stdout:(133/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.2 MB/s | 2.0 MB 00:00 2024-09-11T00:21:24.044 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-11T00:21:24.059 INFO:teuthology.orchestra.run.smithi040.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-11T00:21:24.084 INFO:teuthology.orchestra.run.smithi040.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-11T00:21:24.118 INFO:teuthology.orchestra.run.smithi040.stdout:(136/157): python3-kubernetes-26.1.0-2.el9.noar 4.1 MB/s | 1.0 MB 00:00 2024-09-11T00:21:24.162 INFO:teuthology.orchestra.run.smithi040.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 364 kB/s | 28 kB 00:00 2024-09-11T00:21:24.193 INFO:teuthology.orchestra.run.smithi040.stdout:(138/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 672 kB/s | 90 kB 00:00 2024-09-11T00:21:24.227 INFO:teuthology.orchestra.run.smithi040.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 283 kB/s | 31 kB 00:00 2024-09-11T00:21:24.252 INFO:teuthology.orchestra.run.smithi040.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.1 MB/s | 188 kB 00:00 2024-09-11T00:21:24.269 INFO:teuthology.orchestra.run.smithi040.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 864 kB/s | 36 kB 00:00 2024-09-11T00:21:24.286 INFO:teuthology.orchestra.run.smithi040.stdout:(142/157): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-11T00:21:24.311 INFO:teuthology.orchestra.run.smithi040.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-11T00:21:24.337 INFO:teuthology.orchestra.run.smithi040.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-11T00:21:24.362 INFO:teuthology.orchestra.run.smithi040.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-11T00:21:24.379 INFO:teuthology.orchestra.run.smithi040.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 478 kB/s | 20 kB 00:00 2024-09-11T00:21:24.412 INFO:teuthology.orchestra.run.smithi040.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T00:21:24.417 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-11T00:21:24.438 INFO:teuthology.orchestra.run.smithi040.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-11T00:21:24.505 INFO:teuthology.orchestra.run.smithi040.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-11T00:21:24.531 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:21:24.696 INFO:teuthology.orchestra.run.smithi040.stdout:(150/157): NetworkManager-1.49.90-1.el9.x86_64. 12 MB/s | 2.3 MB 00:00 2024-09-11T00:21:24.699 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:21:24.732 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:21:24.763 INFO:teuthology.orchestra.run.smithi040.stdout:(151/157): NetworkManager-libnm-1.49.90-1.el9.x 27 MB/s | 1.8 MB 00:00 2024-09-11T00:21:24.805 INFO:teuthology.orchestra.run.smithi040.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 982 kB/s | 41 kB 00:00 2024-09-11T00:21:24.845 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:21:24.865 INFO:teuthology.orchestra.run.smithi040.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 4.1 MB/s | 249 kB 00:00 2024-09-11T00:21:24.883 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:21:24.919 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-11T00:21:24.931 INFO:teuthology.orchestra.run.smithi040.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 21 MB/s | 1.4 MB 00:00 2024-09-11T00:21:25.006 INFO:teuthology.orchestra.run.smithi040.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-09-11T00:21:25.065 INFO:teuthology.orchestra.run.smithi040.stdout:(156/157): librados2-19.3.0-4854.g8f219c47.el9. 5.3 MB/s | 3.5 MB 00:00 2024-09-11T00:21:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-11T00:21:25.202 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-11T00:21:25.229 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:21:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:21:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:21:25.437 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:21:25.473 INFO:teuthology.orchestra.run.smithi040.stdout:(157/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 3.1 MB/s | 3.2 MB 00:01 2024-09-11T00:21:25.480 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-09-11T00:21:25.481 INFO:teuthology.orchestra.run.smithi040.stdout:Total 7.7 MB/s | 240 MB 00:31 2024-09-11T00:21:25.485 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:21:25.533 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:21:25.757 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:21:25.962 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:21:26.171 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-11T00:21:26.290 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:21:26.415 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:21:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:21:26.862 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-11T00:21:26.903 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-11T00:21:26.947 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-11T00:21:27.037 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-11T00:21:27.091 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-11T00:21:27.129 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-11T00:21:27.183 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-11T00:21:27.237 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-11T00:21:27.281 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-11T00:21:27.371 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-11T00:21:27.442 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-11T00:21:27.477 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-11T00:21:27.523 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-11T00:21:27.605 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-11T00:21:27.618 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-09-11T00:21:27.639 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-11T00:21:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-11T00:21:27.744 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-11T00:21:27.820 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-09-11T00:21:27.820 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-09-11T00:21:27.826 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-11T00:21:27.888 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-11T00:21:27.988 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-11T00:21:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-11T00:21:28.217 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-11T00:21:28.846 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-11T00:21:28.949 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-11T00:21:29.003 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-11T00:21:29.055 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-11T00:21:29.093 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-11T00:21:29.146 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-11T00:21:29.346 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-11T00:21:29.436 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-11T00:21:29.550 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-11T00:21:29.616 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-11T00:21:29.698 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-11T00:21:29.740 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-11T00:21:29.779 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-11T00:21:29.839 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-11T00:21:29.895 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-11T00:21:29.940 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-11T00:21:29.990 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-11T00:21:30.162 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-11T00:21:30.206 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-11T00:21:30.250 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-11T00:21:30.392 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-11T00:21:30.403 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-09-11T00:21:30.403 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-09-11T00:21:30.432 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-11T00:21:30.480 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-11T00:21:30.512 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-11T00:21:30.537 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-11T00:21:30.651 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-11T00:21:30.835 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-11T00:21:30.878 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-11T00:21:30.914 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-11T00:21:30.951 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-11T00:21:30.989 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-11T00:21:31.028 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-11T00:21:31.065 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-11T00:21:31.100 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-11T00:21:31.153 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-11T00:21:31.201 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-11T00:21:31.250 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-11T00:21:31.351 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-11T00:21:31.417 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-11T00:21:31.454 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-11T00:21:31.576 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-11T00:21:31.641 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-11T00:21:32.513 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-11T00:21:32.568 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-11T00:21:32.602 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-11T00:21:32.709 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-11T00:21:32.776 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-11T00:21:32.829 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-11T00:21:32.945 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-11T00:21:32.987 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-11T00:21:33.220 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-11T00:21:33.251 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-11T00:21:33.335 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-11T00:21:34.142 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-11T00:21:34.279 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-11T00:21:35.858 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-11T00:21:35.955 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-11T00:21:35.991 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-11T00:21:36.024 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-11T00:21:36.373 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-11T00:21:36.426 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:21:36.905 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:21:36.941 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-11T00:21:36.989 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-11T00:21:37.179 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-09-11T00:21:37.329 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-11T00:21:37.380 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-11T00:21:37.454 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-11T00:21:37.498 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-11T00:21:37.516 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-11T00:21:37.546 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:21:37.554 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-11T00:21:37.618 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-11T00:21:37.636 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:21:37.664 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-11T00:21:38.012 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-11T00:21:38.121 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:21:38.270 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:21:38.306 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:21:38.421 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:21:38.460 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:21:38.502 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-11T00:21:38.723 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-11T00:21:38.790 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-11T00:21:38.819 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:21:38.948 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:21:38.979 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:21:39.060 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:21:39.079 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:21:39.118 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:21:39.340 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:21:39.526 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:21:39.711 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-11T00:21:39.845 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:21:39.962 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:21:40.246 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:21:40.392 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-11T00:21:40.443 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-11T00:21:40.489 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-11T00:21:40.573 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-11T00:21:40.577 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:21:40.611 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:21:40.650 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-11T00:21:40.688 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-11T00:21:40.743 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-11T00:21:40.781 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-11T00:21:40.814 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-11T00:21:40.915 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-11T00:21:40.976 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-11T00:21:41.009 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-11T00:21:41.056 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-11T00:21:41.149 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-11T00:21:41.188 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-11T00:21:41.232 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-11T00:21:41.252 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:21:41.260 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-11T00:21:41.297 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:21:41.345 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-11T00:21:41.397 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-11T00:21:41.477 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:21:41.477 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T00:21:41.477 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T00:21:41.477 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:21:41.491 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-11T00:21:41.515 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:21:41.663 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-11T00:21:41.726 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-11T00:21:42.399 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-11T00:21:42.502 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-11T00:21:42.678 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-11T00:21:42.730 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-11T00:21:42.769 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-11T00:21:42.822 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-11T00:21:43.024 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-11T00:21:43.079 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-11T00:21:43.196 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-11T00:21:43.301 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-11T00:21:43.395 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-11T00:21:43.556 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-11T00:21:43.592 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-11T00:21:43.652 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-11T00:21:43.692 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-11T00:21:43.738 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-11T00:21:43.788 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-11T00:21:43.970 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-11T00:21:44.015 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-11T00:21:44.058 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-11T00:21:44.190 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-11T00:21:44.241 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-11T00:21:44.283 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-11T00:21:44.312 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-11T00:21:44.337 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-11T00:21:44.471 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-11T00:21:44.763 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-11T00:21:44.803 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-11T00:21:44.841 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-11T00:21:44.878 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-11T00:21:44.915 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-11T00:21:44.955 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-11T00:21:44.991 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-11T00:21:45.026 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-11T00:21:45.059 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-11T00:21:45.103 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-11T00:21:45.135 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-11T00:21:45.237 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-11T00:21:45.294 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-11T00:21:45.330 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-11T00:21:45.482 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-11T00:21:45.563 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-11T00:21:46.499 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-11T00:21:46.555 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-11T00:21:46.589 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-11T00:21:46.708 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-11T00:21:46.789 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-11T00:21:46.851 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-11T00:21:46.959 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-11T00:21:46.999 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-11T00:21:47.245 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-11T00:21:47.279 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-11T00:21:47.377 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-11T00:21:48.235 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-11T00:21:48.372 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-11T00:21:50.022 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-11T00:21:50.117 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-11T00:21:50.154 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-11T00:21:50.189 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-11T00:21:50.555 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-11T00:21:50.608 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:21:50.720 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:21:50.754 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-11T00:21:50.803 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-11T00:21:51.372 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-11T00:21:51.418 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:21:51.542 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:21:51.569 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-11T00:21:54.054 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:21:54.055 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2024-09-11T00:21:54.055 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2024-09-11T00:21:54.055 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2024-09-11T00:21:54.055 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2024-09-11T00:21:54.055 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2024-09-11T00:21:54.055 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /root 2024-09-11T00:21:54.055 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2024-09-11T00:21:54.055 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:21:54.263 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:21:54.298 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:21:54.298 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:21:54.298 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T00:21:54.298 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:21:54.457 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:21:54.528 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:21:55.202 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:21:55.248 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:21:55.374 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:21:55.374 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T00:21:55.374 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T00:21:55.374 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:21:55.415 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:21:55.888 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:21:55.946 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:21:55.946 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:21:55.946 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T00:21:55.947 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:21:55.947 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:21:55.947 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:21:56.189 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:21:56.239 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:21:56.240 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:21:56.240 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T00:21:56.240 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:21:56.240 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:21:56.240 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:21:56.731 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:21:56.782 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:21:56.782 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:21:56.782 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T00:21:56.782 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:21:56.782 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:21:56.782 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:21:56.906 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-11T00:21:56.988 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-11T00:21:57.063 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-11T00:21:57.287 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-11T00:21:57.343 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-11T00:21:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-11T00:21:57.578 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-11T00:21:57.745 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-11T00:21:57.801 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-11T00:21:57.865 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-11T00:21:57.891 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-11T00:21:58.415 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:21:58.448 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:21:58.499 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-11T00:21:58.579 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-11T00:21:58.604 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:22:02.231 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:22:02.293 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:22:03.383 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:22:03.418 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:22:03.573 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:22:03.756 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-11T00:22:03.795 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:22:03.847 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:22:03.847 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:22:03.847 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T00:22:03.847 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:22:03.847 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:22:03.847 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:03.904 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:22:03.930 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:22:04.038 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-11T00:22:04.108 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-11T00:22:05.130 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-11T00:22:05.190 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:22:05.241 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:22:05.241 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:22:05.241 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T00:22:05.241 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:22:05.241 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:22:05.241 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:05.290 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:22:05.340 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:22:05.340 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:22:05.340 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T00:22:05.341 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:05.391 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:22:05.442 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:22:05.442 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:22:05.442 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T00:22:05.442 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:22:05.442 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:22:05.442 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:05.783 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:22:05.835 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:22:05.835 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:22:05.835 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T00:22:05.835 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:22:05.835 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:22:05.835 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:08.495 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:22:08.496 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /sys 2024-09-11T00:22:08.496 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /proc 2024-09-11T00:22:08.496 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /mnt 2024-09-11T00:22:08.496 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /var/tmp 2024-09-11T00:22:08.496 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /home 2024-09-11T00:22:08.496 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /root 2024-09-11T00:22:08.496 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /tmp 2024-09-11T00:22:08.496 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:08.710 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:22:08.747 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:22:08.747 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:22:08.747 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T00:22:08.747 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:10.430 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:22:10.488 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:22:10.488 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:22:10.488 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T00:22:10.488 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:22:10.488 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:22:10.488 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:10.747 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:22:10.798 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:22:10.799 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:22:10.799 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T00:22:10.799 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:22:10.799 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:22:10.799 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:10.914 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-11T00:22:10.954 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-11T00:22:10.998 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-11T00:22:11.027 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-11T00:22:11.063 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-11T00:22:11.291 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-11T00:22:11.314 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:22:11.351 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-11T00:22:11.366 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:22:11.366 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:22:11.366 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T00:22:11.366 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:22:11.366 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:22:11.366 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:11.381 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-11T00:22:11.413 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-11T00:22:11.456 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-11T00:22:11.507 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-11T00:22:11.568 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-11T00:22:11.641 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-11T00:22:11.879 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-11T00:22:11.945 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-11T00:22:12.058 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-11T00:22:12.179 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-11T00:22:12.313 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:22:12.353 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-11T00:22:12.355 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:22:12.402 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-11T00:22:12.415 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:22:12.441 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-11T00:22:12.483 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-11T00:22:13.160 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:22:13.191 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:22:13.226 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-11T00:22:13.310 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-11T00:22:13.338 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:22:13.693 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-11T00:22:13.824 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-11T00:22:13.890 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-11T00:22:14.006 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-11T00:22:14.037 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-11T00:22:14.062 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-11T00:22:14.107 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-11T00:22:14.107 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:22:14.223 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:22:14.223 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:22:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:22:14.390 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-11T00:22:14.406 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:22:14.406 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:22:14.650 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:22:14.651 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:22:14.768 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:22:14.843 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:22:15.093 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:22:15.094 INFO:teuthology.orchestra.run.smithi175.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-11T00:22:15.094 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:17.203 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:22:17.270 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:22:18.425 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:22:18.453 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:22:18.614 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:22:18.793 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-11T00:22:18.822 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:22:18.873 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:22:18.874 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:22:18.874 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T00:22:18.874 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:22:18.874 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:22:18.874 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:18.931 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:22:18.957 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:22:19.070 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-11T00:22:19.135 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-11T00:22:20.242 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-11T00:22:20.284 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:22:20.335 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:22:20.335 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:22:20.335 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T00:22:20.336 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:22:20.336 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:22:20.336 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:20.393 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:22:20.443 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:22:20.443 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:22:20.443 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T00:22:20.443 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:20.501 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:22:20.554 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:22:20.554 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:22:20.554 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T00:22:20.554 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:22:20.554 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:22:20.554 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:20.919 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:22:20.972 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:22:20.972 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:22:20.972 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T00:22:20.972 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:22:20.972 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:22:20.972 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:21.311 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-11T00:22:21.311 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-11T00:22:21.312 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-11T00:22:21.312 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-11T00:22:21.312 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-11T00:22:21.312 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-11T00:22:21.312 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-11T00:22:21.312 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:22:21.312 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:22:21.312 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:22:21.312 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-11T00:22:21.312 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-11T00:22:21.312 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-11T00:22:21.312 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:22:21.313 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-11T00:22:21.313 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-11T00:22:21.313 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-11T00:22:21.313 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-11T00:22:21.313 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-11T00:22:21.313 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-11T00:22:21.313 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-11T00:22:21.313 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-11T00:22:21.313 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-11T00:22:21.313 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-11T00:22:21.313 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-11T00:22:21.313 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-11T00:22:21.314 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-11T00:22:21.326 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-11T00:22:21.326 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-11T00:22:21.326 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-11T00:22:21.326 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-11T00:22:21.327 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-11T00:22:21.327 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-11T00:22:21.327 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-11T00:22:21.327 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-11T00:22:21.327 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-11T00:22:21.327 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-11T00:22:21.327 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-11T00:22:21.327 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-11T00:22:21.327 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-11T00:22:21.327 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-11T00:22:21.327 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-11T00:22:21.327 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-11T00:22:21.328 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-11T00:22:21.328 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-11T00:22:21.328 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-11T00:22:21.328 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-11T00:22:21.328 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-11T00:22:21.328 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-11T00:22:21.328 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-11T00:22:21.328 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-11T00:22:21.328 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-11T00:22:21.328 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-11T00:22:21.328 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-11T00:22:21.328 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-11T00:22:21.328 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-11T00:22:21.329 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-11T00:22:21.329 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-11T00:22:21.329 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-11T00:22:21.329 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-11T00:22:21.329 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-11T00:22:21.329 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-11T00:22:21.329 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-11T00:22:21.329 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-11T00:22:21.329 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-11T00:22:21.329 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-11T00:22:21.329 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-11T00:22:21.329 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-11T00:22:21.329 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-11T00:22:21.329 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-11T00:22:21.330 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-11T00:22:21.330 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-11T00:22:21.330 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-11T00:22:21.330 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-11T00:22:21.330 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-11T00:22:21.330 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-11T00:22:21.330 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-11T00:22:21.330 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-11T00:22:21.330 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-11T00:22:21.330 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-11T00:22:21.330 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-11T00:22:21.330 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-11T00:22:21.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-11T00:22:21.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-11T00:22:21.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-11T00:22:21.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-11T00:22:21.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-11T00:22:21.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-11T00:22:21.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-11T00:22:21.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-11T00:22:21.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-11T00:22:21.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-11T00:22:21.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-11T00:22:21.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-11T00:22:21.331 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-11T00:22:21.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-11T00:22:21.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-11T00:22:21.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-11T00:22:21.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-11T00:22:21.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-11T00:22:21.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-11T00:22:21.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-11T00:22:21.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-11T00:22:21.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-11T00:22:21.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-11T00:22:21.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-11T00:22:21.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-11T00:22:21.332 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-11T00:22:21.333 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-11T00:22:21.333 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-11T00:22:21.333 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-11T00:22:21.333 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-11T00:22:21.333 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-11T00:22:21.333 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-11T00:22:21.333 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-11T00:22:21.333 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-11T00:22:21.333 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-11T00:22:21.333 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-11T00:22:21.333 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-11T00:22:21.333 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-11T00:22:21.333 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-11T00:22:21.333 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-11T00:22:21.333 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-11T00:22:21.334 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-11T00:22:21.334 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-11T00:22:21.334 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-11T00:22:21.334 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-11T00:22:21.334 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-11T00:22:21.334 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-11T00:22:21.334 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-11T00:22:21.334 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-11T00:22:21.334 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-11T00:22:21.334 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-11T00:22:21.334 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-11T00:22:21.334 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-11T00:22:21.334 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-11T00:22:21.334 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-11T00:22:21.334 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-11T00:22:21.335 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-11T00:22:21.335 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-11T00:22:21.335 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-11T00:22:21.335 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-11T00:22:21.335 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-11T00:22:21.335 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-11T00:22:21.335 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-11T00:22:21.335 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-11T00:22:21.335 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-11T00:22:21.335 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-11T00:22:21.335 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-11T00:22:21.335 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-11T00:22:21.335 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-11T00:22:21.335 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-11T00:22:21.336 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-11T00:22:21.336 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-11T00:22:21.336 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-11T00:22:21.336 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-11T00:22:21.336 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-11T00:22:21.336 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-11T00:22:21.336 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-11T00:22:21.336 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-11T00:22:21.336 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-11T00:22:21.336 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-11T00:22:21.336 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-11T00:22:21.336 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-11T00:22:23.548 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:22:23.548 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:23.548 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2024-09-11T00:22:23.548 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T00:22:23.549 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T00:22:23.549 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T00:22:23.549 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T00:22:23.549 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.549 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.549 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T00:22:23.549 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T00:22:23.549 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-11T00:22:23.549 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T00:22:23.549 INFO:teuthology.orchestra.run.smithi175.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T00:22:23.549 INFO:teuthology.orchestra.run.smithi175.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T00:22:23.549 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T00:22:23.549 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.550 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.550 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.550 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.550 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:23.550 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.550 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.550 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.550 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:23.550 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:23.550 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:23.550 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:23.550 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:23.550 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.551 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.551 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:23.551 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.551 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.551 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.551 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:23.551 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:23.551 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.551 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.551 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:23.551 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T00:22:23.551 INFO:teuthology.orchestra.run.smithi175.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T00:22:23.552 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T00:22:23.552 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T00:22:23.552 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T00:22:23.552 INFO:teuthology.orchestra.run.smithi175.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T00:22:23.552 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T00:22:23.552 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T00:22:23.552 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T00:22:23.552 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T00:22:23.552 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T00:22:23.552 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.552 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.552 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.553 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T00:22:23.553 INFO:teuthology.orchestra.run.smithi175.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T00:22:23.553 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T00:22:23.553 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T00:22:23.553 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T00:22:23.553 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T00:22:23.553 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.553 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.553 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T00:22:23.553 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.553 INFO:teuthology.orchestra.run.smithi175.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T00:22:23.553 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T00:22:23.553 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T00:22:23.553 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T00:22:23.554 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T00:22:23.554 INFO:teuthology.orchestra.run.smithi175.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T00:22:23.554 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T00:22:23.554 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T00:22:23.554 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T00:22:23.554 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T00:22:23.554 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T00:22:23.554 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T00:22:23.554 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T00:22:23.554 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T00:22:23.554 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T00:22:23.554 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T00:22:23.554 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T00:22:23.554 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T00:22:23.555 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T00:22:23.555 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T00:22:23.555 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T00:22:23.555 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T00:22:23.555 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T00:22:23.555 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.555 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.555 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.555 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T00:22:23.555 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T00:22:23.555 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T00:22:23.555 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T00:22:23.555 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T00:22:23.556 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T00:22:23.556 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T00:22:23.556 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T00:22:23.556 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T00:22:23.556 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T00:22:23.556 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T00:22:23.556 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T00:22:23.556 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T00:22:23.556 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T00:22:23.557 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T00:22:23.557 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T00:22:23.557 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T00:22:23.557 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T00:22:23.557 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T00:22:23.557 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T00:22:23.557 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T00:22:23.557 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T00:22:23.557 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T00:22:23.557 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T00:22:23.557 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T00:22:23.557 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T00:22:23.558 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T00:22:23.558 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T00:22:23.558 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T00:22:23.558 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T00:22:23.558 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T00:22:23.558 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T00:22:23.558 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T00:22:23.558 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T00:22:23.558 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T00:22:23.558 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T00:22:23.558 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T00:22:23.558 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T00:22:23.558 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T00:22:23.558 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T00:22:23.559 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.559 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.559 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T00:22:23.559 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T00:22:23.559 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T00:22:23.559 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.559 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T00:22:23.559 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T00:22:23.559 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T00:22:23.559 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T00:22:23.559 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T00:22:23.559 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T00:22:23.560 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T00:22:23.560 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T00:22:23.560 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T00:22:23.560 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T00:22:23.560 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T00:22:23.560 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T00:22:23.560 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T00:22:23.560 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T00:22:23.560 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T00:22:23.560 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.560 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.560 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:23.561 INFO:teuthology.orchestra.run.smithi175.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T00:22:23.561 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T00:22:23.561 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T00:22:23.561 INFO:teuthology.orchestra.run.smithi175.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T00:22:23.561 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T00:22:23.561 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T00:22:23.561 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T00:22:23.562 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:23.562 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-11T00:22:24.254 DEBUG:teuthology.parallel:result is None 2024-09-11T00:22:26.350 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-11T00:22:26.400 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-11T00:22:26.444 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-11T00:22:26.481 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-11T00:22:26.516 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-11T00:22:26.763 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-11T00:22:26.822 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-11T00:22:26.851 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-11T00:22:26.883 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-11T00:22:26.926 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-11T00:22:27.632 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:22:27.674 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:22:27.717 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:22:29.091 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-11T00:22:29.205 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-11T00:22:29.260 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-11T00:22:29.372 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-11T00:22:29.416 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-11T00:22:29.441 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-11T00:22:29.478 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-11T00:22:29.478 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:22:29.610 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:22:29.610 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:22:29.719 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:22:29.743 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-11T00:22:29.760 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:22:29.760 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:22:30.013 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:22:30.013 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:22:30.139 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:22:30.215 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:22:30.439 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:22:30.440 INFO:teuthology.orchestra.run.smithi040.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-11T00:22:30.440 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:37.007 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-11T00:22:37.007 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-11T00:22:37.007 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-11T00:22:37.008 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-11T00:22:37.008 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-11T00:22:37.008 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-11T00:22:37.008 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-11T00:22:37.008 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:22:37.008 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:22:37.008 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:22:37.008 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-11T00:22:37.008 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-11T00:22:37.008 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-11T00:22:37.008 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:22:37.008 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-11T00:22:37.008 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-11T00:22:37.009 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-11T00:22:37.009 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-11T00:22:37.009 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-11T00:22:37.009 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-11T00:22:37.009 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-11T00:22:37.009 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-11T00:22:37.009 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-11T00:22:37.009 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-11T00:22:37.009 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-11T00:22:37.009 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-11T00:22:37.009 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-11T00:22:37.021 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-11T00:22:37.022 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-11T00:22:37.022 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-11T00:22:37.022 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-11T00:22:37.022 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-11T00:22:37.022 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-11T00:22:37.022 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-11T00:22:37.022 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-11T00:22:37.022 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-11T00:22:37.022 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-11T00:22:37.022 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-11T00:22:37.022 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-11T00:22:37.022 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-11T00:22:37.023 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-11T00:22:37.023 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-11T00:22:37.023 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-11T00:22:37.023 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-11T00:22:37.023 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-11T00:22:37.023 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-11T00:22:37.023 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-11T00:22:37.023 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-11T00:22:37.023 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-11T00:22:37.023 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-11T00:22:37.023 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-11T00:22:37.023 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-11T00:22:37.024 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-11T00:22:37.024 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-11T00:22:37.024 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-11T00:22:37.024 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-11T00:22:37.024 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-11T00:22:37.024 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-11T00:22:37.024 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-11T00:22:37.024 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-11T00:22:37.024 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-11T00:22:37.024 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-11T00:22:37.024 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-11T00:22:37.024 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-11T00:22:37.024 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-11T00:22:37.025 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-11T00:22:37.025 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-11T00:22:37.025 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-11T00:22:37.025 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-11T00:22:37.025 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-11T00:22:37.025 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-11T00:22:37.025 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-11T00:22:37.025 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-11T00:22:37.025 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-11T00:22:37.025 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-11T00:22:37.025 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-11T00:22:37.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-11T00:22:37.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-11T00:22:37.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-11T00:22:37.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-11T00:22:37.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-11T00:22:37.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-11T00:22:37.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-11T00:22:37.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-11T00:22:37.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-11T00:22:37.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-11T00:22:37.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-11T00:22:37.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-11T00:22:37.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-11T00:22:37.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-11T00:22:37.027 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-11T00:22:37.027 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-11T00:22:37.027 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-11T00:22:37.027 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-11T00:22:37.027 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-11T00:22:37.027 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-11T00:22:37.027 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-11T00:22:37.027 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-11T00:22:37.027 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-11T00:22:37.027 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-11T00:22:37.027 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-11T00:22:37.027 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-11T00:22:37.027 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-11T00:22:37.027 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-11T00:22:37.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-11T00:22:37.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-11T00:22:37.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-11T00:22:37.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-11T00:22:37.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-11T00:22:37.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-11T00:22:37.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-11T00:22:37.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-11T00:22:37.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-11T00:22:37.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-11T00:22:37.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-11T00:22:37.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-11T00:22:37.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-11T00:22:37.028 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-11T00:22:37.029 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-11T00:22:37.029 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-11T00:22:37.029 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-11T00:22:37.029 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-11T00:22:37.029 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-11T00:22:37.029 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-11T00:22:37.029 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-11T00:22:37.029 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-11T00:22:37.029 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-11T00:22:37.029 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-11T00:22:37.029 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-11T00:22:37.029 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-11T00:22:37.029 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-11T00:22:37.030 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-11T00:22:37.030 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-11T00:22:37.030 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-11T00:22:37.030 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-11T00:22:37.030 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-11T00:22:37.030 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-11T00:22:37.030 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-11T00:22:37.030 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-11T00:22:37.030 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-11T00:22:37.030 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-11T00:22:37.030 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-11T00:22:37.030 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-11T00:22:37.030 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-11T00:22:37.030 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-11T00:22:37.030 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-11T00:22:37.031 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-11T00:22:37.031 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-11T00:22:37.031 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-11T00:22:37.031 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-11T00:22:37.031 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-11T00:22:37.031 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-11T00:22:37.031 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-11T00:22:37.031 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-11T00:22:37.031 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-11T00:22:37.031 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-11T00:22:37.031 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-11T00:22:37.031 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-11T00:22:37.031 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-11T00:22:37.031 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-11T00:22:37.032 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-11T00:22:37.032 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-11T00:22:37.032 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-11T00:22:37.032 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-11T00:22:39.164 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:22:39.165 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:39.165 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2024-09-11T00:22:39.165 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T00:22:39.165 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T00:22:39.165 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T00:22:39.165 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T00:22:39.165 INFO:teuthology.orchestra.run.smithi040.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.165 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.165 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T00:22:39.165 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T00:22:39.165 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-09-11T00:22:39.166 INFO:teuthology.orchestra.run.smithi040.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T00:22:39.166 INFO:teuthology.orchestra.run.smithi040.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T00:22:39.166 INFO:teuthology.orchestra.run.smithi040.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T00:22:39.166 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T00:22:39.166 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.166 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.166 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.166 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.166 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:39.166 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.166 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.166 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.167 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:39.167 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:39.167 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:39.167 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:39.167 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:39.167 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.167 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.167 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:39.167 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.167 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.167 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.167 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:39.167 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:39.168 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.168 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.168 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:22:39.168 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T00:22:39.168 INFO:teuthology.orchestra.run.smithi040.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T00:22:39.168 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T00:22:39.168 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T00:22:39.168 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T00:22:39.168 INFO:teuthology.orchestra.run.smithi040.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T00:22:39.168 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T00:22:39.168 INFO:teuthology.orchestra.run.smithi040.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T00:22:39.168 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T00:22:39.168 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T00:22:39.169 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T00:22:39.169 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.169 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.169 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.169 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T00:22:39.169 INFO:teuthology.orchestra.run.smithi040.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T00:22:39.169 INFO:teuthology.orchestra.run.smithi040.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T00:22:39.169 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T00:22:39.169 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T00:22:39.169 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T00:22:39.169 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.169 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.170 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T00:22:39.170 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.170 INFO:teuthology.orchestra.run.smithi040.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T00:22:39.170 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T00:22:39.170 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T00:22:39.170 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T00:22:39.170 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T00:22:39.170 INFO:teuthology.orchestra.run.smithi040.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T00:22:39.170 INFO:teuthology.orchestra.run.smithi040.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T00:22:39.170 INFO:teuthology.orchestra.run.smithi040.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T00:22:39.170 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T00:22:39.170 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T00:22:39.170 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T00:22:39.171 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T00:22:39.171 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T00:22:39.171 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T00:22:39.171 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T00:22:39.171 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T00:22:39.171 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T00:22:39.171 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T00:22:39.171 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T00:22:39.171 INFO:teuthology.orchestra.run.smithi040.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T00:22:39.171 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T00:22:39.171 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T00:22:39.171 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T00:22:39.171 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T00:22:39.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T00:22:39.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T00:22:39.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T00:22:39.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T00:22:39.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T00:22:39.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T00:22:39.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T00:22:39.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T00:22:39.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T00:22:39.172 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T00:22:39.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T00:22:39.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T00:22:39.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T00:22:39.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T00:22:39.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T00:22:39.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T00:22:39.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T00:22:39.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T00:22:39.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T00:22:39.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T00:22:39.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T00:22:39.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T00:22:39.173 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T00:22:39.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T00:22:39.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T00:22:39.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T00:22:39.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T00:22:39.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T00:22:39.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T00:22:39.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T00:22:39.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T00:22:39.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T00:22:39.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T00:22:39.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T00:22:39.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T00:22:39.174 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T00:22:39.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T00:22:39.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T00:22:39.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T00:22:39.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T00:22:39.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T00:22:39.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T00:22:39.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T00:22:39.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T00:22:39.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T00:22:39.175 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T00:22:39.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T00:22:39.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T00:22:39.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T00:22:39.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T00:22:39.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T00:22:39.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T00:22:39.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T00:22:39.176 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T00:22:39.176 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T00:22:39.176 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T00:22:39.176 INFO:teuthology.orchestra.run.smithi040.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T00:22:39.176 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.176 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.177 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:22:39.177 INFO:teuthology.orchestra.run.smithi040.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T00:22:39.177 INFO:teuthology.orchestra.run.smithi040.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T00:22:39.177 INFO:teuthology.orchestra.run.smithi040.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T00:22:39.177 INFO:teuthology.orchestra.run.smithi040.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T00:22:39.177 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T00:22:39.177 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T00:22:39.177 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T00:22:39.177 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:39.177 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-09-11T00:22:40.070 DEBUG:teuthology.parallel:result is None 2024-09-11T00:22:40.071 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:22:40.235 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T00:22:40.286 INFO:teuthology.orchestra.run.smithi040.stdout:19.3.0-4854.g8f219c47.el9 2024-09-11T00:22:40.286 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-11T00:22:40.286 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-11T00:22:40.288 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:22:40.442 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T00:22:40.492 INFO:teuthology.orchestra.run.smithi175.stdout:19.3.0-4854.g8f219c47.el9 2024-09-11T00:22:40.492 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-11T00:22:40.492 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-11T00:22:40.494 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T00:22:40.494 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:22:40.494 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T00:22:40.554 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:22:40.554 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T00:22:40.615 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T00:22:40.615 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:22:40.615 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T00:22:40.672 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T00:22:40.769 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:22:40.770 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T00:22:40.826 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T00:22:40.921 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T00:22:40.921 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:22:40.922 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T00:22:40.978 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T00:22:41.074 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:22:41.074 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T00:22:41.128 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T00:22:41.226 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T00:22:41.226 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:22:41.226 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T00:22:41.285 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T00:22:41.382 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:22:41.382 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T00:22:41.440 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T00:22:41.537 INFO:teuthology.run_tasks:Running task ceph... 2024-09-11T00:22:41.626 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-11T00:22:41.626 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /var/log/ceph 2024-09-11T00:22:41.631 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /var/log/ceph 2024-09-11T00:22:41.688 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-11T00:22:41.689 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T00:22:41.693 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T00:22:41.749 INFO:tasks.ceph:Creating extra log directories... 2024-09-11T00:22:41.749 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T00:22:41.752 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T00:22:41.816 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-11T00:22:41.816 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-11T00:22:41.816 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-11T00:22:41.816 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:22:41.817 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-11T00:22:41.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-11T00:22:42.017 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-11T00:22:42.072 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:22:42.072 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-11T00:22:42.108 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-11T00:22:42.287 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-11T00:22:42.348 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-11T00:22:42.348 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-11T00:22:42.348 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899841', 'branch': 'wip-hemanth-testing-2024-09-10-0723', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/acls}', 'email': 'hyelloji@redhat.com', 'first_in_suite': False, 'job_id': '7899841', 'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-hemanth-testing-2024-09-10-0723'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-hemanth-testing-2024-09-10-0723', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'owner': 'scheduled_hyelloji@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6190, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'sleep_before_teardown': 0, 'subset': '479/1024', 'suite': 'fs', 'suite_branch': 'wip-hemanth-testing-2024-09-10-0723', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi040.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCz8s6bVpH4c4jc0g+mRNGRJ5foCl71tDivDI3uWV6ZS+pOPD+4yyOAixhA4WjD/H5DHHN+9oHgLxOZu75QLy/c=', 'smithi175.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAPbcB+wjZ326a8U/nemO2LY3FWaEfKanKqAF1E3sJaU6eVPwxLlTaU2LYK+BuOpyexJEMf73KXsIzz9TMf0I/A='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_acls']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_16:59:47', 'tube': 'smithi', 'user': 'hyelloji', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-11T00:22:42.349 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T00:22:42.353 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T00:22:42.388 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T00:22:42.430 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T00:22:42.485 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:22:42.485 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T00:22:42.520 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T00:22:42.520 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2024-09-11T00:22:42.595 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T00:22:42.595 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:22:42.595 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-09-11T00:22:42.595 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:22:42.595 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:22:42.595 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-11 00:22:30.808469068 +0000 2024-09-11T00:22:42.595 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-11 00:20:04.348535803 +0000 2024-09-11T00:22:42.595 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-11 00:20:04.348535803 +0000 2024-09-11T00:22:42.595 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-09-11 00:20:04.348535803 +0000 2024-09-11T00:22:42.596 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T00:22:42.687 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-11T00:22:42.687 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-11T00:22:42.688 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000316512 s, 1.6 MB/s 2024-09-11T00:22:42.690 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T00:22:42.726 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2024-09-11T00:22:42.801 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T00:22:42.802 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:22:42.802 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-09-11T00:22:42.802 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:22:42.802 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:22:42.802 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-11 00:22:30.809469056 +0000 2024-09-11T00:22:42.802 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-11 00:20:04.810529910 +0000 2024-09-11T00:22:42.802 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-11 00:20:04.810529910 +0000 2024-09-11T00:22:42.802 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-09-11 00:20:04.810529910 +0000 2024-09-11T00:22:42.802 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T00:22:42.894 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-11T00:22:42.894 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-11T00:22:42.894 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000268424 s, 1.9 MB/s 2024-09-11T00:22:42.897 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T00:22:42.933 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2024-09-11T00:22:43.007 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T00:22:43.007 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:22:43.007 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-09-11T00:22:43.008 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:22:43.008 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:22:43.008 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-11 00:22:30.809469056 +0000 2024-09-11T00:22:43.008 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-11 00:20:05.282523890 +0000 2024-09-11T00:22:43.008 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-11 00:20:05.282523890 +0000 2024-09-11T00:22:43.008 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-09-11 00:20:05.282523890 +0000 2024-09-11T00:22:43.008 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T00:22:43.100 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-11T00:22:43.100 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-11T00:22:43.100 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.00026697 s, 1.9 MB/s 2024-09-11T00:22:43.103 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T00:22:43.140 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2024-09-11T00:22:43.217 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T00:22:43.217 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:22:43.217 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-09-11T00:22:43.217 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:22:43.217 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:22:43.217 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-11 00:22:30.810469043 +0000 2024-09-11T00:22:43.217 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-11 00:20:05.801517270 +0000 2024-09-11T00:22:43.217 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-11 00:20:05.801517270 +0000 2024-09-11T00:22:43.217 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-09-11 00:20:05.801517270 +0000 2024-09-11T00:22:43.218 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T00:22:43.310 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-11T00:22:43.310 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-11T00:22:43.310 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000263406 s, 1.9 MB/s 2024-09-11T00:22:43.313 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T00:22:43.349 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T00:22:43.349 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:22:43.349 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T00:22:43.386 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T00:22:43.386 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-09-11T00:22:43.463 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T00:22:43.464 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:22:43.464 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-09-11T00:22:43.464 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:22:43.464 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:22:43.464 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-11 00:22:15.441522693 +0000 2024-09-11T00:22:43.464 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-11 00:20:04.311877664 +0000 2024-09-11T00:22:43.464 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-11 00:20:04.311877664 +0000 2024-09-11T00:22:43.464 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-11 00:20:04.311877664 +0000 2024-09-11T00:22:43.464 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T00:22:43.556 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-11T00:22:43.556 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-11T00:22:43.556 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000284665 s, 1.8 MB/s 2024-09-11T00:22:43.559 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T00:22:43.595 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-09-11T00:22:43.671 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T00:22:43.672 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:22:43.672 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-09-11T00:22:43.672 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:22:43.672 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:22:43.672 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-11 00:22:15.441522693 +0000 2024-09-11T00:22:43.672 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-11 00:20:04.782870588 +0000 2024-09-11T00:22:43.672 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-11 00:20:04.782870588 +0000 2024-09-11T00:22:43.672 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-11 00:20:04.782870588 +0000 2024-09-11T00:22:43.672 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T00:22:43.765 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-11T00:22:43.765 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-11T00:22:43.765 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000465673 s, 1.1 MB/s 2024-09-11T00:22:43.767 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T00:22:43.804 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-09-11T00:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T00:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-09-11T00:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-11 00:22:15.443522662 +0000 2024-09-11T00:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-11 00:20:05.253863511 +0000 2024-09-11T00:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-11 00:20:05.253863511 +0000 2024-09-11T00:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-11 00:20:05.253863511 +0000 2024-09-11T00:22:43.880 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T00:22:43.971 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-11T00:22:43.971 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-11T00:22:43.971 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000264532 s, 1.9 MB/s 2024-09-11T00:22:43.974 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T00:22:44.010 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-09-11T00:22:44.086 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T00:22:44.086 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:22:44.086 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-09-11T00:22:44.086 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:22:44.086 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:22:44.086 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-11 00:22:15.444522646 +0000 2024-09-11T00:22:44.086 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-11 00:20:05.714856585 +0000 2024-09-11T00:22:44.086 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-11 00:20:05.714856585 +0000 2024-09-11T00:22:44.086 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-11 00:20:05.714856585 +0000 2024-09-11T00:22:44.087 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T00:22:44.177 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-11T00:22:44.178 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-11T00:22:44.178 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000283215 s, 1.8 MB/s 2024-09-11T00:22:44.180 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T00:22:44.216 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T00:22:44.216 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T00:22:44.217 INFO:tasks.ceph:Generating config... 2024-09-11T00:22:44.218 INFO:tasks.ceph:[client] pid file = 2024-09-11T00:22:44.218 INFO:tasks.ceph:[mgr] client mount timeout = 30 2024-09-11T00:22:44.218 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-11T00:22:44.218 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-11T00:22:44.218 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-11T00:22:44.218 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-11T00:22:44.218 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-11T00:22:44.218 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-11T00:22:44.218 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-11T00:22:44.218 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-11T00:22:44.218 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-11T00:22:44.219 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-11T00:22:44.219 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-11T00:22:44.219 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-11T00:22:44.219 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-11T00:22:44.219 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-11T00:22:44.219 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-11T00:22:44.219 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-11T00:22:44.219 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-11T00:22:44.219 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-11T00:22:44.219 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-11T00:22:44.219 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-11T00:22:44.219 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-11T00:22:44.219 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-11T00:22:44.220 INFO:tasks.ceph:Setting up mon.a... 2024-09-11T00:22:44.220 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-11T00:22:44.317 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.keyring 2024-09-11T00:22:44.323 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-11T00:22:44.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T00:22:44.465 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.40'), ('mon.b', '172.21.15.175'), ('mon.c', '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]')] 2024-09-11T00:22:44.466 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.40,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'client mount timeout': 30, 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-11T00:22:44.467 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:22:44.467 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T00:22:44.502 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.40 --add b 172.21.15.175 --addv c '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:22:44.621 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:22:44.621 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: generated fsid f5cb250f-2a64-4822-87ba-c63d5f030b36 2024-09-11T00:22:44.621 INFO:teuthology.orchestra.run.smithi040.stdout:setting min_mon_release = quincy 2024-09-11T00:22:44.621 INFO:teuthology.orchestra.run.smithi040.stdout:epoch 0 2024-09-11T00:22:44.621 INFO:teuthology.orchestra.run.smithi040.stdout:fsid f5cb250f-2a64-4822-87ba-c63d5f030b36 2024-09-11T00:22:44.621 INFO:teuthology.orchestra.run.smithi040.stdout:last_changed 2024-09-11T00:22:44.620288+0000 2024-09-11T00:22:44.621 INFO:teuthology.orchestra.run.smithi040.stdout:created 2024-09-11T00:22:44.620288+0000 2024-09-11T00:22:44.621 INFO:teuthology.orchestra.run.smithi040.stdout:min_mon_release 17 (quincy) 2024-09-11T00:22:44.621 INFO:teuthology.orchestra.run.smithi040.stdout:election_strategy: 1 2024-09-11T00:22:44.621 INFO:teuthology.orchestra.run.smithi040.stdout:0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-09-11T00:22:44.621 INFO:teuthology.orchestra.run.smithi040.stdout:1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.b 2024-09-11T00:22:44.621 INFO:teuthology.orchestra.run.smithi040.stdout:2: [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] mon.c 2024-09-11T00:22:44.622 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-11T00:22:44.624 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T00:22:44.659 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f5cb250f-2a64-4822-87ba-c63d5f030b36... 2024-09-11T00:22:44.659 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T00:22:44.703 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T00:22:44.797 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2024-09-11T00:22:44.797 INFO:teuthology.orchestra.run.smithi040.stdout: chdir = "" 2024-09-11T00:22:44.797 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T00:22:44.797 INFO:teuthology.orchestra.run.smithi040.stdout: auth supported = cephx 2024-09-11T00:22:44.797 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.797 INFO:teuthology.orchestra.run.smithi040.stdout: filestore xattr use omap = true 2024-09-11T00:22:44.797 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.797 INFO:teuthology.orchestra.run.smithi040.stdout: mon clock drift allowed = 1.000 2024-09-11T00:22:44.798 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.798 INFO:teuthology.orchestra.run.smithi040.stdout: osd crush chooseleaf type = 0 2024-09-11T00:22:44.798 INFO:teuthology.orchestra.run.smithi040.stdout: auth debug = true 2024-09-11T00:22:44.798 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.798 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on old message = true 2024-09-11T00:22:44.798 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on bug = true 2024-09-11T00:22:44.798 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.798 INFO:teuthology.orchestra.run.smithi040.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T00:22:44.798 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn max object skew = 0 2024-09-11T00:22:44.798 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.798 INFO:teuthology.orchestra.run.smithi040.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T00:22:44.798 INFO:teuthology.orchestra.run.smithi040.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T00:22:44.798 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.799 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default size = 2 2024-09-11T00:22:44.799 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.799 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow primary affinity = true 2024-09-11T00:22:44.799 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow pg remap = true 2024-09-11T00:22:44.799 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on legacy crush tunables = false 2024-09-11T00:22:44.799 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on crush straw calc version zero = false 2024-09-11T00:22:44.799 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on no sortbitwise = false 2024-09-11T00:22:44.799 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = false 2024-09-11T00:22:44.799 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on too few osds = false 2024-09-11T00:22:44.799 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T00:22:44.799 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T00:22:44.799 INFO:teuthology.orchestra.run.smithi040.stdout: mon_allow_pool_size_one = true 2024-09-11T00:22:44.799 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.799 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T00:22:44.800 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.800 INFO:teuthology.orchestra.run.smithi040.stdout: osd default data pool replay window = 5 2024-09-11T00:22:44.800 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.800 INFO:teuthology.orchestra.run.smithi040.stdout: mon allow pool delete = true 2024-09-11T00:22:44.800 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.800 INFO:teuthology.orchestra.run.smithi040.stdout: mon cluster log file level = debug 2024-09-11T00:22:44.800 INFO:teuthology.orchestra.run.smithi040.stdout: debug asserts on shutdown = true 2024-09-11T00:22:44.800 INFO:teuthology.orchestra.run.smithi040.stdout: mon health detail to clog = false 2024-09-11T00:22:44.800 INFO:teuthology.orchestra.run.smithi040.stdout: mon host = "172.21.15.40,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2024-09-11T00:22:44.800 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = f5cb250f-2a64-4822-87ba-c63d5f030b36 2024-09-11T00:22:44.800 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.800 INFO:teuthology.orchestra.run.smithi040.stdout:[osd] 2024-09-11T00:22:44.800 INFO:teuthology.orchestra.run.smithi040.stdout: osd journal size = 100 2024-09-11T00:22:44.800 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.801 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub load threshold = 5.0 2024-09-11T00:22:44.801 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub max interval = 600 2024-09-11T00:22:44.801 INFO:teuthology.orchestra.run.smithi040.stdout: osd mclock profile = high_recovery_ops 2024-09-11T00:22:44.801 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.801 INFO:teuthology.orchestra.run.smithi040.stdout: osd recover clone overlap = true 2024-09-11T00:22:44.801 INFO:teuthology.orchestra.run.smithi040.stdout: osd recovery max chunk = 1048576 2024-09-11T00:22:44.801 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.801 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug shutdown = true 2024-09-11T00:22:44.801 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug op order = true 2024-09-11T00:22:44.801 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug verify stray on activate = true 2024-09-11T00:22:44.801 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug trim objects = true 2024-09-11T00:22:44.801 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.801 INFO:teuthology.orchestra.run.smithi040.stdout: osd open classes on start = true 2024-09-11T00:22:44.802 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug pg log writeout = true 2024-09-11T00:22:44.802 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.802 INFO:teuthology.orchestra.run.smithi040.stdout: osd deep scrub update digest min age = 30 2024-09-11T00:22:44.802 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.802 INFO:teuthology.orchestra.run.smithi040.stdout: osd map max advance = 10 2024-09-11T00:22:44.802 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.802 INFO:teuthology.orchestra.run.smithi040.stdout: journal zero on create = true 2024-09-11T00:22:44.802 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.802 INFO:teuthology.orchestra.run.smithi040.stdout: filestore ondisk finisher threads = 3 2024-09-11T00:22:44.802 INFO:teuthology.orchestra.run.smithi040.stdout: filestore apply finisher threads = 3 2024-09-11T00:22:44.802 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.802 INFO:teuthology.orchestra.run.smithi040.stdout: bdev debug aio = true 2024-09-11T00:22:44.802 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug misdirected ops = true 2024-09-11T00:22:44.803 INFO:teuthology.orchestra.run.smithi040.stdout: bdev async discard = True 2024-09-11T00:22:44.803 INFO:teuthology.orchestra.run.smithi040.stdout: bdev enable discard = True 2024-09-11T00:22:44.803 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore allocator = bitmap 2024-09-11T00:22:44.803 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore block size = 96636764160 2024-09-11T00:22:44.803 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore fsck on mount = True 2024-09-11T00:22:44.803 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluefs = 1/20 2024-09-11T00:22:44.803 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluestore = 1/20 2024-09-11T00:22:44.803 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-09-11T00:22:44.803 INFO:teuthology.orchestra.run.smithi040.stdout: debug osd = 20 2024-09-11T00:22:44.803 INFO:teuthology.orchestra.run.smithi040.stdout: debug rocksdb = 4/10 2024-09-11T00:22:44.803 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T00:22:44.803 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd full ratio = 0.9 2024-09-11T00:22:44.803 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd nearfull ratio = 0.8 2024-09-11T00:22:44.803 INFO:teuthology.orchestra.run.smithi040.stdout: osd failsafe full ratio = 0.95 2024-09-11T00:22:44.804 INFO:teuthology.orchestra.run.smithi040.stdout: osd objectstore = bluestore 2024-09-11T00:22:44.804 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.804 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr] 2024-09-11T00:22:44.804 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-09-11T00:22:44.804 INFO:teuthology.orchestra.run.smithi040.stdout: debug mgr = 20 2024-09-11T00:22:44.804 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2024-09-11T00:22:44.804 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2024-09-11T00:22:44.804 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2024-09-11T00:22:44.804 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2024-09-11T00:22:44.804 INFO:teuthology.orchestra.run.smithi040.stdout: mgr/telemetry/nag = false 2024-09-11T00:22:44.804 INFO:teuthology.orchestra.run.smithi040.stdout: client mount timeout = 30 2024-09-11T00:22:44.804 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2024-09-11T00:22:44.804 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.804 INFO:teuthology.orchestra.run.smithi040.stdout:[mon] 2024-09-11T00:22:44.805 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-09-11T00:22:44.805 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2024-09-11T00:22:44.805 INFO:teuthology.orchestra.run.smithi040.stdout: debug paxos = 20 2024-09-11T00:22:44.805 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2024-09-11T00:22:44.805 INFO:teuthology.orchestra.run.smithi040.stdout: mon data avail warn = 5 2024-09-11T00:22:44.805 INFO:teuthology.orchestra.run.smithi040.stdout: mon mgr mkfs grace = 240 2024-09-11T00:22:44.805 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2024-09-11T00:22:44.805 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd reporter subtree level = osd 2024-09-11T00:22:44.805 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd prime pg temp = true 2024-09-11T00:22:44.805 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2024-09-11T00:22:44.805 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.805 INFO:teuthology.orchestra.run.smithi040.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T00:22:44.805 INFO:teuthology.orchestra.run.smithi040.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T00:22:44.805 INFO:teuthology.orchestra.run.smithi040.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T00:22:44.805 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.806 INFO:teuthology.orchestra.run.smithi040.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T00:22:44.806 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T00:22:44.806 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T00:22:44.806 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.806 INFO:teuthology.orchestra.run.smithi040.stdout: # 1m isn't quite enough 2024-09-11T00:22:44.806 INFO:teuthology.orchestra.run.smithi040.stdout: mon_down_mkfs_grace = 2m 2024-09-11T00:22:44.806 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.806 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_filestore_osds = false 2024-09-11T00:22:44.806 INFO:teuthology.orchestra.run.smithi040.stdout: mon down mkfs grace = 300 2024-09-11T00:22:44.806 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:22:44.806 INFO:teuthology.orchestra.run.smithi040.stdout:[client] 2024-09-11T00:22:44.806 INFO:teuthology.orchestra.run.smithi040.stdout: rgw cache enabled = true 2024-09-11T00:22:44.806 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable ops log = true 2024-09-11T00:22:44.807 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable usage log = true 2024-09-11T00:22:44.807 INFO:teuthology.orchestra.run.smithi040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T00:22:44.807 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T00:22:44.807 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = "" 2024-09-11T00:22:44.807 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.a] 2024-09-11T00:22:44.807 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.b] 2024-09-11T00:22:44.807 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.c] 2024-09-11T00:22:44.807 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2024-09-11T00:22:44.807 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2024-09-11T00:22:44.807 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2024-09-11T00:22:44.807 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2024-09-11T00:22:44.808 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2024-09-11T00:22:44.808 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2024-09-11T00:22:44.808 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T00:22:44.808 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2024-09-11T00:22:44.808 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.808 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2024-09-11T00:22:44.808 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.808 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2024-09-11T00:22:44.808 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.808 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2024-09-11T00:22:44.808 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2024-09-11T00:22:44.808 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.809 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2024-09-11T00:22:44.809 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2024-09-11T00:22:44.809 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.809 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T00:22:44.809 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2024-09-11T00:22:44.809 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.809 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T00:22:44.809 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T00:22:44.809 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.809 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2024-09-11T00:22:44.809 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.809 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2024-09-11T00:22:44.809 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2024-09-11T00:22:44.809 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2024-09-11T00:22:44.809 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2024-09-11T00:22:44.810 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2024-09-11T00:22:44.810 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2024-09-11T00:22:44.810 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2024-09-11T00:22:44.810 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T00:22:44.810 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T00:22:44.810 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2024-09-11T00:22:44.810 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.810 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T00:22:44.810 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.810 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2024-09-11T00:22:44.810 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.810 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2024-09-11T00:22:44.810 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.810 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2024-09-11T00:22:44.811 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2024-09-11T00:22:44.811 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2024-09-11T00:22:44.811 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.40,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2024-09-11T00:22:44.811 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = f5cb250f-2a64-4822-87ba-c63d5f030b36 2024-09-11T00:22:44.811 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.811 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2024-09-11T00:22:44.811 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2024-09-11T00:22:44.811 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.811 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2024-09-11T00:22:44.811 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 600 2024-09-11T00:22:44.811 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock profile = high_recovery_ops 2024-09-11T00:22:44.811 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.811 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2024-09-11T00:22:44.811 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2024-09-11T00:22:44.811 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.812 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2024-09-11T00:22:44.812 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2024-09-11T00:22:44.812 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2024-09-11T00:22:44.812 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug trim objects = true 2024-09-11T00:22:44.812 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.812 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2024-09-11T00:22:44.812 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2024-09-11T00:22:44.812 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.812 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2024-09-11T00:22:44.812 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.812 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2024-09-11T00:22:44.812 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.812 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2024-09-11T00:22:44.812 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.813 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2024-09-11T00:22:44.813 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2024-09-11T00:22:44.813 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.813 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2024-09-11T00:22:44.813 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2024-09-11T00:22:44.813 INFO:teuthology.orchestra.run.smithi175.stdout: bdev async discard = True 2024-09-11T00:22:44.813 INFO:teuthology.orchestra.run.smithi175.stdout: bdev enable discard = True 2024-09-11T00:22:44.813 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore allocator = bitmap 2024-09-11T00:22:44.813 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2024-09-11T00:22:44.813 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2024-09-11T00:22:44.813 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 1/20 2024-09-11T00:22:44.813 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 1/20 2024-09-11T00:22:44.813 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-09-11T00:22:44.813 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2024-09-11T00:22:44.814 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 4/10 2024-09-11T00:22:44.814 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T00:22:44.814 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2024-09-11T00:22:44.814 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2024-09-11T00:22:44.814 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2024-09-11T00:22:44.814 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2024-09-11T00:22:44.814 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.814 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2024-09-11T00:22:44.814 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-09-11T00:22:44.814 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2024-09-11T00:22:44.814 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-09-11T00:22:44.814 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-09-11T00:22:44.814 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-09-11T00:22:44.814 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-09-11T00:22:44.814 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2024-09-11T00:22:44.815 INFO:teuthology.orchestra.run.smithi175.stdout: client mount timeout = 30 2024-09-11T00:22:44.815 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2024-09-11T00:22:44.815 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.815 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2024-09-11T00:22:44.815 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-09-11T00:22:44.815 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-09-11T00:22:44.815 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2024-09-11T00:22:44.815 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-09-11T00:22:44.815 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2024-09-11T00:22:44.815 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2024-09-11T00:22:44.815 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-09-11T00:22:44.815 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2024-09-11T00:22:44.815 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2024-09-11T00:22:44.815 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-09-11T00:22:44.816 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.816 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T00:22:44.816 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T00:22:44.816 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T00:22:44.816 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.816 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T00:22:44.816 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T00:22:44.816 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T00:22:44.816 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.816 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2024-09-11T00:22:44.816 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2024-09-11T00:22:44.816 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.816 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2024-09-11T00:22:44.816 INFO:teuthology.orchestra.run.smithi175.stdout: mon down mkfs grace = 300 2024-09-11T00:22:44.817 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-11T00:22:44.817 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2024-09-11T00:22:44.817 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2024-09-11T00:22:44.817 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2024-09-11T00:22:44.817 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2024-09-11T00:22:44.817 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T00:22:44.817 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T00:22:44.817 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = "" 2024-09-11T00:22:44.817 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2024-09-11T00:22:44.817 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2024-09-11T00:22:44.817 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2024-09-11T00:22:44.817 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-09-11T00:22:44.817 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2024-09-11T00:22:44.817 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-09-11T00:22:44.817 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2024-09-11T00:22:44.827 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-11T00:22:44.828 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-11T00:22:44.925 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-11T00:22:44.926 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:22:44.926 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-11T00:22:44.961 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:22:44.961 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-11T00:22:45.035 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T00:22:45.036 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:22:45.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T00:22:45.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T00:22:45.154 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:22:45.154 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:22:45.230 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi175.front.sepia.ceph.com 2024-09-11T00:22:45.230 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:22:45.230 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T00:22:45.230 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T00:22:45.307 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:22:45.307 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:22:45.381 INFO:tasks.ceph:Setting up mon nodes... 2024-09-11T00:22:45.381 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-11T00:22:45.382 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T00:22:45.487 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T00:22:45.493 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T00:22:45.605 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T00:22:45.612 INFO:tasks.ceph:Setting up mds nodes... 2024-09-11T00:22:45.612 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-11T00:22:45.716 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-11T00:22:45.722 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-11T00:22:45.777 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-11T00:22:45.881 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-11T00:22:45.886 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-11T00:22:45.941 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-11T00:22:46.046 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-11T00:22:46.052 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-11T00:22:46.108 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-11T00:22:46.211 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-11T00:22:46.217 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-11T00:22:46.272 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-11T00:22:46.273 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T00:22:46.356 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-11T00:22:46.384 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-11T00:22:46.465 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-11T00:22:46.493 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-11T00:22:46.575 INFO:teuthology.orchestra.run.smithi175.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-11T00:22:46.602 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-11T00:22:46.682 INFO:teuthology.orchestra.run.smithi175.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-11T00:22:46.710 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-11T00:22:46.710 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T00:22:46.711 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-11T00:22:46.767 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T00:22:46.767 INFO:tasks.ceph:role: osd.0 2024-09-11T00:22:46.767 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T00:22:46.767 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T00:22:46.830 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:22:46.830 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:22:46.830 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:22:46.830 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:22:46.830 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:22:46.830 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:22:46.830 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:22:46.831 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:22:46.831 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:22:46.831 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:22:47.234 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-09-11T00:22:47.238 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-09-11T00:22:47.238 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-11T00:22:47.359 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-11T00:22:47.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-11T00:22:47.480 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T00:22:47.481 INFO:tasks.ceph:role: osd.1 2024-09-11T00:22:47.481 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T00:22:47.481 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T00:22:47.545 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:22:47.545 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:22:47.545 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:22:47.546 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:22:47.546 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:22:47.546 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:22:47.546 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:22:47.546 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:22:47.546 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:22:47.546 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:22:47.897 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-09-11T00:22:47.901 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-09-11T00:22:47.902 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-11T00:22:47.985 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-11T00:22:48.051 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-11T00:22:48.110 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T00:22:48.110 INFO:tasks.ceph:role: osd.2 2024-09-11T00:22:48.111 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T00:22:48.111 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T00:22:48.173 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:22:48.173 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:22:48.173 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:22:48.173 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:22:48.173 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:22:48.174 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:22:48.174 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:22:48.174 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:22:48.174 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:22:48.174 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:22:48.556 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-09-11T00:22:48.560 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-09-11T00:22:48.561 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-11T00:22:48.661 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-11T00:22:48.723 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-11T00:22:48.779 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T00:22:48.779 INFO:tasks.ceph:role: osd.3 2024-09-11T00:22:48.779 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T00:22:48.779 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T00:22:48.843 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:22:48.843 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:22:48.843 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:22:48.843 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:22:48.843 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:22:48.843 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:22:48.843 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:22:48.844 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:22:48.844 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:22:48.844 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:22:49.232 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-09-11T00:22:49.236 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-09-11T00:22:49.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-11T00:22:49.355 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-11T00:22:49.418 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:22:49.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:22:49.525+0000 7f226e60e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-11T00:22:49.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:22:49.530+0000 7f226e60e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-11T00:22:49.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:22:49.531+0000 7f226e60e640 -1 bdev(0x557e9a7b7800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-11T00:22:49.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:22:49.531+0000 7f226e60e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-11T00:22:52.569 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T00:22:52.631 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:22:52.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:22:52.723+0000 7f190d4ef640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-11T00:22:52.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:22:52.724+0000 7f190d4ef640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-11T00:22:52.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:22:52.724+0000 7f190d4ef640 -1 bdev(0x560d0e46d800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-11T00:22:52.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:22:52.724+0000 7f190d4ef640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-11T00:22:55.753 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T00:22:55.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:22:55.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:22:55.907+0000 7f6f6b031640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-11T00:22:55.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:22:55.908+0000 7f6f6b031640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-11T00:22:55.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:22:55.908+0000 7f6f6b031640 -1 bdev(0x55cc7bbcb800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-11T00:22:55.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:22:55.908+0000 7f6f6b031640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-11T00:22:58.929 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T00:22:58.991 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:22:59.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:22:59.084+0000 7f87fcdae640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-11T00:22:59.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:22:59.084+0000 7f87fcdae640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-11T00:22:59.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:22:59.084+0000 7f87fcdae640 -1 bdev(0x559f9afb7800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-11T00:22:59.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:22:59.085+0000 7f87fcdae640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-11T00:23:02.146 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T00:23:02.207 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-11T00:23:02.269 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T00:23:02.269 INFO:tasks.ceph:role: osd.4 2024-09-11T00:23:02.269 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com 2024-09-11T00:23:02.269 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:23:02.335 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:23:02.737 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-09-11T00:23:02.741 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-09-11T00:23:02.741 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-11T00:23:02.878 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-11T00:23:02.944 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-11T00:23:03.000 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T00:23:03.000 INFO:tasks.ceph:role: osd.5 2024-09-11T00:23:03.001 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com 2024-09-11T00:23:03.001 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T00:23:03.062 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:23:03.063 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:23:03.063 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:23:03.063 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:23:03.063 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:23:03.063 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:23:03.063 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:23:03.063 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:23:03.063 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:23:03.063 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:23:03.420 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-09-11T00:23:03.424 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-09-11T00:23:03.425 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-11T00:23:03.509 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-11T00:23:03.570 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-11T00:23:03.626 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T00:23:03.626 INFO:tasks.ceph:role: osd.6 2024-09-11T00:23:03.626 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com 2024-09-11T00:23:03.626 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T00:23:03.688 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:23:03.688 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:23:03.688 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:23:03.688 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:23:03.688 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:23:03.688 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:23:03.688 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:23:03.689 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:23:03.689 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:23:03.689 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:23:04.078 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-09-11T00:23:04.082 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-09-11T00:23:04.082 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-11T00:23:04.182 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-11T00:23:04.245 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-11T00:23:04.301 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T00:23:04.301 INFO:tasks.ceph:role: osd.7 2024-09-11T00:23:04.301 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com 2024-09-11T00:23:04.301 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T00:23:04.364 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T00:23:04.364 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T00:23:04.364 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T00:23:04.364 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T00:23:04.364 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T00:23:04.364 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-09-11T00:23:04.364 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T00:23:04.364 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T00:23:04.364 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T00:23:04.365 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T00:23:04.784 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-09-11T00:23:04.788 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-09-11T00:23:04.788 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-11T00:23:04.929 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-11T00:23:04.992 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:23:05.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:05.100+0000 7f9252b25640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-11T00:23:05.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:05.105+0000 7f9252b25640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-11T00:23:05.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:05.106+0000 7f9252b25640 -1 bdev(0x55e99575b800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-11T00:23:05.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:05.106+0000 7f9252b25640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-11T00:23:08.360 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-11T00:23:08.419 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:23:08.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:08.508+0000 7f05a27b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-11T00:23:08.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:08.509+0000 7f05a27b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-11T00:23:08.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:08.509+0000 7f05a27b2640 -1 bdev(0x55869884d800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-11T00:23:08.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:08.509+0000 7f05a27b2640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-11T00:23:11.535 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-11T00:23:11.591 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:23:11.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:11.678+0000 7f4bfa7dd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-11T00:23:11.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:11.679+0000 7f4bfa7dd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-11T00:23:11.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:11.679+0000 7f4bfa7dd640 -1 bdev(0x560a1e0ad800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-11T00:23:11.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:11.680+0000 7f4bfa7dd640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-11T00:23:12.351 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:23:12.355 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:23:14.943 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-11T00:23:15.003 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:23:15.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:15.093+0000 7ff14700f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-11T00:23:15.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:15.094+0000 7ff14700f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-11T00:23:15.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:15.094+0000 7ff14700f640 -1 bdev(0x55587ec11800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-11T00:23:15.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:15.095+0000 7ff14700f640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-11T00:23:18.123 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-11T00:23:18.181 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-11T00:23:18.181 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:23:18.181 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-11T00:23:18.243 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:23:18.243 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-11T00:23:18.344 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:23:18.344 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-11T00:23:18.443 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:23:18.443 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-11T00:23:18.540 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:23:18.540 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-11T00:23:18.636 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:23:18.636 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-11T00:23:18.731 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:23:18.731 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-11T00:23:18.827 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:23:18.828 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-11T00:23:18.886 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:23:18.886 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-11T00:23:18.982 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:23:18.982 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-11T00:23:19.077 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:23:19.077 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-11T00:23:19.172 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:23:19.172 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-11T00:23:19.266 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:23:19.267 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-11T00:23:19.361 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:23:19.361 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-11T00:23:19.457 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:23:19.457 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-11T00:23:19.495 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:23:19.495 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-11T00:23:19.571 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:23:19.571 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-11T00:23:19.606 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:23:19.606 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-11T00:23:19.680 INFO:tasks.ceph:Adding keys to all mons... 2024-09-11T00:23:19.680 DEBUG:teuthology.orchestra.run.smithi040:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T00:23:19.684 DEBUG:teuthology.orchestra.run.smithi175:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T00:23:19.735 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.y] 2024-09-11T00:23:19.735 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDV4uBmZHwAHRAAaV9xFq8CBsynQaq38qysrg== 2024-09-11T00:23:19.735 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2024-09-11T00:23:19.735 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDV4uBmLFOvKhAAb1cFmpm1U1fm8MLXxXUPcQ== 2024-09-11T00:23:19.735 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2024-09-11T00:23:19.735 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDV4uBmUQ2ENBAA0hmk6g0a2Xom4gt2LTr8dA== 2024-09-11T00:23:19.735 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.0] 2024-09-11T00:23:19.735 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDZ4uBmZZ9jHxAA+f3rLsxL2dvFgq7tN4tf0A== 2024-09-11T00:23:19.736 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.1] 2024-09-11T00:23:19.736 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDc4uBm8V0uKxAAw4WYTHgOlO4SmPbwv4FtZg== 2024-09-11T00:23:19.736 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.2] 2024-09-11T00:23:19.736 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDf4uBmTBweNhAAfa3ZEjKtk/gux+P/AQcgtw== 2024-09-11T00:23:19.736 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.3] 2024-09-11T00:23:19.736 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDj4uBm5DoRBRAAIBfqSduZ0i/yWK4VmfBJlg== 2024-09-11T00:23:19.736 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.x] 2024-09-11T00:23:19.736 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDV4uBmVJUPJBAAeehcDZVCcpiiYtFBIo0ePA== 2024-09-11T00:23:19.736 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2024-09-11T00:23:19.736 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDW4uBmcfq7AhAAG2MquPDLPdnjl0gQuW2lSQ== 2024-09-11T00:23:19.736 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2024-09-11T00:23:19.736 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDW4uBmUcKUDBAAv0bR7JPrKbIlni/IqRmfjg== 2024-09-11T00:23:19.736 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.4] 2024-09-11T00:23:19.736 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDp4uBmFlkRBhAAJThnT6u+bsgrgcxNajL+ag== 2024-09-11T00:23:19.737 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.5] 2024-09-11T00:23:19.737 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDs4uBmSWpsHhAA9Nxa99BKw86VppOt5lcyvA== 2024-09-11T00:23:19.737 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.6] 2024-09-11T00:23:19.737 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDv4uBmu6ePKBAA3Dsf28//S4DRnEfsqijC3A== 2024-09-11T00:23:19.737 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.7] 2024-09-11T00:23:19.737 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDz4uBmJpOvBRAA860ItKmw0vHPT9j6sclQIw== 2024-09-11T00:23:19.737 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2024-09-11T00:23:19.737 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDW4uBmjUo6FRAAR+2yK++OAaoLfSv+n2079Q== 2024-09-11T00:23:19.737 INFO:teuthology.orchestra.run.smithi040.stdout:[client.2] 2024-09-11T00:23:19.737 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDW4uBmnE+5GxAAVuwA93riifhk4+FvqU5N1Q== 2024-09-11T00:23:19.737 INFO:teuthology.orchestra.run.smithi040.stdout:[client.1] 2024-09-11T00:23:19.737 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDW4uBm8dpDIhAAiF6QGXV6aVwkj7YjPW1ZtA== 2024-09-11T00:23:19.737 INFO:teuthology.orchestra.run.smithi040.stdout:[client.3] 2024-09-11T00:23:19.737 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDW4uBm+uWnKBAAuSy+KvI5JhtSuMHhM6imsw== 2024-09-11T00:23:19.772 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.y] 2024-09-11T00:23:19.772 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDV4uBmZHwAHRAAaV9xFq8CBsynQaq38qysrg== 2024-09-11T00:23:19.772 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-09-11T00:23:19.773 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDV4uBmLFOvKhAAb1cFmpm1U1fm8MLXxXUPcQ== 2024-09-11T00:23:19.773 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2024-09-11T00:23:19.773 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDV4uBmUQ2ENBAA0hmk6g0a2Xom4gt2LTr8dA== 2024-09-11T00:23:19.773 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.0] 2024-09-11T00:23:19.773 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDZ4uBmZZ9jHxAA+f3rLsxL2dvFgq7tN4tf0A== 2024-09-11T00:23:19.773 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.1] 2024-09-11T00:23:19.773 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDc4uBm8V0uKxAAw4WYTHgOlO4SmPbwv4FtZg== 2024-09-11T00:23:19.773 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.2] 2024-09-11T00:23:19.773 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDf4uBmTBweNhAAfa3ZEjKtk/gux+P/AQcgtw== 2024-09-11T00:23:19.773 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.3] 2024-09-11T00:23:19.773 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDj4uBm5DoRBRAAIBfqSduZ0i/yWK4VmfBJlg== 2024-09-11T00:23:19.773 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.x] 2024-09-11T00:23:19.773 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDV4uBmVJUPJBAAeehcDZVCcpiiYtFBIo0ePA== 2024-09-11T00:23:19.773 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-09-11T00:23:19.774 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDW4uBmcfq7AhAAG2MquPDLPdnjl0gQuW2lSQ== 2024-09-11T00:23:19.774 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2024-09-11T00:23:19.774 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDW4uBmUcKUDBAAv0bR7JPrKbIlni/IqRmfjg== 2024-09-11T00:23:19.774 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.4] 2024-09-11T00:23:19.774 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDp4uBmFlkRBhAAJThnT6u+bsgrgcxNajL+ag== 2024-09-11T00:23:19.774 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.5] 2024-09-11T00:23:19.774 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDs4uBmSWpsHhAA9Nxa99BKw86VppOt5lcyvA== 2024-09-11T00:23:19.774 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.6] 2024-09-11T00:23:19.774 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDv4uBmu6ePKBAA3Dsf28//S4DRnEfsqijC3A== 2024-09-11T00:23:19.774 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.7] 2024-09-11T00:23:19.774 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDz4uBmJpOvBRAA860ItKmw0vHPT9j6sclQIw== 2024-09-11T00:23:19.774 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2024-09-11T00:23:19.774 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDW4uBmjUo6FRAAR+2yK++OAaoLfSv+n2079Q== 2024-09-11T00:23:19.775 INFO:teuthology.orchestra.run.smithi175.stdout:[client.2] 2024-09-11T00:23:19.775 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDW4uBmnE+5GxAAVuwA93riifhk4+FvqU5N1Q== 2024-09-11T00:23:19.775 INFO:teuthology.orchestra.run.smithi175.stdout:[client.1] 2024-09-11T00:23:19.775 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDW4uBm8dpDIhAAiF6QGXV6aVwkj7YjPW1ZtA== 2024-09-11T00:23:19.775 INFO:teuthology.orchestra.run.smithi175.stdout:[client.3] 2024-09-11T00:23:19.775 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDW4uBm+uWnKBAAuSy+KvI5JhtSuMHhM6imsw== 2024-09-11T00:23:19.776 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T00:23:19.783 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T00:23:19.909 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:23:19.913 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:23:20.009 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:23:20.013 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:23:20.110 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:23:20.114 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:23:20.208 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:23:20.211 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:23:20.306 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:23:20.309 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:23:20.403 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:23:20.407 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:23:20.501 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T00:23:20.505 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T00:23:20.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:23:20.603 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:23:20.700 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:23:20.704 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T00:23:20.799 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:23:20.804 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:23:20.897 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:23:20.901 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:23:20.994 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:23:20.998 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:23:21.092 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:23:21.096 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T00:23:21.190 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T00:23:21.194 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T00:23:21.290 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T00:23:21.294 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T00:23:21.393 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T00:23:21.398 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T00:23:21.494 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T00:23:21.498 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T00:23:21.593 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-11T00:23:21.597 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-11T00:23:21.652 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T00:23:21.761 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-11T00:23:21.818 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-11T00:23:21.874 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T00:23:21.983 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-11T00:23:22.039 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-11T00:23:22.094 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T00:23:22.201 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-11T00:23:22.257 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:23:22.261 DEBUG:teuthology.orchestra.run.smithi175:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T00:23:22.295 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-11T00:23:22.295 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T00:23:22.295 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T00:23:22.336 INFO:tasks.ceph.mon.a:Started 2024-09-11T00:23:22.336 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-11T00:23:22.336 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-11T00:23:22.340 INFO:tasks.ceph.mon.b:Started 2024-09-11T00:23:22.340 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-11T00:23:22.341 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-11T00:23:22.344 INFO:tasks.ceph.mon.c:Started 2024-09-11T00:23:22.345 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-11T00:23:22.345 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-11T00:23:22.345 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-11T00:23:22.349 INFO:tasks.ceph.mgr.y:Started 2024-09-11T00:23:22.349 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-11T00:23:22.349 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-11T00:23:22.353 INFO:tasks.ceph.mgr.x:Started 2024-09-11T00:23:22.354 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-11T00:23:22.354 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-11T00:23:22.358 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-11T00:23:22.358 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-11T00:23:22.404 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-11T00:23:22.404 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-11T00:23:22.450 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-11T00:23:22.451 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-11T00:23:22.497 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-11T00:23:22.497 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-11T00:23:22.544 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-11T00:23:22.544 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-11T00:23:22.593 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-11T00:23:22.594 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-11T00:23:22.639 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-11T00:23:22.640 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-11T00:23:22.688 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-11T00:23:22.688 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-11T00:23:22.735 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-11T00:23:22.735 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-11T00:23:22.787 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-11T00:23:22.787 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-11T00:23:22.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.825+0000 7fb0c3c00640 1 -- 172.21.15.40:0/3412023943 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0bc0d2730 con 0x7fb0bc0d2350 2024-09-11T00:23:22.839 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-11T00:23:22.840 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-11T00:23:22.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.828+0000 7fac0fe00640 1 -- 172.21.15.40:0/2572506885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac100b5090 msgr2=0x7fac101f57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:22.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.828+0000 7fac0fe00640 1 --2- 172.21.15.40:0/2572506885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac100b5090 0x7fac101f57c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fac00001150 tx=0x7fac00001610 comp rx=0 tx=0).stop 2024-09-11T00:23:22.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.828+0000 7fac0fe00640 1 -- 172.21.15.40:0/2572506885 shutdown_connections 2024-09-11T00:23:22.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.828+0000 7fac0fe00640 1 --2- 172.21.15.40:0/2572506885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac100d47a0 0x7fac1006e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:22.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.828+0000 7fac0fe00640 1 --2- 172.21.15.40:0/2572506885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac100d23a0 0x7fac101f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:22.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.828+0000 7fac0fe00640 1 --2- 172.21.15.40:0/2572506885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac100b5090 0x7fac101f57c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:22.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.828+0000 7fac0fe00640 1 -- 172.21.15.40:0/2572506885 >> 172.21.15.40:0/2572506885 conn(0x7fac100d3c10 msgr2=0x7fac100b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:22.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.829+0000 7fac0fe00640 1 -- 172.21.15.40:0/2572506885 shutdown_connections 2024-09-11T00:23:22.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.829+0000 7fac0fe00640 1 -- 172.21.15.40:0/2572506885 wait complete. 2024-09-11T00:23:22.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.834+0000 7fb0b8c00640 1 -- 172.21.15.40:0/3412023943 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fb0a8004be0 con 0x7fb0bc0d2350 2024-09-11T00:23:22.866 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-11T00:23:22.866 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-11T00:23:22.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.869+0000 7f7be2600640 1 -- 172.21.15.40:0/4160828279 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f7bdc15f630 con 0x7f7bdc072560 2024-09-11T00:23:22.882 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-11T00:23:22.882 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-11T00:23:22.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.879+0000 7fb851a00640 1 -- 172.21.15.40:0/3230017095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb84c0b3750 msgr2=0x7fb84c072340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:22.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.879+0000 7fb851a00640 1 --2- 172.21.15.40:0/3230017095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb84c0b3750 0x7fb84c072340 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb84c070030 tx=0x7fb83802a4a0 comp rx=0 tx=0).stop 2024-09-11T00:23:22.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.880+0000 7fb851a00640 1 -- 172.21.15.40:0/3230017095 shutdown_connections 2024-09-11T00:23:22.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.880+0000 7fb851a00640 1 --2- 172.21.15.40:0/3230017095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb84c0b3750 0x7fb84c072340 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:22.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.880+0000 7fb851a00640 1 --2- 172.21.15.40:0/3230017095 >> v2:172.21.15.40:3300/0 conn(0x7fb84c159aa0 0x7fb84c0b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:22.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.880+0000 7fb851a00640 1 -- 172.21.15.40:0/3230017095 >> 172.21.15.40:0/3230017095 conn(0x7fb84c0cf8d0 msgr2=0x7fb84c0cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:22.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.880+0000 7fb851a00640 1 -- 172.21.15.40:0/3230017095 shutdown_connections 2024-09-11T00:23:22.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.881+0000 7fb851a00640 1 -- 172.21.15.40:0/3230017095 wait complete. 2024-09-11T00:23:22.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.881+0000 7f7bd3400640 1 -- 172.21.15.40:0/4160828279 <== mon.2 v2:172.21.15.175:3301/0 8 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f7bd4029020 con 0x7f7bdc072560 2024-09-11T00:23:22.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.883+0000 7f7bd3400640 1 -- 172.21.15.40:0/4160828279 <== mon.2 v2:172.21.15.175:3301/0 9 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7f7bd400a930 con 0x7f7bdc072560 2024-09-11T00:23:22.892 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-11T00:23:22.892 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-11T00:23:22.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.884+0000 7fb0b8c00640 1 -- 172.21.15.40:0/3412023943 <== mon.2 v2:172.21.15.175:3301/0 8 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fb0a8010480 con 0x7fb0bc0d2350 2024-09-11T00:23:22.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.885+0000 7fb851a00640 1 Processor -- start 2024-09-11T00:23:22.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.885+0000 7fb851a00640 1 -- start start 2024-09-11T00:23:22.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.889+0000 7fb851a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb84c072880 0x7fb84c1f0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:22.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.890+0000 7fb84be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb84c072880 0x7fb84c1f0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:22.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.890+0000 7f7be2600640 1 -- 172.21.15.40:0/4160828279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bdc072560 msgr2=0x7f7bdc157250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:22.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.890+0000 7f7be2600640 1 --2- 172.21.15.40:0/4160828279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bdc072560 0x7f7bdc157250 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400c670 tx=0x7f7bd400cb30 comp rx=0 tx=0).stop 2024-09-11T00:23:22.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.890+0000 7fb84be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb84c072880 0x7fb84c1f0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60390/0 (socket says 172.21.15.40:60390) 2024-09-11T00:23:22.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.890+0000 7fb84be00640 1 -- 172.21.15.40:0/1367497257 learned_addr learned my addr 172.21.15.40:0/1367497257 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:22.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.891+0000 7fb851a00640 1 --2- 172.21.15.40:0/1367497257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb84c0b3750 0x7fb84c149450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:22.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.891+0000 7f7be2600640 1 -- 172.21.15.40:0/4160828279 shutdown_connections 2024-09-11T00:23:22.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.891+0000 7f7be2600640 1 --2- 172.21.15.40:0/4160828279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bdc15bcc0 0x7f7bdc0b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:22.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.891+0000 7f7be2600640 1 --2- 172.21.15.40:0/4160828279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bdc0d06d0 0x7f7bdc153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:22.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.891+0000 7f7be2600640 1 --2- 172.21.15.40:0/4160828279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bdc072560 0x7f7bdc157250 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:22.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.891+0000 7f7be2600640 1 -- 172.21.15.40:0/4160828279 >> 172.21.15.40:0/4160828279 conn(0x7f7bdc0cfbb0 msgr2=0x7f7bdc0ceee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:22.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.891+0000 7f7be2600640 1 -- 172.21.15.40:0/4160828279 shutdown_connections 2024-09-11T00:23:22.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.891+0000 7f7be2600640 1 -- 172.21.15.40:0/4160828279 wait complete. 2024-09-11T00:23:22.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.891+0000 7fb851a00640 1 --2- 172.21.15.40:0/1367497257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb84c159aa0 0x7fb84c1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.891+0000 7fb84b400640 1 --2- 172.21.15.40:0/1367497257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb84c0b3750 0x7fb84c149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.894+0000 7fb851a00640 1 -- 172.21.15.40:0/1367497257 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c06fbd0 con 0x7fb84c072880 2024-09-11T00:23:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.894+0000 7fb851a00640 1 -- 172.21.15.40:0/1367497257 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c06fa50 con 0x7fb84c0b3750 2024-09-11T00:23:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.894+0000 7fb851a00640 1 -- 172.21.15.40:0/1367497257 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb84c06fd50 con 0x7fb84c159aa0 2024-09-11T00:23:22.910 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-11T00:23:22.910 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-11T00:23:22.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.895+0000 7fb851000640 1 --2- 172.21.15.40:0/1367497257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb84c159aa0 0x7fb84c1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:22.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.903+0000 7fb851000640 1 -- 172.21.15.40:0/1367497257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb84c0b3750 msgr2=0x7fb84c149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:22.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.903+0000 7fb851000640 1 --2- 172.21.15.40:0/1367497257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb84c0b3750 0x7fb84c149450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:22.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.903+0000 7fb851000640 1 -- 172.21.15.40:0/1367497257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb84c072880 msgr2=0x7fb84c1f0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:22.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.903+0000 7fb851000640 1 --2- 172.21.15.40:0/1367497257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb84c072880 0x7fb84c1f0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:22.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.903+0000 7fb851000640 1 -- 172.21.15.40:0/1367497257 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84c1e3920 con 0x7fb84c159aa0 2024-09-11T00:23:22.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.904+0000 7fb84be00640 1 --2- 172.21.15.40:0/1367497257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb84c072880 0x7fb84c1f0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:23:22.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.908+0000 7fb851000640 1 --2- 172.21.15.40:0/1367497257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb84c159aa0 0x7fb84c1555b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb84400e990 tx=0x7fb84400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:22.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.909+0000 7fb843e00640 1 -- 172.21.15.40:0/1367497257 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb844015070 con 0x7fb84c159aa0 2024-09-11T00:23:22.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.909+0000 7fb851a00640 1 -- 172.21.15.40:0/1367497257 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb84c1e3c00 con 0x7fb84c159aa0 2024-09-11T00:23:22.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.909+0000 7fb851a00640 1 -- 172.21.15.40:0/1367497257 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb84c1f1b60 con 0x7fb84c159aa0 2024-09-11T00:23:22.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.910+0000 7fb843e00640 1 -- 172.21.15.40:0/1367497257 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fb844003d80 con 0x7fb84c159aa0 2024-09-11T00:23:22.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.910+0000 7fb843e00640 1 -- 172.21.15.40:0/1367497257 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb844015070 con 0x7fb84c159aa0 2024-09-11T00:23:22.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.913+0000 7fb843e00640 1 -- 172.21.15.40:0/1367497257 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fb84400f040 con 0x7fb84c159aa0 2024-09-11T00:23:22.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.913+0000 7fb843e00640 1 -- 172.21.15.40:0/1367497257 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb844011470 con 0x7fb84c159aa0 2024-09-11T00:23:22.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.921+0000 7fb851a00640 1 -- 172.21.15.40:0/1367497257 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb824005290 con 0x7fb84c159aa0 2024-09-11T00:23:22.931 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-11T00:23:22.932 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-09-11T00:23:22.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.926+0000 7fb843e00640 1 -- 172.21.15.40:0/1367497257 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fb84400a5c0 con 0x7fb84c159aa0 2024-09-11T00:23:22.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.935+0000 7f819b200640 1 -- 172.21.15.40:0/3332367755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8194073350 msgr2=0x7f8194157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:22.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.935+0000 7f819b200640 1 --2- 172.21.15.40:0/3332367755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8194073350 0x7f8194157b70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8190009be0 tx=0x7f819002a890 comp rx=0 tx=0).stop 2024-09-11T00:23:22.955 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-11T00:23:22.955 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-11T00:23:22.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.935+0000 7f819b200640 1 -- 172.21.15.40:0/3332367755 shutdown_connections 2024-09-11T00:23:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.935+0000 7f819b200640 1 --2- 172.21.15.40:0/3332367755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8194073350 0x7f8194157b70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.935+0000 7f819b200640 1 -- 172.21.15.40:0/3332367755 >> 172.21.15.40:0/3332367755 conn(0x7f81940b1500 msgr2=0x7f81940b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.935+0000 7f819b200640 1 -- 172.21.15.40:0/3332367755 shutdown_connections 2024-09-11T00:23:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.935+0000 7f819b200640 1 -- 172.21.15.40:0/3332367755 wait complete. 2024-09-11T00:23:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.938+0000 7f819b200640 1 Processor -- start 2024-09-11T00:23:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.943+0000 7f819b200640 1 -- start start 2024-09-11T00:23:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.947+0000 7f819b200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f819406cab0 0x7f81940a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.947+0000 7f819b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8194073350 0x7f8194140580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.948+0000 7f819b200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f819415e480 0x7f81940ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.951+0000 7f819b200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f819416d300 con 0x7f819415e480 2024-09-11T00:23:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.951+0000 7f819b200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f81941585f0 con 0x7f8194073350 2024-09-11T00:23:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.951+0000 7f819b200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f819416d480 con 0x7f819406cab0 2024-09-11T00:23:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.953+0000 7f8199e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f819406cab0 0x7f81940a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:22.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.953+0000 7f8199e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f819406cab0 0x7f81940a9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.40:53902/0 (socket says 172.21.15.40:53902) 2024-09-11T00:23:22.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.953+0000 7f8199e00640 1 -- 172.21.15.40:0/1980621123 learned_addr learned my addr 172.21.15.40:0/1980621123 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:22.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.953+0000 7f8199400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8194073350 0x7f8194140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:22.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.954+0000 7f819a800640 1 --2- 172.21.15.40:0/1980621123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f819415e480 0x7f81940ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:22.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.958+0000 7f819a800640 1 -- 172.21.15.40:0/1980621123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f819406cab0 msgr2=0x7f81940a9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:22.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.958+0000 7f819a800640 1 --2- 172.21.15.40:0/1980621123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f819406cab0 0x7f81940a9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:22.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.958+0000 7f819a800640 1 -- 172.21.15.40:0/1980621123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8194073350 msgr2=0x7f8194140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:22.973 DEBUG:tasks.ceph:set 18 configs 2024-09-11T00:23:22.973 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi040') 2024-09-11T00:23:22.974 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi040') 2024-09-11T00:23:22.974 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi040') 2024-09-11T00:23:22.974 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi040') 2024-09-11T00:23:22.974 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi040') 2024-09-11T00:23:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.959+0000 7f819a800640 1 --2- 172.21.15.40:0/1980621123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8194073350 0x7f8194140580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.959+0000 7f819a800640 1 -- 172.21.15.40:0/1980621123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81941fbbe0 con 0x7f819415e480 2024-09-11T00:23:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.962+0000 7f8199400640 1 --2- 172.21.15.40:0/1980621123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8194073350 0x7f8194140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:22.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.963+0000 7f819a800640 1 --2- 172.21.15.40:0/1980621123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f819415e480 0x7f81940ceb70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f81940aee40 tx=0x7f8190003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:22.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.967+0000 7f818e000640 1 -- 172.21.15.40:0/1980621123 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8190040070 con 0x7f819415e480 2024-09-11T00:23:22.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.967+0000 7f818e000640 1 -- 172.21.15.40:0/1980621123 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f8190004320 con 0x7f819415e480 2024-09-11T00:23:22.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.972+0000 7f819b200640 1 -- 172.21.15.40:0/1980621123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8194140ac0 con 0x7f819415e480 2024-09-11T00:23:22.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.972+0000 7f819b200640 1 -- 172.21.15.40:0/1980621123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81941fbe80 con 0x7f819415e480 2024-09-11T00:23:22.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.972+0000 7f818e000640 1 -- 172.21.15.40:0/1980621123 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8190031620 con 0x7f819415e480 2024-09-11T00:23:22.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.975+0000 7f818e000640 1 -- 172.21.15.40:0/1980621123 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f8190045460 con 0x7f819415e480 2024-09-11T00:23:22.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.976+0000 7f818e000640 1 -- 172.21.15.40:0/1980621123 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f819003c6c0 con 0x7f819415e480 2024-09-11T00:23:22.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.977+0000 7f8183400640 1 -- 172.21.15.40:0/1980621123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f816c005290 con 0x7f819415e480 2024-09-11T00:23:22.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:22.985+0000 7f818e000640 1 -- 172.21.15.40:0/1980621123 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f81900046d0 con 0x7f819415e480 2024-09-11T00:23:23.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.047+0000 7fb0c3c00640 1 -- 172.21.15.40:0/3412023943 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fb0bc0d2b90 con 0x7fb0bc0d2350 2024-09-11T00:23:23.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.058+0000 7fb0b8c00640 1 -- 172.21.15.40:0/3412023943 <== mon.2 v2:172.21.15.175:3301/0 9 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0a801a460 con 0x7fb0bc0d2350 2024-09-11T00:23:23.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.059+0000 7fb0b8c00640 1 -- 172.21.15.40:0/3412023943 <== mon.2 v2:172.21.15.175:3301/0 10 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fb0a801a830 con 0x7fb0bc0d2350 2024-09-11T00:23:23.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.058+0000 7f818e000640 1 -- 172.21.15.40:0/1980621123 <== mon.0 v2:172.21.15.40:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81900317c0 con 0x7f819415e480 2024-09-11T00:23:23.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.061+0000 7fb843e00640 1 -- 172.21.15.40:0/1367497257 <== mon.2 v2:172.21.15.175:3301/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb844005260 con 0x7fb84c159aa0 2024-09-11T00:23:23.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.067+0000 7fa0d6800640 1 -- 172.21.15.40:0/911369755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d00d29a0 msgr2=0x7fa0d00cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.067+0000 7fa0d6800640 1 --2- 172.21.15.40:0/911369755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d00d29a0 0x7fa0d00cfaa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8005fd0 tx=0x7fa0c802a850 comp rx=0 tx=0).stop 2024-09-11T00:23:23.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.067+0000 7fa0d6800640 1 -- 172.21.15.40:0/911369755 shutdown_connections 2024-09-11T00:23:23.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.067+0000 7fa0d6800640 1 --2- 172.21.15.40:0/911369755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d00d29a0 0x7fa0d00cfaa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.067+0000 7fa0d6800640 1 -- 172.21.15.40:0/911369755 >> 172.21.15.40:0/911369755 conn(0x7fa0d00d3f80 msgr2=0x7fa0d00d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.067+0000 7fa0d6800640 1 -- 172.21.15.40:0/911369755 shutdown_connections 2024-09-11T00:23:23.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.068+0000 7fa0d6800640 1 -- 172.21.15.40:0/911369755 wait complete. 2024-09-11T00:23:23.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.069+0000 7fb0c3c00640 1 -- 172.21.15.40:0/3412023943 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0bc0d2350 msgr2=0x7fb0bc157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.069+0000 7fb0c3c00640 1 --2- 172.21.15.40:0/3412023943 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0bc0d2350 0x7fb0bc157550 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800c510 tx=0x7fb0a800c9d0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.069+0000 7fb0c3c00640 1 -- 172.21.15.40:0/3412023943 shutdown_connections 2024-09-11T00:23:23.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.069+0000 7fb0c3c00640 1 --2- 172.21.15.40:0/3412023943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0bc0d4aa0 0x7fb0bc0cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.069+0000 7fb0c3c00640 1 --2- 172.21.15.40:0/3412023943 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0bc0d2350 0x7fb0bc157550 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.069+0000 7fb0c3c00640 1 --2- 172.21.15.40:0/3412023943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0bc0b2e50 0x7fb0bc1f4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.069+0000 7fb0c3c00640 1 -- 172.21.15.40:0/3412023943 >> 172.21.15.40:0/3412023943 conn(0x7fb0bc0d3f80 msgr2=0x7fb0bc06e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.069+0000 7fb0c3c00640 1 -- 172.21.15.40:0/3412023943 shutdown_connections 2024-09-11T00:23:23.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.070+0000 7fb0c3c00640 1 -- 172.21.15.40:0/3412023943 wait complete. 2024-09-11T00:23:23.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.082+0000 7fa0d6800640 1 Processor -- start 2024-09-11T00:23:23.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.082+0000 7fa0d6800640 1 -- start start 2024-09-11T00:23:23.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.091+0000 7fa0d6800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d00d25c0 0x7fa0d01fc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.091+0000 7fa0d6800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0d00d29a0 0x7fa0d014ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.091+0000 7fa0cf400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d00d25c0 0x7fa0d01fc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.091+0000 7fa0cf400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d00d25c0 0x7fa0d01fc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.40:56920/0 (socket says 172.21.15.40:56920) 2024-09-11T00:23:23.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.099+0000 7fa0cf400640 1 -- 172.21.15.40:0/1213619450 learned_addr learned my addr 172.21.15.40:0/1213619450 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:23.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.099+0000 7fa0cea00640 1 --2- 172.21.15.40:0/1213619450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0d00d29a0 0x7fa0d014ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.100+0000 7fa0d6800640 1 --2- 172.21.15.40:0/1213619450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0d00d4aa0 0x7fa0d0154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.100+0000 7fa0d6800640 1 -- 172.21.15.40:0/1213619450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d00b2fd0 con 0x7fa0d00d4aa0 2024-09-11T00:23:23.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.100+0000 7fa0d6800640 1 -- 172.21.15.40:0/1213619450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d00b2e50 con 0x7fa0d00d25c0 2024-09-11T00:23:23.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.100+0000 7fa0d6800640 1 -- 172.21.15.40:0/1213619450 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa0d00b3150 con 0x7fa0d00d29a0 2024-09-11T00:23:23.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.101+0000 7fa0cfe00640 1 --2- 172.21.15.40:0/1213619450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0d00d4aa0 0x7fa0d0154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.101+0000 7fa0cea00640 1 -- 172.21.15.40:0/1213619450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d00d25c0 msgr2=0x7fa0d01fc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.101+0000 7fa0cea00640 1 --2- 172.21.15.40:0/1213619450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d00d25c0 0x7fa0d01fc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.101+0000 7fa0cea00640 1 -- 172.21.15.40:0/1213619450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0d00d4aa0 msgr2=0x7fa0d0154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.104+0000 7fa0cea00640 1 --2- 172.21.15.40:0/1213619450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0d00d4aa0 0x7fa0d0154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.120+0000 7fa0cea00640 1 -- 172.21.15.40:0/1213619450 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d014fc60 con 0x7fa0d00d29a0 2024-09-11T00:23:23.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.121+0000 7fa0cfe00640 1 --2- 172.21.15.40:0/1213619450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0d00d4aa0 0x7fa0d0154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:23.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.121+0000 7fa0cea00640 1 --2- 172.21.15.40:0/1213619450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0d00d29a0 0x7fa0d014ed50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00c340 tx=0x7fa0bc00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:23.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.122+0000 7fa0c7400640 1 -- 172.21.15.40:0/1213619450 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc011790 con 0x7fa0d00d29a0 2024-09-11T00:23:23.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.122+0000 7fa0c7400640 1 -- 172.21.15.40:0/1213619450 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0bc017070 con 0x7fa0d00d29a0 2024-09-11T00:23:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.122+0000 7fa0d6800640 1 -- 172.21.15.40:0/1213619450 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0d00b7e80 con 0x7fa0d00d29a0 2024-09-11T00:23:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.123+0000 7fa0d6800640 1 -- 172.21.15.40:0/1213619450 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0d00b8140 con 0x7fa0d00d29a0 2024-09-11T00:23:23.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.124+0000 7fa0d6800640 1 -- 172.21.15.40:0/1213619450 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0d00b2430 con 0x7fa0d00d29a0 2024-09-11T00:23:23.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.125+0000 7fa0c7400640 1 -- 172.21.15.40:0/1213619450 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc011cc0 con 0x7fa0d00d29a0 2024-09-11T00:23:23.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.128+0000 7fa0c7400640 1 -- 172.21.15.40:0/1213619450 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fa0bc01c460 con 0x7fa0d00d29a0 2024-09-11T00:23:23.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.128+0000 7fa0c7400640 1 -- 172.21.15.40:0/1213619450 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa0bc012880 con 0x7fa0d00d29a0 2024-09-11T00:23:23.134 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi040') 2024-09-11T00:23:23.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.134+0000 7fa0c7400640 1 -- 172.21.15.40:0/1213619450 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fa0d014fc60 con 0x7fa0d00d29a0 2024-09-11T00:23:23.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.143+0000 7f47f8c00640 1 -- 172.21.15.40:0/468684891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47f40b4830 msgr2=0x7f47f4073e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.143+0000 7f47f8c00640 1 --2- 172.21.15.40:0/468684891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47f40b4830 0x7f47f4073e30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f47e4005fd0 tx=0x7f47e402a5f0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.143+0000 7f47f8c00640 1 -- 172.21.15.40:0/468684891 shutdown_connections 2024-09-11T00:23:23.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.143+0000 7f47f8c00640 1 --2- 172.21.15.40:0/468684891 >> v2:172.21.15.40:3300/0 conn(0x7f47f4162ef0 0x7f47f40ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.143+0000 7f47f8c00640 1 --2- 172.21.15.40:0/468684891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47f40b4830 0x7f47f4073e30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.145+0000 7f47f8c00640 1 -- 172.21.15.40:0/468684891 >> 172.21.15.40:0/468684891 conn(0x7f47f40cf8d0 msgr2=0x7f47f40cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.145+0000 7f47f8c00640 1 -- 172.21.15.40:0/468684891 shutdown_connections 2024-09-11T00:23:23.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.145+0000 7f47f8c00640 1 -- 172.21.15.40:0/468684891 wait complete. 2024-09-11T00:23:23.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.148+0000 7f47f8c00640 1 Processor -- start 2024-09-11T00:23:23.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.148+0000 7f47f8c00640 1 -- start start 2024-09-11T00:23:23.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.161+0000 7f47f8c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47f406f950 0x7f47f4151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.161+0000 7f47f8c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47f40b4830 0x7f47f415f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.161+0000 7f47f8c00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47f4162ef0 0x7f47f4161230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.161+0000 7f47f8c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f47f40aeb60 con 0x7f47f40b4830 2024-09-11T00:23:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.161+0000 7f47f8c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f47f40ae9e0 con 0x7f47f406f950 2024-09-11T00:23:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.161+0000 7f47f8c00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f47f40aece0 con 0x7f47f4162ef0 2024-09-11T00:23:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.162+0000 7f47f3e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47f4162ef0 0x7f47f4161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.162+0000 7f47f3e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47f4162ef0 0x7f47f4161230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.40:53926/0 (socket says 172.21.15.40:53926) 2024-09-11T00:23:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.162+0000 7f47f3e00640 1 -- 172.21.15.40:0/1059835846 learned_addr learned my addr 172.21.15.40:0/1059835846 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.163+0000 7f47f2a00640 1 --2- 172.21.15.40:0/1059835846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47f40b4830 0x7f47f415f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.164+0000 7f47f2a00640 1 -- 172.21.15.40:0/1059835846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47f4162ef0 msgr2=0x7f47f4161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.164+0000 7f47f2a00640 1 --2- 172.21.15.40:0/1059835846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47f4162ef0 0x7f47f4161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.164+0000 7f47f2a00640 1 -- 172.21.15.40:0/1059835846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47f406f950 msgr2=0x7f47f4151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.164+0000 7f47f2a00640 1 --2- 172.21.15.40:0/1059835846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47f406f950 0x7f47f4151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.164+0000 7f47f2a00640 1 -- 172.21.15.40:0/1059835846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f4160190 con 0x7f47f40b4830 2024-09-11T00:23:23.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.165+0000 7f47f2a00640 1 --2- 172.21.15.40:0/1059835846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47f40b4830 0x7f47f415f7d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f47e4031000 tx=0x7f47e40326c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:23.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.170+0000 7f47eb400640 1 -- 172.21.15.40:0/1059835846 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e403f070 con 0x7f47f40b4830 2024-09-11T00:23:23.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.170+0000 7f47f8c00640 1 -- 172.21.15.40:0/1059835846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f4160470 con 0x7f47f40b4830 2024-09-11T00:23:23.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.170+0000 7f47f8c00640 1 -- 172.21.15.40:0/1059835846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f4160a30 con 0x7f47f40b4830 2024-09-11T00:23:23.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.170+0000 7f47eb400640 1 -- 172.21.15.40:0/1059835846 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47e4004460 con 0x7f47f40b4830 2024-09-11T00:23:23.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.172+0000 7f47eb400640 1 -- 172.21.15.40:0/1059835846 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e403f070 con 0x7f47f40b4830 2024-09-11T00:23:23.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.172+0000 7f47f8c00640 1 -- 172.21.15.40:0/1059835846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47cc005290 con 0x7f47f40b4830 2024-09-11T00:23:23.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.173+0000 7f47eb400640 1 -- 172.21.15.40:0/1059835846 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f47e40328b0 con 0x7f47f40b4830 2024-09-11T00:23:23.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.173+0000 7f47eb400640 1 -- 172.21.15.40:0/1059835846 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f47e4003c50 con 0x7f47f40b4830 2024-09-11T00:23:23.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.181+0000 7f47eb400640 1 -- 172.21.15.40:0/1059835846 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f47e4049030 con 0x7f47f40b4830 2024-09-11T00:23:23.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.183+0000 7fb851a00640 1 -- 172.21.15.40:0/1367497257 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fb824005580 con 0x7fb84c159aa0 2024-09-11T00:23:23.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.201+0000 7fb843e00640 1 -- 172.21.15.40:0/1367497257 <== mon.2 v2:172.21.15.175:3301/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7fb844005430 con 0x7fb84c159aa0 2024-09-11T00:23:23.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.202+0000 7fb851a00640 1 -- 172.21.15.40:0/1367497257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb84c159aa0 msgr2=0x7fb84c1555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.203+0000 7fb851a00640 1 --2- 172.21.15.40:0/1367497257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb84c159aa0 0x7fb84c1555b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb84400e990 tx=0x7fb84400ee50 comp rx=0 tx=0).stop 2024-09-11T00:23:23.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.203+0000 7fb851a00640 1 -- 172.21.15.40:0/1367497257 shutdown_connections 2024-09-11T00:23:23.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.203+0000 7fb851a00640 1 --2- 172.21.15.40:0/1367497257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb84c159aa0 0x7fb84c1555b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.203+0000 7fb851a00640 1 --2- 172.21.15.40:0/1367497257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb84c0b3750 0x7fb84c149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.205+0000 7fb851a00640 1 --2- 172.21.15.40:0/1367497257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb84c072880 0x7fb84c1f0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.205+0000 7fb851a00640 1 -- 172.21.15.40:0/1367497257 >> 172.21.15.40:0/1367497257 conn(0x7fb84c0cf8d0 msgr2=0x7fb84c1588f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.208+0000 7fdfa6800640 1 -- 172.21.15.40:0/3654785001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfa00d4aa0 msgr2=0x7fdfa00d0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.208+0000 7fdfa6800640 1 --2- 172.21.15.40:0/3654785001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfa00d4aa0 0x7fdfa00d0950 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdf90013f30 tx=0x7fdf900329c0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.209+0000 7fb851a00640 1 -- 172.21.15.40:0/1367497257 shutdown_connections 2024-09-11T00:23:23.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.209+0000 7fb851a00640 1 -- 172.21.15.40:0/1367497257 wait complete. 2024-09-11T00:23:23.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.208+0000 7fdfa6800640 1 -- 172.21.15.40:0/3654785001 shutdown_connections 2024-09-11T00:23:23.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.208+0000 7fdfa6800640 1 --2- 172.21.15.40:0/3654785001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfa00d4aa0 0x7fdfa00d0950 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.208+0000 7fdfa6800640 1 --2- 172.21.15.40:0/3654785001 >> v2:172.21.15.175:3300/0 conn(0x7fdfa00d2350 0x7fdfa00d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.208+0000 7fdfa6800640 1 -- 172.21.15.40:0/3654785001 >> 172.21.15.40:0/3654785001 conn(0x7fdfa00d3f80 msgr2=0x7fdfa00d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.212+0000 7fdfa6800640 1 -- 172.21.15.40:0/3654785001 shutdown_connections 2024-09-11T00:23:23.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.212+0000 7fdfa6800640 1 -- 172.21.15.40:0/3654785001 wait complete. 2024-09-11T00:23:23.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.215+0000 7fdfa6800640 1 Processor -- start 2024-09-11T00:23:23.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.220+0000 7fdfa6800640 1 -- start start 2024-09-11T00:23:23.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.226+0000 7fdfa6800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa00b2e50 0x7fdfa00cb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.226+0000 7fdfa6800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfa00d2350 0x7fdfa00b88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.226+0000 7fdfa6800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfa00d4aa0 0x7fdfa00cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.226+0000 7fdfa6800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa00b3670 con 0x7fdfa00d2350 2024-09-11T00:23:23.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.226+0000 7fdfa6800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa00b34f0 con 0x7fdfa00b2e50 2024-09-11T00:23:23.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.226+0000 7fdfa6800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa015e0d0 con 0x7fdfa00d4aa0 2024-09-11T00:23:23.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.227+0000 7fdf9f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa00b2e50 0x7fdfa00cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.227+0000 7fdf9f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa00b2e50 0x7fdfa00cb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.40:56932/0 (socket says 172.21.15.40:56932) 2024-09-11T00:23:23.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.227+0000 7fdf9f400640 1 -- 172.21.15.40:0/4224881739 learned_addr learned my addr 172.21.15.40:0/4224881739 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:23.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.230+0000 7fdf9fe00640 1 --2- 172.21.15.40:0/4224881739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfa00d4aa0 0x7fdfa00cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.230+0000 7fdf9ea00640 1 --2- 172.21.15.40:0/4224881739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfa00d2350 0x7fdfa00b88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.230+0000 7fdf9fe00640 1 -- 172.21.15.40:0/4224881739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa00b2e50 msgr2=0x7fdfa00cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.230+0000 7fdf9fe00640 1 --2- 172.21.15.40:0/4224881739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa00b2e50 0x7fdfa00cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.230+0000 7fdf9fe00640 1 -- 172.21.15.40:0/4224881739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfa00d2350 msgr2=0x7fdfa00b88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.230+0000 7fdf9fe00640 1 --2- 172.21.15.40:0/4224881739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfa00d2350 0x7fdfa00b88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.230+0000 7fdf9fe00640 1 -- 172.21.15.40:0/4224881739 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa01f44d0 con 0x7fdfa00d4aa0 2024-09-11T00:23:23.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.231+0000 7fdf9fe00640 1 --2- 172.21.15.40:0/4224881739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfa00d4aa0 0x7fdfa00cd550 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800caa0 tx=0x7fdf9800cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:23.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.235+0000 7fdf97400640 1 -- 172.21.15.40:0/4224881739 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf98016020 con 0x7fdfa00d4aa0 2024-09-11T00:23:23.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.235+0000 7fdf97400640 1 -- 172.21.15.40:0/4224881739 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf9800acf0 con 0x7fdfa00d4aa0 2024-09-11T00:23:23.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.235+0000 7fdf97400640 1 -- 172.21.15.40:0/4224881739 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf98012680 con 0x7fdfa00d4aa0 2024-09-11T00:23:23.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.232+0000 7f8183400640 1 -- 172.21.15.40:0/1980621123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f816c005850 con 0x7f819415e480 2024-09-11T00:23:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.235+0000 7fdfa6800640 1 -- 172.21.15.40:0/4224881739 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa01f47b0 con 0x7fdfa00d4aa0 2024-09-11T00:23:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.235+0000 7fdfa6800640 1 -- 172.21.15.40:0/4224881739 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa00cbbe0 con 0x7fdfa00d4aa0 2024-09-11T00:23:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.239+0000 7fdf97400640 1 -- 172.21.15.40:0/4224881739 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fdf98012bb0 con 0x7fdfa00d4aa0 2024-09-11T00:23:23.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.239+0000 7fdf97400640 1 -- 172.21.15.40:0/4224881739 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdf9801b400 con 0x7fdfa00d4aa0 2024-09-11T00:23:23.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.243+0000 7fdfa6800640 1 -- 172.21.15.40:0/4224881739 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa00d16a0 con 0x7fdfa00d4aa0 2024-09-11T00:23:23.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.245+0000 7f818e000640 1 -- 172.21.15.40:0/1980621123 <== mon.0 v2:172.21.15.40:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f819003c8c0 con 0x7f819415e480 2024-09-11T00:23:23.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.251+0000 7f8183400640 1 -- 172.21.15.40:0/1980621123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f819415e480 msgr2=0x7f81940ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.251+0000 7f8183400640 1 --2- 172.21.15.40:0/1980621123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f819415e480 0x7f81940ceb70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f81940aee40 tx=0x7f8190003f10 comp rx=0 tx=0).stop 2024-09-11T00:23:23.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.251+0000 7fdf97400640 1 -- 172.21.15.40:0/4224881739 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fdf98020030 con 0x7fdfa00d4aa0 2024-09-11T00:23:23.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.252+0000 7f8183400640 1 -- 172.21.15.40:0/1980621123 shutdown_connections 2024-09-11T00:23:23.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.252+0000 7f8183400640 1 --2- 172.21.15.40:0/1980621123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f819415e480 0x7f81940ceb70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.252+0000 7f8183400640 1 --2- 172.21.15.40:0/1980621123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8194073350 0x7f8194140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.252+0000 7f8183400640 1 --2- 172.21.15.40:0/1980621123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f819406cab0 0x7f81940a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.252+0000 7f8183400640 1 -- 172.21.15.40:0/1980621123 >> 172.21.15.40:0/1980621123 conn(0x7f81940b1500 msgr2=0x7f819415e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.261+0000 7f8183400640 1 -- 172.21.15.40:0/1980621123 shutdown_connections 2024-09-11T00:23:23.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.261+0000 7f8183400640 1 -- 172.21.15.40:0/1980621123 wait complete. 2024-09-11T00:23:23.280 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi040') 2024-09-11T00:23:23.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.290+0000 7f26f7c00640 1 -- 172.21.15.40:0/3993013656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26f006de30 msgr2=0x7f26f006e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.290+0000 7f26f7c00640 1 --2- 172.21.15.40:0/3993013656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26f006de30 0x7f26f006e210 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f26e8005fd0 tx=0x7f26e802a770 comp rx=0 tx=0).stop 2024-09-11T00:23:23.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.291+0000 7f26f7c00640 1 -- 172.21.15.40:0/3993013656 shutdown_connections 2024-09-11T00:23:23.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.291+0000 7f26f7c00640 1 --2- 172.21.15.40:0/3993013656 >> v2:172.21.15.175:3300/0 conn(0x7f26f0070b50 0x7f26f0071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.291+0000 7f26f7c00640 1 --2- 172.21.15.40:0/3993013656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26f006de30 0x7f26f006e210 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.292+0000 7f26f7c00640 1 -- 172.21.15.40:0/3993013656 >> 172.21.15.40:0/3993013656 conn(0x7f26f00d1d50 msgr2=0x7f26f00d2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.292+0000 7f26f7c00640 1 -- 172.21.15.40:0/3993013656 shutdown_connections 2024-09-11T00:23:23.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.292+0000 7f26f7c00640 1 -- 172.21.15.40:0/3993013656 wait complete. 2024-09-11T00:23:23.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.297+0000 7f26f7c00640 1 Processor -- start 2024-09-11T00:23:23.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.298+0000 7f26f7c00640 1 -- start start 2024-09-11T00:23:23.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.301+0000 7f26f7c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26f006de30 0x7f26f0155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.301+0000 7f26f7c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26f0070b50 0x7f26f01fcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.301+0000 7f26f5200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26f006de30 0x7f26f0155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.301+0000 7f26f5200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26f006de30 0x7f26f0155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.40:56944/0 (socket says 172.21.15.40:56944) 2024-09-11T00:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.302+0000 7f26efe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26f0070b50 0x7f26f01fcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.303+0000 7f26efe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26f0070b50 0x7f26f01fcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60426/0 (socket says 172.21.15.40:60426) 2024-09-11T00:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.303+0000 7f26f5200640 1 -- 172.21.15.40:0/3145370422 learned_addr learned my addr 172.21.15.40:0/3145370422 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.303+0000 7f26f7c00640 1 --2- 172.21.15.40:0/3145370422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26f00d1140 0x7f26f00b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.303+0000 7f26f7c00640 1 -- 172.21.15.40:0/3145370422 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f26f00d0ef0 con 0x7f26f0070b50 2024-09-11T00:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.304+0000 7f26f7c00640 1 -- 172.21.15.40:0/3145370422 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f26f00d0d70 con 0x7f26f006de30 2024-09-11T00:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.304+0000 7f26f5c00640 1 --2- 172.21.15.40:0/3145370422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26f00d1140 0x7f26f00b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.304+0000 7f26f7c00640 1 -- 172.21.15.40:0/3145370422 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f26f015c9b0 con 0x7f26f00d1140 2024-09-11T00:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.309+0000 7f26efe00640 1 -- 172.21.15.40:0/3145370422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26f00d1140 msgr2=0x7f26f00b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.309+0000 7f26efe00640 1 --2- 172.21.15.40:0/3145370422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26f00d1140 0x7f26f00b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.309+0000 7f26efe00640 1 -- 172.21.15.40:0/3145370422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26f006de30 msgr2=0x7f26f0155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.309+0000 7f26efe00640 1 --2- 172.21.15.40:0/3145370422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26f006de30 0x7f26f0155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.309+0000 7f26efe00640 1 -- 172.21.15.40:0/3145370422 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f00cd4e0 con 0x7f26f0070b50 2024-09-11T00:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.310+0000 7f26efe00640 1 --2- 172.21.15.40:0/3145370422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26f0070b50 0x7f26f01fcbc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f26f00720f0 tx=0x7f26e000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.311+0000 7f26ecc00640 1 -- 172.21.15.40:0/3145370422 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e0015020 con 0x7f26f0070b50 2024-09-11T00:23:23.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.315+0000 7f26ecc00640 1 -- 172.21.15.40:0/3145370422 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26e0011920 con 0x7f26f0070b50 2024-09-11T00:23:23.324 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi040') 2024-09-11T00:23:23.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.315+0000 7f26f7c00640 1 -- 172.21.15.40:0/3145370422 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f00cd7c0 con 0x7f26f0070b50 2024-09-11T00:23:23.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.316+0000 7f26ecc00640 1 -- 172.21.15.40:0/3145370422 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e0011d50 con 0x7f26f0070b50 2024-09-11T00:23:23.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.318+0000 7f26f7c00640 1 -- 172.21.15.40:0/3145370422 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f01566c0 con 0x7f26f0070b50 2024-09-11T00:23:23.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.319+0000 7f26ecc00640 1 -- 172.21.15.40:0/3145370422 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f26e001a790 con 0x7f26f0070b50 2024-09-11T00:23:23.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.319+0000 7f26ecc00640 1 -- 172.21.15.40:0/3145370422 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f26e0019c50 con 0x7f26f0070b50 2024-09-11T00:23:23.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.327+0000 7f26f7c00640 1 -- 172.21.15.40:0/3145370422 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f0162250 con 0x7f26f0070b50 2024-09-11T00:23:23.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.335+0000 7f26ecc00640 1 -- 172.21.15.40:0/3145370422 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f26e001f030 con 0x7f26f0070b50 2024-09-11T00:23:23.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.335+0000 7fd6dac00640 1 -- 172.21.15.40:0/2011393174 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6d4157f80 msgr2=0x7fd6d4073f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.335+0000 7fd6dac00640 1 --2- 172.21.15.40:0/2011393174 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6d4157f80 0x7fd6d4073f20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd6d415e170 tx=0x7fd6c802a5a0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.339+0000 7fd6dac00640 1 -- 172.21.15.40:0/2011393174 shutdown_connections 2024-09-11T00:23:23.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.339+0000 7fd6dac00640 1 --2- 172.21.15.40:0/2011393174 >> v2:172.21.15.175:3300/0 conn(0x7fd6d4158360 0x7fd6d406cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.339+0000 7fd6dac00640 1 --2- 172.21.15.40:0/2011393174 >> v2:172.21.15.40:3300/0 conn(0x7fd6d4072340 0x7fd6d406cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.339+0000 7fd6dac00640 1 --2- 172.21.15.40:0/2011393174 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6d4157f80 0x7fd6d4073f20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.339+0000 7fd6dac00640 1 -- 172.21.15.40:0/2011393174 >> 172.21.15.40:0/2011393174 conn(0x7fd6d40b1500 msgr2=0x7fd6d40b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.351+0000 7fd6dac00640 1 -- 172.21.15.40:0/2011393174 shutdown_connections 2024-09-11T00:23:23.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.351+0000 7fd6dac00640 1 -- 172.21.15.40:0/2011393174 wait complete. 2024-09-11T00:23:23.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.355+0000 7fd6dac00640 1 Processor -- start 2024-09-11T00:23:23.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.356+0000 7fd6dac00640 1 -- start start 2024-09-11T00:23:23.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.361+0000 7fd6dac00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d4072340 0x7fd6d40cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.361+0000 7fd6dac00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6d4157f80 0x7fd6d40ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.361+0000 7fd6dac00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6d4158360 0x7fd6d41f8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.361+0000 7fd6dac00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d4161af0 con 0x7fd6d4072340 2024-09-11T00:23:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.361+0000 7fd6dac00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d4161970 con 0x7fd6d4157f80 2024-09-11T00:23:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.361+0000 7fd6dac00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d4161c70 con 0x7fd6d4158360 2024-09-11T00:23:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.362+0000 7fd6d8e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6d4157f80 0x7fd6d40ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.362+0000 7fd6d8e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6d4157f80 0x7fd6d40ccd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.40:56966/0 (socket says 172.21.15.40:56966) 2024-09-11T00:23:23.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.362+0000 7fd6d8e00640 1 -- 172.21.15.40:0/1600105772 learned_addr learned my addr 172.21.15.40:0/1600105772 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:23.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.362+0000 7fd6da200640 1 --2- 172.21.15.40:0/1600105772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6d4158360 0x7fd6d41f8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.362+0000 7fd6d9800640 1 --2- 172.21.15.40:0/1600105772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d4072340 0x7fd6d40cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.363+0000 7f47f8c00640 1 -- 172.21.15.40:0/1059835846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f47cc005580 con 0x7f47f40b4830 2024-09-11T00:23:23.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.363+0000 7fd6d8e00640 1 -- 172.21.15.40:0/1600105772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6d4158360 msgr2=0x7fd6d41f8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.363+0000 7fd6d8e00640 1 --2- 172.21.15.40:0/1600105772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6d4158360 0x7fd6d41f8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.363+0000 7fd6d8e00640 1 -- 172.21.15.40:0/1600105772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d4072340 msgr2=0x7fd6d40cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.363+0000 7fd6d8e00640 1 --2- 172.21.15.40:0/1600105772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d4072340 0x7fd6d40cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.363+0000 7fd6d8e00640 1 -- 172.21.15.40:0/1600105772 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d40cd260 con 0x7fd6d4157f80 2024-09-11T00:23:23.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.364+0000 7fd6d8e00640 1 --2- 172.21.15.40:0/1600105772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6d4157f80 0x7fd6d40ccd20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000b450 tx=0x7fd6c000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:23.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.366+0000 7fd6d1600640 1 -- 172.21.15.40:0/1600105772 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0015020 con 0x7fd6d4157f80 2024-09-11T00:23:23.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.366+0000 7fd6d1600640 1 -- 172.21.15.40:0/1600105772 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6c0011980 con 0x7fd6d4157f80 2024-09-11T00:23:23.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.366+0000 7fd6d1600640 1 -- 172.21.15.40:0/1600105772 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0011dd0 con 0x7fd6d4157f80 2024-09-11T00:23:23.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.369+0000 7f47eb400640 1 -- 172.21.15.40:0/1059835846 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v9)=0 v9) ==== 115+0+0 (secure 0 0 0) 0x7f47e4032db0 con 0x7f47f40b4830 2024-09-11T00:23:23.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.370+0000 7fd6dac00640 1 -- 172.21.15.40:0/1600105772 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d40cd4e0 con 0x7fd6d4157f80 2024-09-11T00:23:23.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.370+0000 7fd6dac00640 1 -- 172.21.15.40:0/1600105772 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d41f7d30 con 0x7fd6d4157f80 2024-09-11T00:23:23.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.373+0000 7fd6d1600640 1 -- 172.21.15.40:0/1600105772 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fd6c0022060 con 0x7fd6d4157f80 2024-09-11T00:23:23.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.373+0000 7fd6d1600640 1 -- 172.21.15.40:0/1600105772 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd6c0010aa0 con 0x7fd6d4157f80 2024-09-11T00:23:23.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.373+0000 7fd6c6a00640 1 -- 172.21.15.40:0/1600105772 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a8005290 con 0x7fd6d4157f80 2024-09-11T00:23:23.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.377+0000 7fa0d6800640 1 -- 172.21.15.40:0/1213619450 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fa0d0076110 con 0x7fa0d00d29a0 2024-09-11T00:23:23.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.377+0000 7f47f8c00640 1 -- 172.21.15.40:0/1059835846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47f40b4830 msgr2=0x7f47f415f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.377+0000 7f47f8c00640 1 --2- 172.21.15.40:0/1059835846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47f40b4830 0x7f47f415f7d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f47e4031000 tx=0x7f47e40326c0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.379+0000 7fd6d1600640 1 -- 172.21.15.40:0/1600105772 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fd6d40cd260 con 0x7fd6d4157f80 2024-09-11T00:23:23.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.378+0000 7f47f8c00640 1 -- 172.21.15.40:0/1059835846 shutdown_connections 2024-09-11T00:23:23.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.378+0000 7f47f8c00640 1 --2- 172.21.15.40:0/1059835846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47f4162ef0 0x7f47f4161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.378+0000 7f47f8c00640 1 --2- 172.21.15.40:0/1059835846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47f40b4830 0x7f47f415f7d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.378+0000 7f47f8c00640 1 --2- 172.21.15.40:0/1059835846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47f406f950 0x7f47f4151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.378+0000 7f47f8c00640 1 -- 172.21.15.40:0/1059835846 >> 172.21.15.40:0/1059835846 conn(0x7f47f40cf8d0 msgr2=0x7f47f415afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.378+0000 7f47f8c00640 1 -- 172.21.15.40:0/1059835846 shutdown_connections 2024-09-11T00:23:23.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.380+0000 7f47f8c00640 1 -- 172.21.15.40:0/1059835846 wait complete. 2024-09-11T00:23:23.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.383+0000 7f568a600640 1 -- 172.21.15.40:0/1270908805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f568406fe40 msgr2=0x7f568415bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.383+0000 7f568a600640 1 --2- 172.21.15.40:0/1270908805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f568406fe40 0x7f568415bee0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f567c005fd0 tx=0x7f567c02a7a0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.386+0000 7f568a600640 1 -- 172.21.15.40:0/1270908805 shutdown_connections 2024-09-11T00:23:23.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.386+0000 7f568a600640 1 --2- 172.21.15.40:0/1270908805 >> v2:172.21.15.40:3300/0 conn(0x7f5684073ec0 0x7f56840742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.386+0000 7f568a600640 1 --2- 172.21.15.40:0/1270908805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f568406fe40 0x7f568415bee0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.386+0000 7f568a600640 1 -- 172.21.15.40:0/1270908805 >> 172.21.15.40:0/1270908805 conn(0x7f56840b1500 msgr2=0x7f56840b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.386+0000 7f568a600640 1 -- 172.21.15.40:0/1270908805 shutdown_connections 2024-09-11T00:23:23.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.386+0000 7f568a600640 1 -- 172.21.15.40:0/1270908805 wait complete. 2024-09-11T00:23:23.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.389+0000 7fa0c7400640 1 -- 172.21.15.40:0/1213619450 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v10)=0 v10) ==== 106+0+0 (secure 0 0 0) 0x7fa0bc012420 con 0x7fa0d00d29a0 2024-09-11T00:23:23.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.390+0000 7fa0d6800640 1 -- 172.21.15.40:0/1213619450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0d00d29a0 msgr2=0x7fa0d014ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.390+0000 7fa0d6800640 1 --2- 172.21.15.40:0/1213619450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0d00d29a0 0x7fa0d014ed50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00c340 tx=0x7fa0bc00c800 comp rx=0 tx=0).stop 2024-09-11T00:23:23.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.391+0000 7fa0d6800640 1 -- 172.21.15.40:0/1213619450 shutdown_connections 2024-09-11T00:23:23.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.391+0000 7fa0d6800640 1 --2- 172.21.15.40:0/1213619450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0d00d4aa0 0x7fa0d0154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.391+0000 7fa0d6800640 1 --2- 172.21.15.40:0/1213619450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0d00d29a0 0x7fa0d014ed50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.391+0000 7fa0d6800640 1 --2- 172.21.15.40:0/1213619450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d00d25c0 0x7fa0d01fc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.391+0000 7fa0d6800640 1 -- 172.21.15.40:0/1213619450 >> 172.21.15.40:0/1213619450 conn(0x7fa0d00d3f80 msgr2=0x7fa0d01535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.392+0000 7fa0d6800640 1 -- 172.21.15.40:0/1213619450 shutdown_connections 2024-09-11T00:23:23.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.389+0000 7f568a600640 1 Processor -- start 2024-09-11T00:23:23.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.393+0000 7f568a600640 1 -- start start 2024-09-11T00:23:23.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.394+0000 7fa0d6800640 1 -- 172.21.15.40:0/1213619450 wait complete. 2024-09-11T00:23:23.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.396+0000 7f568a600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f568406cab0 0x7f56841f07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.397+0000 7f568a600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f568406fe40 0x7f5684152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.397+0000 7f5689200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f568406cab0 0x7f56841f07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.397+0000 7f5689200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f568406cab0 0x7f56841f07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.40:56968/0 (socket says 172.21.15.40:56968) 2024-09-11T00:23:23.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.397+0000 7f5689200640 1 -- 172.21.15.40:0/3374381896 learned_addr learned my addr 172.21.15.40:0/3374381896 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:23.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.397+0000 7f568a600640 1 --2- 172.21.15.40:0/3374381896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5684073ec0 0x7f5684150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.398+0000 7f5683e00640 1 --2- 172.21.15.40:0/3374381896 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f568406fe40 0x7f5684152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.398+0000 7f568a600640 1 -- 172.21.15.40:0/3374381896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f568406d2d0 con 0x7f5684073ec0 2024-09-11T00:23:23.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.398+0000 7f568a600640 1 -- 172.21.15.40:0/3374381896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f568406d150 con 0x7f568406cab0 2024-09-11T00:23:23.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.399+0000 7f568a600640 1 -- 172.21.15.40:0/3374381896 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f56841538a0 con 0x7f568406fe40 2024-09-11T00:23:23.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.399+0000 7f5689c00640 1 --2- 172.21.15.40:0/3374381896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5684073ec0 0x7f5684150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.401+0000 7f5689c00640 1 -- 172.21.15.40:0/3374381896 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f568406fe40 msgr2=0x7f5684152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.401+0000 7f5689c00640 1 --2- 172.21.15.40:0/3374381896 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f568406fe40 0x7f5684152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.401+0000 7f5689c00640 1 -- 172.21.15.40:0/3374381896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f568406cab0 msgr2=0x7f56841f07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.401+0000 7f5689c00640 1 --2- 172.21.15.40:0/3374381896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f568406cab0 0x7f56841f07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.401+0000 7f5689c00640 1 -- 172.21.15.40:0/3374381896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5684153b80 con 0x7f5684073ec0 2024-09-11T00:23:23.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.402+0000 7f5689200640 1 --2- 172.21.15.40:0/3374381896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f568406cab0 0x7f56841f07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:23.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.402+0000 7f5689c00640 1 --2- 172.21.15.40:0/3374381896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5684073ec0 0x7f5684150f40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f567400c520 tx=0x7f567400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:23.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.403+0000 7f5680c00640 1 -- 172.21.15.40:0/3374381896 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5674012620 con 0x7f5684073ec0 2024-09-11T00:23:23.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.403+0000 7f5680c00640 1 -- 172.21.15.40:0/3374381896 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5674017070 con 0x7f5684073ec0 2024-09-11T00:23:23.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.404+0000 7f568a600640 1 -- 172.21.15.40:0/3374381896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5684153e60 con 0x7f5684073ec0 2024-09-11T00:23:23.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.404+0000 7f568a600640 1 -- 172.21.15.40:0/3374381896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56841efe00 con 0x7f5684073ec0 2024-09-11T00:23:23.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.404+0000 7f5680c00640 1 -- 172.21.15.40:0/3374381896 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5674012b30 con 0x7f5684073ec0 2024-09-11T00:23:23.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.405+0000 7f5680c00640 1 -- 172.21.15.40:0/3374381896 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f567401c460 con 0x7f5684073ec0 2024-09-11T00:23:23.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.405+0000 7f5680c00640 1 -- 172.21.15.40:0/3374381896 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f567401b820 con 0x7f5684073ec0 2024-09-11T00:23:23.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.406+0000 7f568a600640 1 -- 172.21.15.40:0/3374381896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f565c005290 con 0x7f5684073ec0 2024-09-11T00:23:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.410+0000 7f5680c00640 1 -- 172.21.15.40:0/3374381896 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f5674012cd0 con 0x7f5684073ec0 2024-09-11T00:23:23.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.422+0000 7fc12be00640 1 -- 172.21.15.40:0/833956551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1100053c0 msgr2=0x7fc11000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.423+0000 7fc129600640 1 -- 172.21.15.40:0/833956551 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12400c260 con 0x7fc1100053c0 2024-09-11T00:23:23.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.423+0000 7fc12be00640 1 --2- 172.21.15.40:0/833956551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1100053c0 0x7fc11000b9c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc12400c640 tx=0x7fc110005830 comp rx=0 tx=0).stop 2024-09-11T00:23:23.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.423+0000 7fc12be00640 1 -- 172.21.15.40:0/833956551 shutdown_connections 2024-09-11T00:23:23.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.424+0000 7fc12be00640 1 --2- 172.21.15.40:0/833956551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1100053c0 0x7fc11000b9c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.424+0000 7fc12be00640 1 -- 172.21.15.40:0/833956551 >> 172.21.15.40:0/833956551 conn(0x7fc12c0d3c10 msgr2=0x7fc12c0d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.423+0000 7f5e89200640 1 -- 172.21.15.40:0/2588917676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e68003be0 msgr2=0x7f5e68003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.423+0000 7f5e89200640 1 --2- 172.21.15.40:0/2588917676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e68003be0 0x7f5e68003fc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5e74003ec0 tx=0x7f5e68005830 comp rx=0 tx=0).stop 2024-09-11T00:23:23.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.425+0000 7f5e83e00640 1 -- 172.21.15.40:0/2588917676 reap_dead start 2024-09-11T00:23:23.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.425+0000 7f5e89200640 1 -- 172.21.15.40:0/2588917676 shutdown_connections 2024-09-11T00:23:23.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.425+0000 7f5e89200640 1 -- 172.21.15.40:0/2588917676 >> 172.21.15.40:0/2588917676 conn(0x7f5e840d3c10 msgr2=0x7f5e840d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.425+0000 7f5e89200640 1 -- 172.21.15.40:0/2588917676 shutdown_connections 2024-09-11T00:23:23.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.426+0000 7f5e89200640 1 -- 172.21.15.40:0/2588917676 wait complete. 2024-09-11T00:23:23.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.424+0000 7fe4c1600640 1 -- 172.21.15.40:0/3941246598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4bc159aa0 msgr2=0x7fe4bc0b3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.424+0000 7fe4c1600640 1 --2- 172.21.15.40:0/3941246598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4bc159aa0 0x7fe4bc0b3210 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0b49e0 tx=0x7fe4b402aa50 comp rx=0 tx=0).stop 2024-09-11T00:23:23.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.425+0000 7fe4c1600640 1 -- 172.21.15.40:0/3941246598 shutdown_connections 2024-09-11T00:23:23.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.425+0000 7fe4c1600640 1 --2- 172.21.15.40:0/3941246598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4bc072880 0x7fe4bc15d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.425+0000 7fe4c1600640 1 --2- 172.21.15.40:0/3941246598 >> v2:172.21.15.40:3300/0 conn(0x7fe4bc0b3750 0x7fe4bc072340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.425+0000 7fe4c1600640 1 --2- 172.21.15.40:0/3941246598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4bc159aa0 0x7fe4bc0b3210 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.425+0000 7fe4c1600640 1 -- 172.21.15.40:0/3941246598 >> 172.21.15.40:0/3941246598 conn(0x7fe4bc0cf8d0 msgr2=0x7fe4bc0cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.426+0000 7fe4c1600640 1 -- 172.21.15.40:0/3941246598 shutdown_connections 2024-09-11T00:23:23.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.426+0000 7fe4c1600640 1 -- 172.21.15.40:0/3941246598 wait complete. 2024-09-11T00:23:23.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.429+0000 7f5e89200640 1 Processor -- start 2024-09-11T00:23:23.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.430+0000 7f5e89200640 1 -- start start 2024-09-11T00:23:23.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.430+0000 7fe4c1600640 1 Processor -- start 2024-09-11T00:23:23.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.431+0000 7fe4c1600640 1 -- start start 2024-09-11T00:23:23.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.432+0000 7f5e89200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e841f7fb0 0x7f5e841583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.432+0000 7f5e89200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e841f8390 0x7f5e840c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.432+0000 7f5e89200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e840c7b90 0x7f5e84156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.432+0000 7f5e89200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5e84160c20 con 0x7f5e840c7b90 2024-09-11T00:23:23.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.432+0000 7f19b3200640 1 -- 172.21.15.40:0/1237859266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1998004d90 msgr2=0x7f1998005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.432+0000 7f19b3200640 1 --2- 172.21.15.40:0/1237859266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1998004d90 0x7f1998005210 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f19ac005fd0 tx=0x7f1998005830 comp rx=0 tx=0).stop 2024-09-11T00:23:23.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.432+0000 7f5e89200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5e84160aa0 con 0x7f5e841f7fb0 2024-09-11T00:23:23.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.433+0000 7f5e89200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5e84160da0 con 0x7f5e841f8390 2024-09-11T00:23:23.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.433+0000 7f5e83400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e841f7fb0 0x7f5e841583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.432+0000 7f19b2800640 1 -- 172.21.15.40:0/1237859266 reap_dead start 2024-09-11T00:23:23.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.433+0000 7f5e82a00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e841f8390 0x7f5e840c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.431+0000 7fc12be00640 1 -- 172.21.15.40:0/833956551 shutdown_connections 2024-09-11T00:23:23.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.433+0000 7fe4c1600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4bc072880 0x7fe4bc14a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.433+0000 7f5e83400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e841f7fb0 0x7f5e841583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.40:57010/0 (socket says 172.21.15.40:57010) 2024-09-11T00:23:23.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.433+0000 7f5e83400640 1 -- 172.21.15.40:0/808134195 learned_addr learned my addr 172.21.15.40:0/808134195 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:23.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.434+0000 7fe4c1600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4bc0b3750 0x7fe4bc14bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.434+0000 7f19b3200640 1 -- 172.21.15.40:0/1237859266 shutdown_connections 2024-09-11T00:23:23.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.434+0000 7f19b3200640 1 -- 172.21.15.40:0/1237859266 >> 172.21.15.40:0/1237859266 conn(0x7f19b40b1500 msgr2=0x7f19b40b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.434+0000 7f5e83e00640 1 --2- 172.21.15.40:0/808134195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e840c7b90 0x7f5e84156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.434+0000 7f19b3200640 1 -- 172.21.15.40:0/1237859266 shutdown_connections 2024-09-11T00:23:23.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.435+0000 7fc12be00640 1 -- 172.21.15.40:0/833956551 wait complete. 2024-09-11T00:23:23.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.434+0000 7fe4bb400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4bc0b3750 0x7fe4bc14bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.434+0000 7fe4bb400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4bc0b3750 0x7fe4bc14bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.40:54054/0 (socket says 172.21.15.40:54054) 2024-09-11T00:23:23.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.434+0000 7fe4bbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4bc072880 0x7fe4bc14a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.435+0000 7fe4c1600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4bc159aa0 0x7fe4bc15a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.435+0000 7f5e83400640 1 -- 172.21.15.40:0/808134195 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e841f8390 msgr2=0x7f5e840c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.435+0000 7f5e83400640 1 --2- 172.21.15.40:0/808134195 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e841f8390 0x7f5e840c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.435+0000 7fe4bbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4bc072880 0x7fe4bc14a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60522/0 (socket says 172.21.15.40:60522) 2024-09-11T00:23:23.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.435+0000 7fe4bb400640 1 -- 172.21.15.40:0/4194881872 learned_addr learned my addr 172.21.15.40:0/4194881872 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.435+0000 7f5e83400640 1 -- 172.21.15.40:0/808134195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e840c7b90 msgr2=0x7f5e84156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.435+0000 7fe4c0c00640 1 --2- 172.21.15.40:0/4194881872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4bc159aa0 0x7fe4bc15a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.435+0000 7fe4c1600640 1 -- 172.21.15.40:0/4194881872 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc15dbd0 con 0x7fe4bc072880 2024-09-11T00:23:23.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.436+0000 7fe4c1600640 1 -- 172.21.15.40:0/4194881872 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc070640 con 0x7fe4bc159aa0 2024-09-11T00:23:23.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.436+0000 7fe4c1600640 1 -- 172.21.15.40:0/4194881872 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe4bc15dd50 con 0x7fe4bc0b3750 2024-09-11T00:23:23.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.435+0000 7f5e83400640 1 --2- 172.21.15.40:0/808134195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e840c7b90 0x7f5e84156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.435+0000 7f5e83400640 1 -- 172.21.15.40:0/808134195 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e840c80a0 con 0x7f5e841f7fb0 2024-09-11T00:23:23.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.436+0000 7fe4bbe00640 1 -- 172.21.15.40:0/4194881872 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4bc0b3750 msgr2=0x7fe4bc14bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.438+0000 7fc12be00640 1 Processor -- start 2024-09-11T00:23:23.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.438+0000 7fe4bbe00640 1 --2- 172.21.15.40:0/4194881872 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4bc0b3750 0x7fe4bc14bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.438+0000 7fc12be00640 1 -- start start 2024-09-11T00:23:23.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.438+0000 7fe4bbe00640 1 -- 172.21.15.40:0/4194881872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4bc159aa0 msgr2=0x7fe4bc15a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.438+0000 7fe4bbe00640 1 --2- 172.21.15.40:0/4194881872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4bc159aa0 0x7fe4bc15a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.438+0000 7fe4bbe00640 1 -- 172.21.15.40:0/4194881872 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4bc14ac50 con 0x7fe4bc072880 2024-09-11T00:23:23.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.438+0000 7fe4c0c00640 1 --2- 172.21.15.40:0/4194881872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4bc159aa0 0x7fe4bc15a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:23:23.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.438+0000 7fe4bb400640 1 --2- 172.21.15.40:0/4194881872 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4bc0b3750 0x7fe4bc14bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:23:23.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.440+0000 7fc12be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1100053c0 0x7fc12c1e0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.448 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi040') 2024-09-11T00:23:23.448 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi040') 2024-09-11T00:23:23.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.440+0000 7fc12be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc12c1f5900 0x7fc12c0c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.440+0000 7fc12be00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc12c0c9d20 0x7fc12c0b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.441+0000 7f5e83400640 1 --2- 172.21.15.40:0/808134195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e841f7fb0 0x7f5e841583c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5e74003f20 tx=0x7f5e740011a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:23.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.441+0000 7fc12b400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc12c0c9d20 0x7fc12c0b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.441+0000 7fc12b400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc12c0c9d20 0x7fc12c0b6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.40:54062/0 (socket says 172.21.15.40:54062) 2024-09-11T00:23:23.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.441+0000 7fc12b400640 1 -- 172.21.15.40:0/2465735785 learned_addr learned my addr 172.21.15.40:0/2465735785 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:23.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.441+0000 7fc12be00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c0d47a0 con 0x7fc12c1f5900 2024-09-11T00:23:23.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.441+0000 7fc12be00640 1 -- 172.21.15.40:0/2465735785 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c0d4920 con 0x7fc1100053c0 2024-09-11T00:23:23.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.441+0000 7fc12be00640 1 -- 172.21.15.40:0/2465735785 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc12c0d4aa0 con 0x7fc12c0c9d20 2024-09-11T00:23:23.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.441+0000 7fe4bbe00640 1 --2- 172.21.15.40:0/4194881872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4bc072880 0x7fe4bc14a6d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4032000 tx=0x7fe4b4036770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:23.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.441+0000 7fc12b400640 1 -- 172.21.15.40:0/2465735785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1100053c0 msgr2=0x7fc12c1e0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.441+0000 7fc12a000640 1 --2- 172.21.15.40:0/2465735785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc12c1f5900 0x7fc12c0c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.441+0000 7f5e7b400640 1 -- 172.21.15.40:0/808134195 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74044070 con 0x7f5e841f7fb0 2024-09-11T00:23:23.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.441+0000 7fc12aa00640 1 --2- 172.21.15.40:0/2465735785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1100053c0 0x7fc12c1e0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.441+0000 7fc12b400640 1 --2- 172.21.15.40:0/2465735785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1100053c0 0x7fc12c1e0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.441+0000 7fc12b400640 1 -- 172.21.15.40:0/2465735785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc12c1f5900 msgr2=0x7fc12c0c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.441+0000 7f5e7b400640 1 -- 172.21.15.40:0/808134195 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e7402baf0 con 0x7f5e841f7fb0 2024-09-11T00:23:23.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.441+0000 7f5e7b400640 1 -- 172.21.15.40:0/808134195 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e740035f0 con 0x7f5e841f7fb0 2024-09-11T00:23:23.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.442+0000 7fe4b3e00640 1 -- 172.21.15.40:0/4194881872 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4036d70 con 0x7fe4bc072880 2024-09-11T00:23:23.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.442+0000 7fc12b400640 1 --2- 172.21.15.40:0/2465735785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc12c1f5900 0x7fc12c0c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.442+0000 7fc12b400640 1 -- 172.21.15.40:0/2465735785 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc12c1f5d80 con 0x7fc12c0c9d20 2024-09-11T00:23:23.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.442+0000 7fc12aa00640 1 --2- 172.21.15.40:0/2465735785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1100053c0 0x7fc12c1e0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:23.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.442+0000 7fc12a000640 1 --2- 172.21.15.40:0/2465735785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc12c1f5900 0x7fc12c0c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:23.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.442+0000 7fe4b3e00640 1 -- 172.21.15.40:0/4194881872 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4b403f430 con 0x7fe4bc072880 2024-09-11T00:23:23.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.442+0000 7fc12b400640 1 --2- 172.21.15.40:0/2465735785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc12c0c9d20 0x7fc12c0b6a40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc12400c760 tx=0x7fc124004c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:23.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.442+0000 7fc123400640 1 -- 172.21.15.40:0/2465735785 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12402bae0 con 0x7fc12c0c9d20 2024-09-11T00:23:23.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.442+0000 7fe4b3e00640 1 -- 172.21.15.40:0/4194881872 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b403f880 con 0x7fe4bc072880 2024-09-11T00:23:23.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.442+0000 7fe4c1600640 1 -- 172.21.15.40:0/4194881872 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4bc14af30 con 0x7fe4bc072880 2024-09-11T00:23:23.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.443+0000 7fe4c1600640 1 -- 172.21.15.40:0/4194881872 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4bc14b4f0 con 0x7fe4bc072880 2024-09-11T00:23:23.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.443+0000 7f5e89200640 1 -- 172.21.15.40:0/808134195 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e840c8380 con 0x7f5e841f7fb0 2024-09-11T00:23:23.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.443+0000 7f5e89200640 1 -- 172.21.15.40:0/808134195 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e840c8940 con 0x7f5e841f7fb0 2024-09-11T00:23:23.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.443+0000 7fc12be00640 1 -- 172.21.15.40:0/2465735785 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc12c0b8f30 con 0x7fc12c0c9d20 2024-09-11T00:23:23.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.443+0000 7fc123400640 1 -- 172.21.15.40:0/2465735785 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc12402bd70 con 0x7fc12c0c9d20 2024-09-11T00:23:23.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.444+0000 7fc12be00640 1 -- 172.21.15.40:0/2465735785 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc12c0c8fe0 con 0x7fc12c0c9d20 2024-09-11T00:23:23.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.444+0000 7fc123400640 1 -- 172.21.15.40:0/2465735785 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12402bae0 con 0x7fc12c0c9d20 2024-09-11T00:23:23.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.444+0000 7fc123400640 1 -- 172.21.15.40:0/2465735785 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fc124006460 con 0x7fc12c0c9d20 2024-09-11T00:23:23.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.445+0000 7fe4b3e00640 1 -- 172.21.15.40:0/4194881872 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fe4b403fa20 con 0x7fe4bc072880 2024-09-11T00:23:23.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.445+0000 7fe4b3e00640 1 -- 172.21.15.40:0/4194881872 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe4b4048850 con 0x7fe4bc072880 2024-09-11T00:23:23.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.445+0000 7f5e7b400640 1 -- 172.21.15.40:0/808134195 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f5e740049b0 con 0x7f5e841f7fb0 2024-09-11T00:23:23.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.435+0000 7f19b3200640 1 -- 172.21.15.40:0/1237859266 wait complete. 2024-09-11T00:23:23.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.445+0000 7fc123400640 1 -- 172.21.15.40:0/2465735785 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc12403e770 con 0x7fc12c0c9d20 2024-09-11T00:23:23.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.446+0000 7fc12be00640 1 -- 172.21.15.40:0/2465735785 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc12c0d15b0 con 0x7fc12c0c9d20 2024-09-11T00:23:23.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.444+0000 7f19b3200640 1 Processor -- start 2024-09-11T00:23:23.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.445+0000 7f19b3200640 1 -- start start 2024-09-11T00:23:23.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.446+0000 7f5e7b400640 1 -- 172.21.15.40:0/808134195 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5e74048610 con 0x7f5e841f7fb0 2024-09-11T00:23:23.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.445+0000 7fe4c1600640 1 -- 172.21.15.40:0/4194881872 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe494005290 con 0x7fe4bc072880 2024-09-11T00:23:23.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.446+0000 7f19b3200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1998004d90 0x7f19b4158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.446+0000 7f19b3200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19b415a120 0x7f19b415adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.446+0000 7f19b3200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19b414f440 0x7f19b415b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.447+0000 7f19b3200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f19b4158260 con 0x7f19b414f440 2024-09-11T00:23:23.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.447+0000 7f19b3200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f19b41580e0 con 0x7f19b415a120 2024-09-11T00:23:23.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.447+0000 7f19b3200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f19b41583e0 con 0x7f1998004d90 2024-09-11T00:23:23.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.446+0000 7f5e89200640 1 -- 172.21.15.40:0/808134195 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e84161250 con 0x7f5e841f7fb0 2024-09-11T00:23:23.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.447+0000 7f19b2800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19b414f440 0x7f19b415b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.447+0000 7f19b2800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19b414f440 0x7f19b415b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60534/0 (socket says 172.21.15.40:60534) 2024-09-11T00:23:23.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.447+0000 7f19b2800640 1 -- 172.21.15.40:0/1589160940 learned_addr learned my addr 172.21.15.40:0/1589160940 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:23.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.447+0000 7f19b1400640 1 --2- 172.21.15.40:0/1589160940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19b415a120 0x7f19b415adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.447+0000 7f19b1e00640 1 --2- 172.21.15.40:0/1589160940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1998004d90 0x7f19b4158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.448+0000 7f19b2800640 1 -- 172.21.15.40:0/1589160940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1998004d90 msgr2=0x7f19b4158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.448+0000 7f19b2800640 1 --2- 172.21.15.40:0/1589160940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1998004d90 0x7f19b4158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.448+0000 7f19b2800640 1 -- 172.21.15.40:0/1589160940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19b415a120 msgr2=0x7f19b415adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.448+0000 7f19b2800640 1 --2- 172.21.15.40:0/1589160940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19b415a120 0x7f19b415adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.448+0000 7f19b2800640 1 -- 172.21.15.40:0/1589160940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b4159080 con 0x7f19b414f440 2024-09-11T00:23:23.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.448+0000 7f19b1400640 1 --2- 172.21.15.40:0/1589160940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19b415a120 0x7f19b415adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:23:23.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.448+0000 7f19b2800640 1 --2- 172.21.15.40:0/1589160940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19b414f440 0x7f19b415b2f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f19ac036040 tx=0x7f19ac034bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:23.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.449+0000 7fc123400640 1 -- 172.21.15.40:0/2465735785 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fc124004e20 con 0x7fc12c0c9d20 2024-09-11T00:23:23.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.451+0000 7f5e7b400640 1 -- 172.21.15.40:0/808134195 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f5e74048860 con 0x7f5e841f7fb0 2024-09-11T00:23:23.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.452+0000 7f19aa000640 1 -- 172.21.15.40:0/1589160940 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac043070 con 0x7f19b414f440 2024-09-11T00:23:23.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.452+0000 7f19aa000640 1 -- 172.21.15.40:0/1589160940 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19ac034cc0 con 0x7f19b414f440 2024-09-11T00:23:23.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.452+0000 7f19aa000640 1 -- 172.21.15.40:0/1589160940 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac038040 con 0x7f19b414f440 2024-09-11T00:23:23.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.452+0000 7f19b3200640 1 -- 172.21.15.40:0/1589160940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19b4159360 con 0x7f19b414f440 2024-09-11T00:23:23.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.452+0000 7f19b3200640 1 -- 172.21.15.40:0/1589160940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19b4159920 con 0x7f19b414f440 2024-09-11T00:23:23.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.455+0000 7f19aa000640 1 -- 172.21.15.40:0/1589160940 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f19ac03b050 con 0x7f19b414f440 2024-09-11T00:23:23.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.455+0000 7f19aa000640 1 -- 172.21.15.40:0/1589160940 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f19ac004590 con 0x7f19b414f440 2024-09-11T00:23:23.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.456+0000 7f19b3200640 1 -- 172.21.15.40:0/1589160940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19b406ce90 con 0x7f19b414f440 2024-09-11T00:23:23.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.455+0000 7fe4b3e00640 1 -- 172.21.15.40:0/4194881872 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fe4b4032030 con 0x7fe4bc072880 2024-09-11T00:23:23.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.458+0000 7fdfa6800640 1 -- 172.21.15.40:0/4224881739 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fdfa00d4400 con 0x7fdfa00d4aa0 2024-09-11T00:23:23.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.461+0000 7f19aa000640 1 -- 172.21.15.40:0/1589160940 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f19ac060950 con 0x7f19b414f440 2024-09-11T00:23:23.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.468+0000 7fdf97400640 1 -- 172.21.15.40:0/4224881739 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v11)=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7fdf98020030 con 0x7fdfa00d4aa0 2024-09-11T00:23:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.472+0000 7fdfa6800640 1 -- 172.21.15.40:0/4224881739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfa00d4aa0 msgr2=0x7fdfa00cd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.472+0000 7fdfa6800640 1 --2- 172.21.15.40:0/4224881739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfa00d4aa0 0x7fdfa00cd550 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800caa0 tx=0x7fdf9800cf60 comp rx=0 tx=0).stop 2024-09-11T00:23:23.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.472+0000 7fdfa6800640 1 -- 172.21.15.40:0/4224881739 shutdown_connections 2024-09-11T00:23:23.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.472+0000 7fdfa6800640 1 --2- 172.21.15.40:0/4224881739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfa00d4aa0 0x7fdfa00cd550 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.472+0000 7fdfa6800640 1 --2- 172.21.15.40:0/4224881739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfa00d2350 0x7fdfa00b88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.472+0000 7fdfa6800640 1 --2- 172.21.15.40:0/4224881739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa00b2e50 0x7fdfa00cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.472+0000 7fdfa6800640 1 -- 172.21.15.40:0/4224881739 >> 172.21.15.40:0/4224881739 conn(0x7fdfa00d3f80 msgr2=0x7fdfa006ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.476+0000 7fdfa6800640 1 -- 172.21.15.40:0/4224881739 shutdown_connections 2024-09-11T00:23:23.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.476+0000 7fdfa6800640 1 -- 172.21.15.40:0/4224881739 wait complete. 2024-09-11T00:23:23.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.476+0000 7f029ee00640 1 -- 172.21.15.40:0/473164187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02980d1030 msgr2=0x7f02980cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.476+0000 7f029ee00640 1 --2- 172.21.15.40:0/473164187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02980d1030 0x7f02980cf780 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0284005fd0 tx=0x7f028402a560 comp rx=0 tx=0).stop 2024-09-11T00:23:23.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.477+0000 7f029ee00640 1 -- 172.21.15.40:0/473164187 shutdown_connections 2024-09-11T00:23:23.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.477+0000 7f029ee00640 1 --2- 172.21.15.40:0/473164187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02980d1030 0x7f02980cf780 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.477+0000 7f029ee00640 1 -- 172.21.15.40:0/473164187 >> 172.21.15.40:0/473164187 conn(0x7f02980d3c10 msgr2=0x7f02980d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.477+0000 7f029ee00640 1 -- 172.21.15.40:0/473164187 shutdown_connections 2024-09-11T00:23:23.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.477+0000 7f029ee00640 1 -- 172.21.15.40:0/473164187 wait complete. 2024-09-11T00:23:23.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.480+0000 7f029ee00640 1 Processor -- start 2024-09-11T00:23:23.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.481+0000 7f029ee00640 1 -- start start 2024-09-11T00:23:23.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.483+0000 7f029ee00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02980d1030 0x7f029814df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.483+0000 7f029ee00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02980d1f00 0x7f02980cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.484+0000 7f029da00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02980d1030 0x7f029814df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.484+0000 7f029da00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02980d1030 0x7f029814df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.40:54072/0 (socket says 172.21.15.40:54072) 2024-09-11T00:23:23.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.484+0000 7f029da00640 1 -- 172.21.15.40:0/2773740805 learned_addr learned my addr 172.21.15.40:0/2773740805 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:23.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.484+0000 7f029d000640 1 --2- 172.21.15.40:0/2773740805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02980d1f00 0x7f02980cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.484+0000 7f029ee00640 1 --2- 172.21.15.40:0/2773740805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02980d22e0 0x7f02980cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.485+0000 7f029ee00640 1 -- 172.21.15.40:0/2773740805 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f02980d4ac0 con 0x7f02980d22e0 2024-09-11T00:23:23.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.485+0000 7f029e400640 1 --2- 172.21.15.40:0/2773740805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02980d22e0 0x7f02980cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.485+0000 7f029ee00640 1 -- 172.21.15.40:0/2773740805 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f02980d4940 con 0x7f02980d1f00 2024-09-11T00:23:23.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.485+0000 7f029ee00640 1 -- 172.21.15.40:0/2773740805 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f02980cf2e0 con 0x7f02980d1030 2024-09-11T00:23:23.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.488+0000 7f029da00640 1 -- 172.21.15.40:0/2773740805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02980d1f00 msgr2=0x7f02980cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.488+0000 7f029da00640 1 --2- 172.21.15.40:0/2773740805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02980d1f00 0x7f02980cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.488+0000 7f029da00640 1 -- 172.21.15.40:0/2773740805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02980d22e0 msgr2=0x7f02980cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.488+0000 7f029da00640 1 --2- 172.21.15.40:0/2773740805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02980d22e0 0x7f02980cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.488+0000 7f029da00640 1 -- 172.21.15.40:0/2773740805 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02980c8390 con 0x7f02980d1030 2024-09-11T00:23:23.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.488+0000 7f029e400640 1 --2- 172.21.15.40:0/2773740805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02980d22e0 0x7f02980cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:23:23.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.489+0000 7f029d000640 1 --2- 172.21.15.40:0/2773740805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02980d1f00 0x7f02980cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:23:23.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.493+0000 7f029da00640 1 --2- 172.21.15.40:0/2773740805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02980d1030 0x7f029814df20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f029000c8a0 tx=0x7f029000cd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:23.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.493+0000 7f0295600640 1 -- 172.21.15.40:0/2773740805 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0290003b70 con 0x7f02980d1030 2024-09-11T00:23:23.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.493+0000 7f0295600640 1 -- 172.21.15.40:0/2773740805 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0290003d10 con 0x7f02980d1030 2024-09-11T00:23:23.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.493+0000 7f0295600640 1 -- 172.21.15.40:0/2773740805 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029000aab0 con 0x7f02980d1030 2024-09-11T00:23:23.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.493+0000 7f029ee00640 1 -- 172.21.15.40:0/2773740805 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02980c8670 con 0x7f02980d1030 2024-09-11T00:23:23.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.494+0000 7f029ee00640 1 -- 172.21.15.40:0/2773740805 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f02980c8c30 con 0x7f02980d1030 2024-09-11T00:23:23.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.495+0000 7f029ee00640 1 -- 172.21.15.40:0/2773740805 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0274005290 con 0x7f02980d1030 2024-09-11T00:23:23.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.497+0000 7f0295600640 1 -- 172.21.15.40:0/2773740805 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f02900050d0 con 0x7f02980d1030 2024-09-11T00:23:23.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.498+0000 7f0295600640 1 -- 172.21.15.40:0/2773740805 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0290012a60 con 0x7f02980d1030 2024-09-11T00:23:23.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.498+0000 7f0295600640 1 -- 172.21.15.40:0/2773740805 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f0290020060 con 0x7f02980d1030 2024-09-11T00:23:23.505 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi040') 2024-09-11T00:23:23.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.537+0000 7f26f7c00640 1 -- 172.21.15.40:0/3145370422 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f26f0157890 con 0x7f26f0070b50 2024-09-11T00:23:23.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.545+0000 7fd6c6a00640 1 -- 172.21.15.40:0/1600105772 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fd6a8005580 con 0x7fd6d4157f80 2024-09-11T00:23:23.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.546+0000 7f26ecc00640 1 -- 172.21.15.40:0/3145370422 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v12)=0 v12) ==== 121+0+0 (secure 0 0 0) 0x7f26e00193b0 con 0x7f26f0070b50 2024-09-11T00:23:23.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.548+0000 7f26f7c00640 1 -- 172.21.15.40:0/3145370422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26f0070b50 msgr2=0x7f26f01fcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.548+0000 7f26f7c00640 1 --2- 172.21.15.40:0/3145370422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26f0070b50 0x7f26f01fcbc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f26f00720f0 tx=0x7f26e000b870 comp rx=0 tx=0).stop 2024-09-11T00:23:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.549+0000 7f26f7c00640 1 -- 172.21.15.40:0/3145370422 shutdown_connections 2024-09-11T00:23:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.549+0000 7f26f7c00640 1 --2- 172.21.15.40:0/3145370422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26f00d1140 0x7f26f00b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.549+0000 7f26f7c00640 1 --2- 172.21.15.40:0/3145370422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26f0070b50 0x7f26f01fcbc0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.549+0000 7f26f7c00640 1 --2- 172.21.15.40:0/3145370422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26f006de30 0x7f26f0155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.549+0000 7f26f7c00640 1 -- 172.21.15.40:0/3145370422 >> 172.21.15.40:0/3145370422 conn(0x7f26f00d1d50 msgr2=0x7f26f01569c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.549+0000 7f26f7c00640 1 -- 172.21.15.40:0/3145370422 shutdown_connections 2024-09-11T00:23:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.550+0000 7f26f7c00640 1 -- 172.21.15.40:0/3145370422 wait complete. 2024-09-11T00:23:23.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.558+0000 7fd6d1600640 1 -- 172.21.15.40:0/1600105772 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7fd6c000d040 con 0x7fd6d4157f80 2024-09-11T00:23:23.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.563+0000 7fd6c6a00640 1 -- 172.21.15.40:0/1600105772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6d4157f80 msgr2=0x7fd6d40ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.563+0000 7fd6c6a00640 1 --2- 172.21.15.40:0/1600105772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6d4157f80 0x7fd6d40ccd20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000b450 tx=0x7fd6c000b910 comp rx=0 tx=0).stop 2024-09-11T00:23:23.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.563+0000 7fd6c6a00640 1 -- 172.21.15.40:0/1600105772 shutdown_connections 2024-09-11T00:23:23.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.563+0000 7fd6c6a00640 1 --2- 172.21.15.40:0/1600105772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6d4158360 0x7fd6d41f8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.563+0000 7fd6c6a00640 1 --2- 172.21.15.40:0/1600105772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6d4157f80 0x7fd6d40ccd20 secure :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000b450 tx=0x7fd6c000b910 comp rx=0 tx=0).stop 2024-09-11T00:23:23.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.563+0000 7fd6c6a00640 1 --2- 172.21.15.40:0/1600105772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d4072340 0x7fd6d40cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.563+0000 7fd6c6a00640 1 -- 172.21.15.40:0/1600105772 >> 172.21.15.40:0/1600105772 conn(0x7fd6d40b1500 msgr2=0x7fd6d415e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.563+0000 7fd6c6a00640 1 -- 172.21.15.40:0/1600105772 shutdown_connections 2024-09-11T00:23:23.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.563+0000 7fd6c6a00640 1 -- 172.21.15.40:0/1600105772 wait complete. 2024-09-11T00:23:23.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.585+0000 7f568a600640 1 -- 172.21.15.40:0/3374381896 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f565c005580 con 0x7f5684073ec0 2024-09-11T00:23:23.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.591+0000 7f5680c00640 1 -- 172.21.15.40:0/3374381896 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v14)=0 v14) ==== 119+0+0 (secure 0 0 0) 0x7f567401b3c0 con 0x7f5684073ec0 2024-09-11T00:23:23.595 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi040') 2024-09-11T00:23:23.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.594+0000 7f568a600640 1 -- 172.21.15.40:0/3374381896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5684073ec0 msgr2=0x7f5684150f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.594+0000 7f568a600640 1 --2- 172.21.15.40:0/3374381896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5684073ec0 0x7f5684150f40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f567400c520 tx=0x7f567400c9e0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.594+0000 7f568a600640 1 -- 172.21.15.40:0/3374381896 shutdown_connections 2024-09-11T00:23:23.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.594+0000 7f568a600640 1 --2- 172.21.15.40:0/3374381896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5684073ec0 0x7f5684150f40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.594+0000 7f568a600640 1 --2- 172.21.15.40:0/3374381896 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f568406fe40 0x7f5684152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.594+0000 7f568a600640 1 --2- 172.21.15.40:0/3374381896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f568406cab0 0x7f56841f07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.594+0000 7f568a600640 1 -- 172.21.15.40:0/3374381896 >> 172.21.15.40:0/3374381896 conn(0x7f56840b1500 msgr2=0x7f568415b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.594+0000 7f568a600640 1 -- 172.21.15.40:0/3374381896 shutdown_connections 2024-09-11T00:23:23.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.595+0000 7f568a600640 1 -- 172.21.15.40:0/3374381896 wait complete. 2024-09-11T00:23:23.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.597+0000 7fc12be00640 1 -- 172.21.15.40:0/2465735785 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fc12c0d0400 con 0x7fc12c0c9d20 2024-09-11T00:23:23.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.606+0000 7fc123400640 1 -- 172.21.15.40:0/2465735785 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7fc12400c2d0 con 0x7fc12c0c9d20 2024-09-11T00:23:23.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.608+0000 7fc12be00640 1 -- 172.21.15.40:0/2465735785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc12c0c9d20 msgr2=0x7fc12c0b6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.608+0000 7fc12be00640 1 --2- 172.21.15.40:0/2465735785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc12c0c9d20 0x7fc12c0b6a40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc12400c760 tx=0x7fc124004c30 comp rx=0 tx=0).stop 2024-09-11T00:23:23.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.608+0000 7fc12be00640 1 -- 172.21.15.40:0/2465735785 shutdown_connections 2024-09-11T00:23:23.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.608+0000 7fc12be00640 1 --2- 172.21.15.40:0/2465735785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc12c0c9d20 0x7fc12c0b6a40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.608+0000 7fc12be00640 1 --2- 172.21.15.40:0/2465735785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc12c1f5900 0x7fc12c0c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.608+0000 7fc12be00640 1 --2- 172.21.15.40:0/2465735785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1100053c0 0x7fc12c1e0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.608+0000 7fc12be00640 1 -- 172.21.15.40:0/2465735785 >> 172.21.15.40:0/2465735785 conn(0x7fc12c0d3c10 msgr2=0x7fc12c0b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.609+0000 7fc12be00640 1 -- 172.21.15.40:0/2465735785 shutdown_connections 2024-09-11T00:23:23.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.609+0000 7fc12be00640 1 -- 172.21.15.40:0/2465735785 wait complete. 2024-09-11T00:23:23.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.618+0000 7fe4c1600640 1 -- 172.21.15.40:0/4194881872 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fe494005580 con 0x7fe4bc072880 2024-09-11T00:23:23.622 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi040') 2024-09-11T00:23:23.622 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi040') 2024-09-11T00:23:23.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.623+0000 7f5e89200640 1 -- 172.21.15.40:0/808134195 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f5e8415fce0 con 0x7f5e841f7fb0 2024-09-11T00:23:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.623+0000 7fe4b3e00640 1 -- 172.21.15.40:0/4194881872 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v16)=0 v16) ==== 120+0+0 (secure 0 0 0) 0x7fe4b40483f0 con 0x7fe4bc072880 2024-09-11T00:23:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.625+0000 7fe4c1600640 1 -- 172.21.15.40:0/4194881872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4bc072880 msgr2=0x7fe4bc14a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.625+0000 7fe4c1600640 1 --2- 172.21.15.40:0/4194881872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4bc072880 0x7fe4bc14a6d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4032000 tx=0x7fe4b4036770 comp rx=0 tx=0).stop 2024-09-11T00:23:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.625+0000 7fe4c1600640 1 -- 172.21.15.40:0/4194881872 shutdown_connections 2024-09-11T00:23:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.625+0000 7fe4c1600640 1 --2- 172.21.15.40:0/4194881872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4bc159aa0 0x7fe4bc15a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.625+0000 7fe4c1600640 1 --2- 172.21.15.40:0/4194881872 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4bc0b3750 0x7fe4bc14bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.625+0000 7fe4c1600640 1 --2- 172.21.15.40:0/4194881872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4bc072880 0x7fe4bc14a6d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.625+0000 7fe4c1600640 1 -- 172.21.15.40:0/4194881872 >> 172.21.15.40:0/4194881872 conn(0x7fe4bc0cf8d0 msgr2=0x7fe4bc155ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.626+0000 7fe4c1600640 1 -- 172.21.15.40:0/4194881872 shutdown_connections 2024-09-11T00:23:23.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.626+0000 7fe4c1600640 1 -- 172.21.15.40:0/4194881872 wait complete. 2024-09-11T00:23:23.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.630+0000 7f5e7b400640 1 -- 172.21.15.40:0/808134195 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f5e74048a40 con 0x7f5e841f7fb0 2024-09-11T00:23:23.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.632+0000 7f5e89200640 1 -- 172.21.15.40:0/808134195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e841f7fb0 msgr2=0x7f5e841583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.632+0000 7f5e89200640 1 --2- 172.21.15.40:0/808134195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e841f7fb0 0x7f5e841583c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5e74003f20 tx=0x7f5e740011a0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.632+0000 7f5e89200640 1 -- 172.21.15.40:0/808134195 shutdown_connections 2024-09-11T00:23:23.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.632+0000 7f5e89200640 1 --2- 172.21.15.40:0/808134195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e840c7b90 0x7f5e84156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.632+0000 7f5e89200640 1 --2- 172.21.15.40:0/808134195 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e841f8390 0x7f5e840c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.632+0000 7f5e89200640 1 --2- 172.21.15.40:0/808134195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e841f7fb0 0x7f5e841583c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.632+0000 7f5e89200640 1 -- 172.21.15.40:0/808134195 >> 172.21.15.40:0/808134195 conn(0x7f5e840d3c10 msgr2=0x7f5e8415eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.632+0000 7f5e89200640 1 -- 172.21.15.40:0/808134195 shutdown_connections 2024-09-11T00:23:23.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.632+0000 7f5e89200640 1 -- 172.21.15.40:0/808134195 wait complete. 2024-09-11T00:23:23.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.635+0000 7f19b3200640 1 -- 172.21.15.40:0/1589160940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f19b4157760 con 0x7f19b414f440 2024-09-11T00:23:23.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.639+0000 7f19aa000640 1 -- 172.21.15.40:0/1589160940 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v18)=0 v18) ==== 120+0+0 (secure 0 0 0) 0x7f19ac04e070 con 0x7f19b414f440 2024-09-11T00:23:23.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.640+0000 7f19b3200640 1 -- 172.21.15.40:0/1589160940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19b414f440 msgr2=0x7f19b415b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.640+0000 7f19b3200640 1 --2- 172.21.15.40:0/1589160940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19b414f440 0x7f19b415b2f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f19ac036040 tx=0x7f19ac034bd0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.640+0000 7f19b3200640 1 -- 172.21.15.40:0/1589160940 shutdown_connections 2024-09-11T00:23:23.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.640+0000 7f19b3200640 1 --2- 172.21.15.40:0/1589160940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19b414f440 0x7f19b415b2f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.640+0000 7f19b3200640 1 --2- 172.21.15.40:0/1589160940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19b415a120 0x7f19b415adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.640+0000 7f19b3200640 1 --2- 172.21.15.40:0/1589160940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1998004d90 0x7f19b4158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.640+0000 7f19b3200640 1 -- 172.21.15.40:0/1589160940 >> 172.21.15.40:0/1589160940 conn(0x7f19b40b1500 msgr2=0x7f19b41602a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.641+0000 7f19b3200640 1 -- 172.21.15.40:0/1589160940 shutdown_connections 2024-09-11T00:23:23.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.641+0000 7f19b3200640 1 -- 172.21.15.40:0/1589160940 wait complete. 2024-09-11T00:23:23.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.650+0000 7f029ee00640 1 -- 172.21.15.40:0/2773740805 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f0274005580 con 0x7f02980d1030 2024-09-11T00:23:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.655+0000 7f0295600640 1 -- 172.21.15.40:0/2773740805 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v19)=0 v19) ==== 125+0+0 (secure 0 0 0) 0x7f0290012420 con 0x7f02980d1030 2024-09-11T00:23:23.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.656+0000 7f029ee00640 1 -- 172.21.15.40:0/2773740805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02980d1030 msgr2=0x7f029814df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.656+0000 7f029ee00640 1 --2- 172.21.15.40:0/2773740805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02980d1030 0x7f029814df20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f029000c8a0 tx=0x7f029000cd60 comp rx=0 tx=0).stop 2024-09-11T00:23:23.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.656+0000 7f029ee00640 1 -- 172.21.15.40:0/2773740805 shutdown_connections 2024-09-11T00:23:23.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.656+0000 7f029ee00640 1 --2- 172.21.15.40:0/2773740805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02980d22e0 0x7f02980cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.656+0000 7f029ee00640 1 --2- 172.21.15.40:0/2773740805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02980d1f00 0x7f02980cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.656+0000 7f029ee00640 1 --2- 172.21.15.40:0/2773740805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02980d1030 0x7f029814df20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.656+0000 7f029ee00640 1 -- 172.21.15.40:0/2773740805 >> 172.21.15.40:0/2773740805 conn(0x7f02980d3c10 msgr2=0x7f02980b08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.656+0000 7f029ee00640 1 -- 172.21.15.40:0/2773740805 shutdown_connections 2024-09-11T00:23:23.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.656+0000 7f029ee00640 1 -- 172.21.15.40:0/2773740805 wait complete. 2024-09-11T00:23:23.668 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi040') 2024-09-11T00:23:23.669 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi040') 2024-09-11T00:23:23.669 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi040') 2024-09-11T00:23:23.678 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi040') 2024-09-11T00:23:23.678 INFO:tasks.ceph:Setting crush tunables to default 2024-09-11T00:23:23.679 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd crush tunables default 2024-09-11T00:23:23.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.874+0000 7f4eaa000640 1 -- 172.21.15.40:0/3700491429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40b2e50 msgr2=0x7f4ea40b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.874+0000 7f4eaa000640 1 --2- 172.21.15.40:0/3700491429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40b2e50 0x7f4ea40b3e20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c005fd0 tx=0x7f4e9c02a780 comp rx=0 tx=0).stop 2024-09-11T00:23:23.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.874+0000 7f4eaa000640 1 -- 172.21.15.40:0/3700491429 shutdown_connections 2024-09-11T00:23:23.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.874+0000 7f4eaa000640 1 --2- 172.21.15.40:0/3700491429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40b2e50 0x7f4ea40b3e20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.874+0000 7f4eaa000640 1 --2- 172.21.15.40:0/3700491429 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ea40d4aa0 0x7f4ea40b38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.874+0000 7f4eaa000640 1 -- 172.21.15.40:0/3700491429 >> 172.21.15.40:0/3700491429 conn(0x7f4ea40d3f80 msgr2=0x7f4ea40d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.874+0000 7f4eaa000640 1 -- 172.21.15.40:0/3700491429 shutdown_connections 2024-09-11T00:23:23.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.874+0000 7f4eaa000640 1 -- 172.21.15.40:0/3700491429 wait complete. 2024-09-11T00:23:23.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.876+0000 7f4eaa000640 1 Processor -- start 2024-09-11T00:23:23.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.876+0000 7f4eaa000640 1 -- start start 2024-09-11T00:23:23.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.877+0000 7f4eaa000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ea40b2e50 0x7f4ea409dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.877+0000 7f4eaa000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ea40d2350 0x7f4ea41f3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.877+0000 7f4eaa000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40d4aa0 0x7f4ea41f7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:23.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.877+0000 7f4eaa000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea40b3660 con 0x7f4ea40d4aa0 2024-09-11T00:23:23.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.877+0000 7f4eaa000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea415e2e0 con 0x7f4ea40d2350 2024-09-11T00:23:23.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.877+0000 7f4eaa000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea40b4360 con 0x7f4ea40b2e50 2024-09-11T00:23:23.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.877+0000 7f4ea3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40d4aa0 0x7f4ea41f7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.877+0000 7f4ea3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40d4aa0 0x7f4ea41f7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60580/0 (socket says 172.21.15.40:60580) 2024-09-11T00:23:23.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.877+0000 7f4ea3e00640 1 -- 172.21.15.40:0/333770703 learned_addr learned my addr 172.21.15.40:0/333770703 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:23.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.877+0000 7f4e9aa00640 1 --2- 172.21.15.40:0/333770703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ea40d2350 0x7f4ea41f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.877+0000 7f4ea3400640 1 --2- 172.21.15.40:0/333770703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ea40b2e50 0x7f4ea409dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:23.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.877+0000 7f4ea3e00640 1 -- 172.21.15.40:0/333770703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ea40b2e50 msgr2=0x7f4ea409dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.878+0000 7f4ea3e00640 1 --2- 172.21.15.40:0/333770703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ea40b2e50 0x7f4ea409dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.878+0000 7f4ea3e00640 1 -- 172.21.15.40:0/333770703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ea40d2350 msgr2=0x7f4ea41f3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.878+0000 7f4ea3e00640 1 --2- 172.21.15.40:0/333770703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ea40d2350 0x7f4ea41f3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.878+0000 7f4ea3e00640 1 -- 172.21.15.40:0/333770703 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea415eca0 con 0x7f4ea40d4aa0 2024-09-11T00:23:23.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.878+0000 7f4ea3400640 1 --2- 172.21.15.40:0/333770703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ea40b2e50 0x7f4ea409dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:23:23.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.878+0000 7f4e9aa00640 1 --2- 172.21.15.40:0/333770703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ea40d2350 0x7f4ea41f3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:23:23.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.878+0000 7f4ea3e00640 1 --2- 172.21.15.40:0/333770703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40d4aa0 0x7f4ea41f7b50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c005fd0 tx=0x7f4e9c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:23.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.878+0000 7f4e9be00640 1 -- 172.21.15.40:0/333770703 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c040070 con 0x7f4ea40d4aa0 2024-09-11T00:23:23.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.878+0000 7f4e9be00640 1 -- 172.21.15.40:0/333770703 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e9c004540 con 0x7f4ea40d4aa0 2024-09-11T00:23:23.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.878+0000 7f4e9be00640 1 -- 172.21.15.40:0/333770703 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c003e10 con 0x7f4ea40d4aa0 2024-09-11T00:23:23.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.878+0000 7f4eaa000640 1 -- 172.21.15.40:0/333770703 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea415ef80 con 0x7f4ea40d4aa0 2024-09-11T00:23:23.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.878+0000 7f4eaa000640 1 -- 172.21.15.40:0/333770703 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea415e930 con 0x7f4ea40d4aa0 2024-09-11T00:23:23.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.879+0000 7f4e9be00640 1 -- 172.21.15.40:0/333770703 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f4e9c045450 con 0x7f4ea40d4aa0 2024-09-11T00:23:23.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.879+0000 7f4e9be00640 1 -- 172.21.15.40:0/333770703 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4e9c03c760 con 0x7f4ea40d4aa0 2024-09-11T00:23:23.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.879+0000 7f4eaa000640 1 -- 172.21.15.40:0/333770703 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ea40b47e0 con 0x7f4ea40d4aa0 2024-09-11T00:23:23.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.882+0000 7f4e9be00640 1 -- 172.21.15.40:0/333770703 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f4e9c03c9b0 con 0x7f4ea40d4aa0 2024-09-11T00:23:23.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.951+0000 7f4eaa000640 1 -- 172.21.15.40:0/333770703 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f4ea406d7e0 con 0x7f4ea40d4aa0 2024-09-11T00:23:23.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.953+0000 7f4e9be00640 1 -- 172.21.15.40:0/333770703 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f4e9c03cb90 con 0x7f4ea40d4aa0 2024-09-11T00:23:23.955 INFO:teuthology.orchestra.run.smithi040.stderr:adjusted tunables profile to default 2024-09-11T00:23:23.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.954+0000 7f4eaa000640 1 -- 172.21.15.40:0/333770703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40d4aa0 msgr2=0x7f4ea41f7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:23.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.954+0000 7f4eaa000640 1 --2- 172.21.15.40:0/333770703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40d4aa0 0x7f4ea41f7b50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c005fd0 tx=0x7f4e9c003c20 comp rx=0 tx=0).stop 2024-09-11T00:23:23.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.954+0000 7f4eaa000640 1 -- 172.21.15.40:0/333770703 shutdown_connections 2024-09-11T00:23:23.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.954+0000 7f4eaa000640 1 --2- 172.21.15.40:0/333770703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea40d4aa0 0x7f4ea41f7b50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.954+0000 7f4eaa000640 1 --2- 172.21.15.40:0/333770703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ea40d2350 0x7f4ea41f3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.954+0000 7f4eaa000640 1 --2- 172.21.15.40:0/333770703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ea40b2e50 0x7f4ea409dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:23.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.954+0000 7f4eaa000640 1 -- 172.21.15.40:0/333770703 >> 172.21.15.40:0/333770703 conn(0x7f4ea40d3f80 msgr2=0x7f4ea40b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:23.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.954+0000 7f4eaa000640 1 -- 172.21.15.40:0/333770703 shutdown_connections 2024-09-11T00:23:23.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:23.954+0000 7f4eaa000640 1 -- 172.21.15.40:0/333770703 wait complete. 2024-09-11T00:23:23.972 INFO:tasks.ceph:check_enable_crimson: False 2024-09-11T00:23:23.972 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-11T00:23:23.972 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:23:23.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-11T00:23:24.029 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:23:24.029 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-11T00:23:24.125 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:23:24.125 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-11T00:23:24.223 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:23:24.223 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-11T00:23:24.319 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:23:24.320 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-11T00:23:24.375 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:23:24.375 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-11T00:23:24.471 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:23:24.472 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-11T00:23:24.569 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:23:24.569 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-11T00:23:24.665 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new ee10e123-8817-4d94-a340-73d00121af37 0 2024-09-11T00:23:24.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.858+0000 7f0f79800640 1 -- 172.21.15.175:0/2590375586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f740d47a0 msgr2=0x7f0f740d1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:24.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.858+0000 7f0f79800640 1 --2- 172.21.15.175:0/2590375586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f740d47a0 0x7f0f740d1c90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009830 tx=0x7f0f6002a5b0 comp rx=0 tx=0).stop 2024-09-11T00:23:24.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.858+0000 7f0f79800640 1 -- 172.21.15.175:0/2590375586 shutdown_connections 2024-09-11T00:23:24.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.858+0000 7f0f79800640 1 --2- 172.21.15.175:0/2590375586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f740d47a0 0x7f0f740d1c90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:24.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.858+0000 7f0f79800640 1 -- 172.21.15.175:0/2590375586 >> 172.21.15.175:0/2590375586 conn(0x7f0f740d3c10 msgr2=0x7f0f740d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:24.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.858+0000 7f0f79800640 1 -- 172.21.15.175:0/2590375586 shutdown_connections 2024-09-11T00:23:24.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.858+0000 7f0f79800640 1 -- 172.21.15.175:0/2590375586 wait complete. 2024-09-11T00:23:24.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.859+0000 7f0f79800640 1 Processor -- start 2024-09-11T00:23:24.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.860+0000 7f0f79800640 1 -- start start 2024-09-11T00:23:24.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.860+0000 7f0f79800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f740b5090 0x7f0f74159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:24.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.860+0000 7f0f79800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f740d21d0 0x7f0f7406d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:24.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.860+0000 7f0f79800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f740d47a0 0x7f0f7406d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:24.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.861+0000 7f0f79800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0f74161120 con 0x7f0f740b5090 2024-09-11T00:23:24.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.861+0000 7f0f79800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0f74160fa0 con 0x7f0f740d21d0 2024-09-11T00:23:24.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.861+0000 7f0f79800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0f741612a0 con 0x7f0f740d47a0 2024-09-11T00:23:24.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.861+0000 7f0f73400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f740d21d0 0x7f0f7406d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:24.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.861+0000 7f0f73400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f740d21d0 0x7f0f7406d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59704/0 (socket says 172.21.15.175:59704) 2024-09-11T00:23:24.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.861+0000 7f0f73400640 1 -- 172.21.15.175:0/4292523546 learned_addr learned my addr 172.21.15.175:0/4292523546 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T00:23:24.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.861+0000 7f0f73e00640 1 --2- 172.21.15.175:0/4292523546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f740b5090 0x7f0f74159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:24.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.861+0000 7f0f78e00640 1 --2- 172.21.15.175:0/4292523546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f740d47a0 0x7f0f7406d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:24.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.861+0000 7f0f73400640 1 -- 172.21.15.175:0/4292523546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f740d47a0 msgr2=0x7f0f7406d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:24.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.861+0000 7f0f73400640 1 --2- 172.21.15.175:0/4292523546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f740d47a0 0x7f0f7406d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:24.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.861+0000 7f0f73400640 1 -- 172.21.15.175:0/4292523546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f740b5090 msgr2=0x7f0f74159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:24.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.861+0000 7f0f73400640 1 --2- 172.21.15.175:0/4292523546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f740b5090 0x7f0f74159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:24.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.861+0000 7f0f73400640 1 -- 172.21.15.175:0/4292523546 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f740c9ea0 con 0x7f0f740d21d0 2024-09-11T00:23:24.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.861+0000 7f0f78e00640 1 --2- 172.21.15.175:0/4292523546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f740d47a0 0x7f0f7406d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:23:24.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.861+0000 7f0f73e00640 1 --2- 172.21.15.175:0/4292523546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f740b5090 0x7f0f74159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:23:24.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.861+0000 7f0f73400640 1 --2- 172.21.15.175:0/4292523546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f740d21d0 0x7f0f7406d0b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009950 tx=0x7f0f60033ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:24.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.862+0000 7f0f6be00640 1 -- 172.21.15.175:0/4292523546 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60031b50 con 0x7f0f740d21d0 2024-09-11T00:23:24.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.862+0000 7f0f6be00640 1 -- 172.21.15.175:0/4292523546 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f60031de0 con 0x7f0f740d21d0 2024-09-11T00:23:24.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.862+0000 7f0f6be00640 1 -- 172.21.15.175:0/4292523546 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60005280 con 0x7f0f740d21d0 2024-09-11T00:23:24.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.862+0000 7f0f79800640 1 -- 172.21.15.175:0/4292523546 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f740c90e0 con 0x7f0f740d21d0 2024-09-11T00:23:24.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.862+0000 7f0f79800640 1 -- 172.21.15.175:0/4292523546 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f740c96a0 con 0x7f0f740d21d0 2024-09-11T00:23:24.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.862+0000 7f0f6be00640 1 -- 172.21.15.175:0/4292523546 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f0f600047a0 con 0x7f0f740d21d0 2024-09-11T00:23:24.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.862+0000 7f0f6be00640 1 -- 172.21.15.175:0/4292523546 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f0f600333a0 con 0x7f0f740d21d0 2024-09-11T00:23:24.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.863+0000 7f0f79800640 1 -- 172.21.15.175:0/4292523546 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f740d1c90 con 0x7f0f740d21d0 2024-09-11T00:23:24.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.867+0000 7f0f6be00640 1 -- 172.21.15.175:0/4292523546 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f0f6003f030 con 0x7f0f740d21d0 2024-09-11T00:23:24.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.941+0000 7f0f79800640 1 -- 172.21.15.175:0/4292523546 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ee10e123-8817-4d94-a340-73d00121af37", "id": 0} v 0) -- 0x7f0f7406e5a0 con 0x7f0f740d21d0 2024-09-11T00:23:24.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.946+0000 7f0f6be00640 1 -- 172.21.15.175:0/4292523546 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ee10e123-8817-4d94-a340-73d00121af37", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f0f60031770 con 0x7f0f740d21d0 2024-09-11T00:23:24.948 INFO:teuthology.orchestra.run.smithi175.stdout:0 2024-09-11T00:23:24.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.947+0000 7f0f79800640 1 -- 172.21.15.175:0/4292523546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f740d21d0 msgr2=0x7f0f7406d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:24.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.947+0000 7f0f79800640 1 --2- 172.21.15.175:0/4292523546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f740d21d0 0x7f0f7406d0b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009950 tx=0x7f0f60033ba0 comp rx=0 tx=0).stop 2024-09-11T00:23:24.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.947+0000 7f0f79800640 1 -- 172.21.15.175:0/4292523546 shutdown_connections 2024-09-11T00:23:24.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.947+0000 7f0f79800640 1 --2- 172.21.15.175:0/4292523546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f740d47a0 0x7f0f7406d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:24.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.947+0000 7f0f79800640 1 --2- 172.21.15.175:0/4292523546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f740d21d0 0x7f0f7406d0b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:24.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.947+0000 7f0f79800640 1 --2- 172.21.15.175:0/4292523546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f740b5090 0x7f0f74159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:24.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.947+0000 7f0f79800640 1 -- 172.21.15.175:0/4292523546 >> 172.21.15.175:0/4292523546 conn(0x7f0f740d3c10 msgr2=0x7f0f7406e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:24.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.947+0000 7f0f79800640 1 -- 172.21.15.175:0/4292523546 shutdown_connections 2024-09-11T00:23:24.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:24.947+0000 7f0f79800640 1 -- 172.21.15.175:0/4292523546 wait complete. 2024-09-11T00:23:24.964 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new f90895e9-8660-42b9-8aba-3f9d4d130b5e 1 2024-09-11T00:23:25.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.116+0000 7f4947e00640 1 -- 172.21.15.175:0/2734392422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49480d2870 msgr2=0x7f49480d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:25.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.116+0000 7f4947e00640 1 --2- 172.21.15.175:0/2734392422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49480d2870 0x7f49480d0df0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4934005fd0 tx=0x7f493402a710 comp rx=0 tx=0).stop 2024-09-11T00:23:25.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.116+0000 7f4947e00640 1 -- 172.21.15.175:0/2734392422 shutdown_connections 2024-09-11T00:23:25.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.116+0000 7f4947e00640 1 --2- 172.21.15.175:0/2734392422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49480d2870 0x7f49480d0df0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.116+0000 7f4947e00640 1 -- 172.21.15.175:0/2734392422 >> 172.21.15.175:0/2734392422 conn(0x7f49480d3b80 msgr2=0x7f49480d3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:25.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.116+0000 7f4947e00640 1 -- 172.21.15.175:0/2734392422 shutdown_connections 2024-09-11T00:23:25.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.116+0000 7f4947e00640 1 -- 172.21.15.175:0/2734392422 wait complete. 2024-09-11T00:23:25.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.117+0000 7f4947e00640 1 Processor -- start 2024-09-11T00:23:25.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.118+0000 7f4947e00640 1 -- start start 2024-09-11T00:23:25.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.118+0000 7f4947e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49480d2870 0x7f49480b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:25.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.118+0000 7f4947e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49480d46a0 0x7f4948154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:25.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.119+0000 7f4947e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f494815dd00 0x7f49480b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:25.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.119+0000 7f4947e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f49480cf540 con 0x7f494815dd00 2024-09-11T00:23:25.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.119+0000 7f4947e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f49480cf3c0 con 0x7f49480d2870 2024-09-11T00:23:25.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.119+0000 7f4947e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f49480cf6c0 con 0x7f49480d46a0 2024-09-11T00:23:25.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.119+0000 7f4946a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49480d2870 0x7f49480b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:25.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.119+0000 7f4946a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49480d2870 0x7f49480b2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59718/0 (socket says 172.21.15.175:59718) 2024-09-11T00:23:25.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.119+0000 7f4946000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49480d46a0 0x7f4948154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:25.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.119+0000 7f4946a00640 1 -- 172.21.15.175:0/4269465261 learned_addr learned my addr 172.21.15.175:0/4269465261 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T00:23:25.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.119+0000 7f4947400640 1 --2- 172.21.15.175:0/4269465261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f494815dd00 0x7f49480b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:25.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.119+0000 7f4946a00640 1 -- 172.21.15.175:0/4269465261 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49480d46a0 msgr2=0x7f4948154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:25.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.119+0000 7f4946a00640 1 --2- 172.21.15.175:0/4269465261 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49480d46a0 0x7f4948154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.119+0000 7f4946a00640 1 -- 172.21.15.175:0/4269465261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f494815dd00 msgr2=0x7f49480b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:25.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.119+0000 7f4946a00640 1 --2- 172.21.15.175:0/4269465261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f494815dd00 0x7f49480b0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.119+0000 7f4946a00640 1 -- 172.21.15.175:0/4269465261 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49480cc980 con 0x7f49480d2870 2024-09-11T00:23:25.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.120+0000 7f4946a00640 1 --2- 172.21.15.175:0/4269465261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49480d2870 0x7f49480b2130 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f493800c3d0 tx=0x7f493800c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:25.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.120+0000 7f493f400640 1 -- 172.21.15.175:0/4269465261 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938017070 con 0x7f49480d2870 2024-09-11T00:23:25.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.120+0000 7f493f400640 1 -- 172.21.15.175:0/4269465261 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49380053c0 con 0x7f49480d2870 2024-09-11T00:23:25.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.120+0000 7f4947e00640 1 -- 172.21.15.175:0/4269465261 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49480cacf0 con 0x7f49480d2870 2024-09-11T00:23:25.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.120+0000 7f493f400640 1 -- 172.21.15.175:0/4269465261 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938003850 con 0x7f49480d2870 2024-09-11T00:23:25.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.120+0000 7f4947e00640 1 -- 172.21.15.175:0/4269465261 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49480cb290 con 0x7f49480d2870 2024-09-11T00:23:25.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.120+0000 7f493f400640 1 -- 172.21.15.175:0/4269465261 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f49380039f0 con 0x7f49480d2870 2024-09-11T00:23:25.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.120+0000 7f493f400640 1 -- 172.21.15.175:0/4269465261 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f493801c480 con 0x7f49480d2870 2024-09-11T00:23:25.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.121+0000 7f4947e00640 1 -- 172.21.15.175:0/4269465261 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49480cb460 con 0x7f49480d2870 2024-09-11T00:23:25.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.123+0000 7f493f400640 1 -- 172.21.15.175:0/4269465261 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f4938021070 con 0x7f49480d2870 2024-09-11T00:23:25.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.198+0000 7f4947e00640 1 -- 172.21.15.175:0/4269465261 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f90895e9-8660-42b9-8aba-3f9d4d130b5e", "id": 1} v 0) -- 0x7f49480cfb40 con 0x7f49480d2870 2024-09-11T00:23:25.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.202+0000 7f493f400640 1 -- 172.21.15.175:0/4269465261 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f90895e9-8660-42b9-8aba-3f9d4d130b5e", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f49480cc980 con 0x7f49480d2870 2024-09-11T00:23:25.204 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-09-11T00:23:25.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.203+0000 7f4947e00640 1 -- 172.21.15.175:0/4269465261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49480d2870 msgr2=0x7f49480b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:25.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.203+0000 7f4947e00640 1 --2- 172.21.15.175:0/4269465261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49480d2870 0x7f49480b2130 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f493800c3d0 tx=0x7f493800c890 comp rx=0 tx=0).stop 2024-09-11T00:23:25.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.203+0000 7f4947e00640 1 -- 172.21.15.175:0/4269465261 shutdown_connections 2024-09-11T00:23:25.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.203+0000 7f4947e00640 1 --2- 172.21.15.175:0/4269465261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f494815dd00 0x7f49480b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.203+0000 7f4947e00640 1 --2- 172.21.15.175:0/4269465261 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49480d46a0 0x7f4948154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.203+0000 7f4947e00640 1 --2- 172.21.15.175:0/4269465261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49480d2870 0x7f49480b2130 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.203+0000 7f4947e00640 1 -- 172.21.15.175:0/4269465261 >> 172.21.15.175:0/4269465261 conn(0x7f49480d3b80 msgr2=0x7f494815b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:25.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.203+0000 7f4947e00640 1 -- 172.21.15.175:0/4269465261 shutdown_connections 2024-09-11T00:23:25.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.203+0000 7f4947e00640 1 -- 172.21.15.175:0/4269465261 wait complete. 2024-09-11T00:23:25.220 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new a190497a-2aba-4748-8f1d-7e372259d65a 2 2024-09-11T00:23:25.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.373+0000 7ff9e7200640 1 -- 172.21.15.175:0/651849699 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9e80d47a0 msgr2=0x7ff9e80d1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:25.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.373+0000 7ff9e7200640 1 --2- 172.21.15.175:0/651849699 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9e80d47a0 0x7ff9e80d1c90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0005fd0 tx=0x7ff9d002a5d0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.373+0000 7ff9e7200640 1 -- 172.21.15.175:0/651849699 shutdown_connections 2024-09-11T00:23:25.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.373+0000 7ff9e7200640 1 --2- 172.21.15.175:0/651849699 >> v2:172.21.15.175:3300/0 conn(0x7ff9e80d21d0 0x7ff9e8160890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.373+0000 7ff9e7200640 1 --2- 172.21.15.175:0/651849699 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9e80d47a0 0x7ff9e80d1c90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.373+0000 7ff9e7200640 1 -- 172.21.15.175:0/651849699 >> 172.21.15.175:0/651849699 conn(0x7ff9e80d3c10 msgr2=0x7ff9e80d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:25.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.373+0000 7ff9e7200640 1 -- 172.21.15.175:0/651849699 shutdown_connections 2024-09-11T00:23:25.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.373+0000 7ff9e7200640 1 -- 172.21.15.175:0/651849699 wait complete. 2024-09-11T00:23:25.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.373+0000 7ff9e7200640 1 Processor -- start 2024-09-11T00:23:25.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.374+0000 7ff9e7200640 1 -- start start 2024-09-11T00:23:25.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.374+0000 7ff9e7200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9e80b5090 0x7ff9e815dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:25.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.376+0000 7ff9e7200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9e80d21d0 0x7ff9e81f8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:25.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.376+0000 7ff9e7200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9e80d47a0 0x7ff9e81e8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:25.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.376+0000 7ff9e7200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e8160f50 con 0x7ff9e80b5090 2024-09-11T00:23:25.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.376+0000 7ff9e7200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e8160dd0 con 0x7ff9e80d21d0 2024-09-11T00:23:25.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.376+0000 7ff9e7200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e81610d0 con 0x7ff9e80d47a0 2024-09-11T00:23:25.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.376+0000 7ff9dfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9e80d21d0 0x7ff9e81f8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:25.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.376+0000 7ff9dfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9e80d21d0 0x7ff9e81f8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59736/0 (socket says 172.21.15.175:59736) 2024-09-11T00:23:25.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.376+0000 7ff9dfe00640 1 -- 172.21.15.175:0/2464410623 learned_addr learned my addr 172.21.15.175:0/2464410623 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T00:23:25.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.376+0000 7ff9e6800640 1 --2- 172.21.15.175:0/2464410623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9e80d47a0 0x7ff9e81e8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:25.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.376+0000 7ff9e5e00640 1 --2- 172.21.15.175:0/2464410623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9e80b5090 0x7ff9e815dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:25.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.376+0000 7ff9dfe00640 1 -- 172.21.15.175:0/2464410623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9e80d47a0 msgr2=0x7ff9e81e8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:25.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.376+0000 7ff9dfe00640 1 --2- 172.21.15.175:0/2464410623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9e80d47a0 0x7ff9e81e8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.376+0000 7ff9dfe00640 1 -- 172.21.15.175:0/2464410623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9e80b5090 msgr2=0x7ff9e815dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:25.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.376+0000 7ff9dfe00640 1 --2- 172.21.15.175:0/2464410623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9e80b5090 0x7ff9e815dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.376+0000 7ff9dfe00640 1 -- 172.21.15.175:0/2464410623 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e80b6ff0 con 0x7ff9e80d21d0 2024-09-11T00:23:25.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.376+0000 7ff9e6800640 1 --2- 172.21.15.175:0/2464410623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9e80d47a0 0x7ff9e81e8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:23:25.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.377+0000 7ff9dfe00640 1 --2- 172.21.15.175:0/2464410623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9e80d21d0 0x7ff9e81f8790 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0034040 tx=0x7ff9d00035f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:25.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.377+0000 7ff9de000640 1 -- 172.21.15.175:0/2464410623 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d003e030 con 0x7ff9e80d21d0 2024-09-11T00:23:25.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.377+0000 7ff9de000640 1 -- 172.21.15.175:0/2464410623 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9d0003ae0 con 0x7ff9e80d21d0 2024-09-11T00:23:25.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.377+0000 7ff9de000640 1 -- 172.21.15.175:0/2464410623 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0035040 con 0x7ff9e80d21d0 2024-09-11T00:23:25.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.377+0000 7ff9e7200640 1 -- 172.21.15.175:0/2464410623 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e81f8cd0 con 0x7ff9e80d21d0 2024-09-11T00:23:25.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.377+0000 7ff9e7200640 1 -- 172.21.15.175:0/2464410623 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e80cbed0 con 0x7ff9e80d21d0 2024-09-11T00:23:25.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.377+0000 7ff9de000640 1 -- 172.21.15.175:0/2464410623 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7ff9d00437a0 con 0x7ff9e80d21d0 2024-09-11T00:23:25.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.377+0000 7ff9de000640 1 -- 172.21.15.175:0/2464410623 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7ff9d0031400 con 0x7ff9e80d21d0 2024-09-11T00:23:25.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.378+0000 7ff9e7200640 1 -- 172.21.15.175:0/2464410623 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e806cc80 con 0x7ff9e80d21d0 2024-09-11T00:23:25.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.380+0000 7ff9de000640 1 -- 172.21.15.175:0/2464410623 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7ff9e806cc80 con 0x7ff9e80d21d0 2024-09-11T00:23:25.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.454+0000 7ff9e7200640 1 -- 172.21.15.175:0/2464410623 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a190497a-2aba-4748-8f1d-7e372259d65a", "id": 2} v 0) -- 0x7ff9e80b4370 con 0x7ff9e80d21d0 2024-09-11T00:23:25.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.459+0000 7ff9de000640 1 -- 172.21.15.175:0/2464410623 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a190497a-2aba-4748-8f1d-7e372259d65a", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7ff9e80b4370 con 0x7ff9e80d21d0 2024-09-11T00:23:25.460 INFO:teuthology.orchestra.run.smithi175.stdout:2 2024-09-11T00:23:25.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.460+0000 7ff9e7200640 1 -- 172.21.15.175:0/2464410623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9e80d21d0 msgr2=0x7ff9e81f8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:25.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.460+0000 7ff9e7200640 1 --2- 172.21.15.175:0/2464410623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9e80d21d0 0x7ff9e81f8790 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0034040 tx=0x7ff9d00035f0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.460+0000 7ff9e7200640 1 -- 172.21.15.175:0/2464410623 shutdown_connections 2024-09-11T00:23:25.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.460+0000 7ff9e7200640 1 --2- 172.21.15.175:0/2464410623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9e80d47a0 0x7ff9e81e8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.460+0000 7ff9e7200640 1 --2- 172.21.15.175:0/2464410623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9e80d21d0 0x7ff9e81f8790 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.460+0000 7ff9e7200640 1 --2- 172.21.15.175:0/2464410623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9e80b5090 0x7ff9e815dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.460+0000 7ff9e7200640 1 -- 172.21.15.175:0/2464410623 >> 172.21.15.175:0/2464410623 conn(0x7ff9e80d3c10 msgr2=0x7ff9e80b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:25.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.460+0000 7ff9e7200640 1 -- 172.21.15.175:0/2464410623 shutdown_connections 2024-09-11T00:23:25.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.460+0000 7ff9e7200640 1 -- 172.21.15.175:0/2464410623 wait complete. 2024-09-11T00:23:25.475 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 8be32ced-898a-46f2-b850-1517667766b9 3 2024-09-11T00:23:25.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.630+0000 7ff9eaa00640 1 -- 172.21.15.175:0/1331946676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9e40d0fe0 msgr2=0x7ff9e40d1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:25.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.630+0000 7ff9eaa00640 1 --2- 172.21.15.175:0/1331946676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9e40d0fe0 0x7ff9e40d1c90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009830 tx=0x7ff9d002a510 comp rx=0 tx=0).stop 2024-09-11T00:23:25.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.630+0000 7ff9eaa00640 1 -- 172.21.15.175:0/1331946676 shutdown_connections 2024-09-11T00:23:25.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.630+0000 7ff9eaa00640 1 --2- 172.21.15.175:0/1331946676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9e40d0fe0 0x7ff9e40d1c90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.630+0000 7ff9eaa00640 1 --2- 172.21.15.175:0/1331946676 >> v2:172.21.15.175:3300/0 conn(0x7ff9e40b5090 0x7ff9e40d47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.630+0000 7ff9eaa00640 1 -- 172.21.15.175:0/1331946676 >> 172.21.15.175:0/1331946676 conn(0x7ff9e40d3c10 msgr2=0x7ff9e40d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:25.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.630+0000 7ff9eaa00640 1 -- 172.21.15.175:0/1331946676 shutdown_connections 2024-09-11T00:23:25.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.630+0000 7ff9eaa00640 1 -- 172.21.15.175:0/1331946676 wait complete. 2024-09-11T00:23:25.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.632+0000 7ff9eaa00640 1 Processor -- start 2024-09-11T00:23:25.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.632+0000 7ff9eaa00640 1 -- start start 2024-09-11T00:23:25.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.633+0000 7ff9eaa00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9e40b5090 0x7ff9e40c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:25.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.633+0000 7ff9eaa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9e40d0fe0 0x7ff9e41f5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:25.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.633+0000 7ff9eaa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9e40d21d0 0x7ff9e4153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:25.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.633+0000 7ff9eaa00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e40d15a0 con 0x7ff9e40d21d0 2024-09-11T00:23:25.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.633+0000 7ff9eaa00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e40d1420 con 0x7ff9e40d0fe0 2024-09-11T00:23:25.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.633+0000 7ff9eaa00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e4160fa0 con 0x7ff9e40b5090 2024-09-11T00:23:25.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.633+0000 7ff9e9600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9e40b5090 0x7ff9e40c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:25.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.633+0000 7ff9e8c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9e40d0fe0 0x7ff9e41f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:25.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.633+0000 7ff9e9600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9e40b5090 0x7ff9e40c9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:57002/0 (socket says 172.21.15.175:57002) 2024-09-11T00:23:25.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.633+0000 7ff9e9600640 1 -- 172.21.15.175:0/2144837013 learned_addr learned my addr 172.21.15.175:0/2144837013 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T00:23:25.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.633+0000 7ff9ea000640 1 --2- 172.21.15.175:0/2144837013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9e40d21d0 0x7ff9e4153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:25.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.634+0000 7ff9e8c00640 1 -- 172.21.15.175:0/2144837013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9e40b5090 msgr2=0x7ff9e40c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:25.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.634+0000 7ff9e8c00640 1 --2- 172.21.15.175:0/2144837013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9e40b5090 0x7ff9e40c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.634+0000 7ff9e8c00640 1 -- 172.21.15.175:0/2144837013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9e40d21d0 msgr2=0x7ff9e4153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:25.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.634+0000 7ff9e8c00640 1 --2- 172.21.15.175:0/2144837013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9e40d21d0 0x7ff9e4153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.634+0000 7ff9e8c00640 1 -- 172.21.15.175:0/2144837013 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e41f59b0 con 0x7ff9e40d0fe0 2024-09-11T00:23:25.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.634+0000 7ff9e9600640 1 --2- 172.21.15.175:0/2144837013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9e40b5090 0x7ff9e40c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:23:25.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.634+0000 7ff9e8c00640 1 --2- 172.21.15.175:0/2144837013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9e40d0fe0 0x7ff9e41f5470 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff9e40b4700 tx=0x7ff9d0032b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:25.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.634+0000 7ff9e1600640 1 -- 172.21.15.175:0/2144837013 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0040070 con 0x7ff9e40d0fe0 2024-09-11T00:23:25.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.634+0000 7ff9e1600640 1 -- 172.21.15.175:0/2144837013 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9d0003900 con 0x7ff9e40d0fe0 2024-09-11T00:23:25.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.634+0000 7ff9e1600640 1 -- 172.21.15.175:0/2144837013 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0003d50 con 0x7ff9e40d0fe0 2024-09-11T00:23:25.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.634+0000 7ff9eaa00640 1 -- 172.21.15.175:0/2144837013 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e40ca5c0 con 0x7ff9e40d0fe0 2024-09-11T00:23:25.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.635+0000 7ff9eaa00640 1 -- 172.21.15.175:0/2144837013 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e40cafc0 con 0x7ff9e40d0fe0 2024-09-11T00:23:25.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.635+0000 7ff9e1600640 1 -- 172.21.15.175:0/2144837013 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7ff9d0045460 con 0x7ff9e40d0fe0 2024-09-11T00:23:25.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.635+0000 7ff9e1600640 1 -- 172.21.15.175:0/2144837013 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7ff9d0045c10 con 0x7ff9e40d0fe0 2024-09-11T00:23:25.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.636+0000 7ff9eaa00640 1 -- 172.21.15.175:0/2144837013 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e4161470 con 0x7ff9e40d0fe0 2024-09-11T00:23:25.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.638+0000 7ff9e1600640 1 -- 172.21.15.175:0/2144837013 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7ff9d0045780 con 0x7ff9e40d0fe0 2024-09-11T00:23:25.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.711+0000 7ff9eaa00640 1 -- 172.21.15.175:0/2144837013 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8be32ced-898a-46f2-b850-1517667766b9", "id": 3} v 0) -- 0x7ff9e40d0400 con 0x7ff9e40d0fe0 2024-09-11T00:23:25.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.715+0000 7ff9e1600640 1 -- 172.21.15.175:0/2144837013 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8be32ced-898a-46f2-b850-1517667766b9", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7ff9d0045a00 con 0x7ff9e40d0fe0 2024-09-11T00:23:25.717 INFO:teuthology.orchestra.run.smithi175.stdout:3 2024-09-11T00:23:25.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.716+0000 7ff9eaa00640 1 -- 172.21.15.175:0/2144837013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9e40d0fe0 msgr2=0x7ff9e41f5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:25.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.717+0000 7ff9eaa00640 1 --2- 172.21.15.175:0/2144837013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9e40d0fe0 0x7ff9e41f5470 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff9e40b4700 tx=0x7ff9d0032b90 comp rx=0 tx=0).stop 2024-09-11T00:23:25.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.717+0000 7ff9eaa00640 1 -- 172.21.15.175:0/2144837013 shutdown_connections 2024-09-11T00:23:25.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.717+0000 7ff9eaa00640 1 --2- 172.21.15.175:0/2144837013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9e40d21d0 0x7ff9e4153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.717+0000 7ff9eaa00640 1 --2- 172.21.15.175:0/2144837013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9e40d0fe0 0x7ff9e41f5470 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.717+0000 7ff9eaa00640 1 --2- 172.21.15.175:0/2144837013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9e40b5090 0x7ff9e40c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.717+0000 7ff9eaa00640 1 -- 172.21.15.175:0/2144837013 >> 172.21.15.175:0/2144837013 conn(0x7ff9e40d3c10 msgr2=0x7ff9e40b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:25.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.717+0000 7ff9eaa00640 1 -- 172.21.15.175:0/2144837013 shutdown_connections 2024-09-11T00:23:25.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.717+0000 7ff9eaa00640 1 -- 172.21.15.175:0/2144837013 wait complete. 2024-09-11T00:23:25.733 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 9867fdfc-6f93-466e-b768-b5a1da7157de 4 2024-09-11T00:23:25.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.886+0000 7fe6a0e00640 1 -- 172.21.15.175:0/3678251638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c0b5090 msgr2=0x7fe69c0d47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:25.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.886+0000 7fe6a0e00640 1 --2- 172.21.15.175:0/3678251638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c0b5090 0x7fe69c0d47a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe69c06cec0 tx=0x7fe68c02a5f0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.886+0000 7fe6a0e00640 1 -- 172.21.15.175:0/3678251638 shutdown_connections 2024-09-11T00:23:25.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.886+0000 7fe6a0e00640 1 --2- 172.21.15.175:0/3678251638 >> v2:172.21.15.40:3300/0 conn(0x7fe69c0d0fe0 0x7fe69c0d1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.886+0000 7fe6a0e00640 1 --2- 172.21.15.175:0/3678251638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c0b5090 0x7fe69c0d47a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.886+0000 7fe6a0e00640 1 -- 172.21.15.175:0/3678251638 >> 172.21.15.175:0/3678251638 conn(0x7fe69c0d3c10 msgr2=0x7fe69c0d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:25.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.886+0000 7fe6a0e00640 1 -- 172.21.15.175:0/3678251638 shutdown_connections 2024-09-11T00:23:25.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.886+0000 7fe6a0e00640 1 -- 172.21.15.175:0/3678251638 wait complete. 2024-09-11T00:23:25.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.888+0000 7fe6a0e00640 1 Processor -- start 2024-09-11T00:23:25.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.888+0000 7fe6a0e00640 1 -- start start 2024-09-11T00:23:25.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.889+0000 7fe6a0e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c0b5090 0x7fe69c15cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:25.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.889+0000 7fe6a0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69c0d0fe0 0x7fe69c15fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:25.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.889+0000 7fe6a0e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe69c0d21d0 0x7fe69c0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:25.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.889+0000 7fe6a0e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe69c0cf960 con 0x7fe69c0d0fe0 2024-09-11T00:23:25.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.889+0000 7fe6a0e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe69c160fa0 con 0x7fe69c0b5090 2024-09-11T00:23:25.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.889+0000 7fe6a0e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe69c15f3a0 con 0x7fe69c0d21d0 2024-09-11T00:23:25.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.889+0000 7fe69b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c0b5090 0x7fe69c15cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:25.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.889+0000 7fe69b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c0b5090 0x7fe69c15cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59780/0 (socket says 172.21.15.175:59780) 2024-09-11T00:23:25.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.889+0000 7fe69b400640 1 -- 172.21.15.175:0/4248012273 learned_addr learned my addr 172.21.15.175:0/4248012273 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T00:23:25.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.889+0000 7fe69be00640 1 --2- 172.21.15.175:0/4248012273 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe69c0d21d0 0x7fe69c0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:25.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.889+0000 7fe69aa00640 1 --2- 172.21.15.175:0/4248012273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69c0d0fe0 0x7fe69c15fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:25.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.889+0000 7fe69b400640 1 -- 172.21.15.175:0/4248012273 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe69c0d21d0 msgr2=0x7fe69c0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:25.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.889+0000 7fe69b400640 1 --2- 172.21.15.175:0/4248012273 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe69c0d21d0 0x7fe69c0cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.889+0000 7fe69b400640 1 -- 172.21.15.175:0/4248012273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69c0d0fe0 msgr2=0x7fe69c15fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:25.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.889+0000 7fe69b400640 1 --2- 172.21.15.175:0/4248012273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69c0d0fe0 0x7fe69c15fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.889+0000 7fe69b400640 1 -- 172.21.15.175:0/4248012273 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe69c15d430 con 0x7fe69c0b5090 2024-09-11T00:23:25.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.890+0000 7fe69b400640 1 --2- 172.21.15.175:0/4248012273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c0b5090 0x7fe69c15cda0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe68c009850 tx=0x7fe68c003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:25.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.890+0000 7fe693400640 1 -- 172.21.15.175:0/4248012273 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c03f070 con 0x7fe69c0b5090 2024-09-11T00:23:25.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.890+0000 7fe693400640 1 -- 172.21.15.175:0/4248012273 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe68c0047a0 con 0x7fe69c0b5090 2024-09-11T00:23:25.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.890+0000 7fe6a0e00640 1 -- 172.21.15.175:0/4248012273 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe69c0b2790 con 0x7fe69c0b5090 2024-09-11T00:23:25.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.890+0000 7fe693400640 1 -- 172.21.15.175:0/4248012273 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c035030 con 0x7fe69c0b5090 2024-09-11T00:23:25.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.890+0000 7fe6a0e00640 1 -- 172.21.15.175:0/4248012273 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe69c0b2020 con 0x7fe69c0b5090 2024-09-11T00:23:25.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.890+0000 7fe693400640 1 -- 172.21.15.175:0/4248012273 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fe68c004bb0 con 0x7fe69c0b5090 2024-09-11T00:23:25.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.891+0000 7fe693400640 1 -- 172.21.15.175:0/4248012273 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fe68c03b460 con 0x7fe69c0b5090 2024-09-11T00:23:25.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.891+0000 7fe6a0e00640 1 -- 172.21.15.175:0/4248012273 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe69c161430 con 0x7fe69c0b5090 2024-09-11T00:23:25.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.893+0000 7fe693400640 1 -- 172.21.15.175:0/4248012273 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fe69c15d430 con 0x7fe69c0b5090 2024-09-11T00:23:25.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.967+0000 7fe6a0e00640 1 -- 172.21.15.175:0/4248012273 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9867fdfc-6f93-466e-b768-b5a1da7157de", "id": 4} v 0) -- 0x7fe69c0d0400 con 0x7fe69c0b5090 2024-09-11T00:23:25.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.972+0000 7fe693400640 1 -- 172.21.15.175:0/4248012273 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9867fdfc-6f93-466e-b768-b5a1da7157de", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fe68c004ed0 con 0x7fe69c0b5090 2024-09-11T00:23:25.974 INFO:teuthology.orchestra.run.smithi175.stdout:4 2024-09-11T00:23:25.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.973+0000 7fe6a0e00640 1 -- 172.21.15.175:0/4248012273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c0b5090 msgr2=0x7fe69c15cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:25.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.973+0000 7fe6a0e00640 1 --2- 172.21.15.175:0/4248012273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c0b5090 0x7fe69c15cda0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe68c009850 tx=0x7fe68c003820 comp rx=0 tx=0).stop 2024-09-11T00:23:25.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.973+0000 7fe6a0e00640 1 -- 172.21.15.175:0/4248012273 shutdown_connections 2024-09-11T00:23:25.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.973+0000 7fe6a0e00640 1 --2- 172.21.15.175:0/4248012273 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe69c0d21d0 0x7fe69c0cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.973+0000 7fe6a0e00640 1 --2- 172.21.15.175:0/4248012273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69c0d0fe0 0x7fe69c15fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.973+0000 7fe6a0e00640 1 --2- 172.21.15.175:0/4248012273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c0b5090 0x7fe69c15cda0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:25.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.973+0000 7fe6a0e00640 1 -- 172.21.15.175:0/4248012273 >> 172.21.15.175:0/4248012273 conn(0x7fe69c0d3c10 msgr2=0x7fe69c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:25.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.973+0000 7fe6a0e00640 1 -- 172.21.15.175:0/4248012273 shutdown_connections 2024-09-11T00:23:25.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:25.974+0000 7fe6a0e00640 1 -- 172.21.15.175:0/4248012273 wait complete. 2024-09-11T00:23:25.989 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new e2f6f616-b5db-466e-942f-e2762171a8ad 5 2024-09-11T00:23:26.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.141+0000 7f3911000640 1 -- 172.21.15.175:0/1360786784 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c0d46a0 msgr2=0x7f390c0cecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:26.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.141+0000 7f3911000640 1 --2- 172.21.15.175:0/1360786784 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c0d46a0 0x7f390c0cecb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3904005fd0 tx=0x7f390402a930 comp rx=0 tx=0).stop 2024-09-11T00:23:26.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.141+0000 7f3911000640 1 -- 172.21.15.175:0/1360786784 shutdown_connections 2024-09-11T00:23:26.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.141+0000 7f3911000640 1 --2- 172.21.15.175:0/1360786784 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c0d46a0 0x7f390c0cecb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.141+0000 7f3911000640 1 --2- 172.21.15.175:0/1360786784 >> v2:172.21.15.175:3300/0 conn(0x7f390c0d2870 0x7f390c0d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.141+0000 7f3911000640 1 -- 172.21.15.175:0/1360786784 >> 172.21.15.175:0/1360786784 conn(0x7f390c0d3b80 msgr2=0x7f390c0d3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:26.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.141+0000 7f3911000640 1 -- 172.21.15.175:0/1360786784 shutdown_connections 2024-09-11T00:23:26.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.141+0000 7f3911000640 1 -- 172.21.15.175:0/1360786784 wait complete. 2024-09-11T00:23:26.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.142+0000 7f3911000640 1 Processor -- start 2024-09-11T00:23:26.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.143+0000 7f3911000640 1 -- start start 2024-09-11T00:23:26.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.143+0000 7f3911000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f390c0d2870 0x7f390c0a1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:26.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.143+0000 7f3911000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c0d46a0 0x7f390c0cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:26.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.143+0000 7f3911000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f390c15dd00 0x7f390c0c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:26.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.143+0000 7f3911000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f390c0cf1f0 con 0x7f390c0d2870 2024-09-11T00:23:26.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.143+0000 7f3911000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f390c0cf370 con 0x7f390c15dd00 2024-09-11T00:23:26.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.143+0000 7f3911000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f390c0cf4f0 con 0x7f390c0d46a0 2024-09-11T00:23:26.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.144+0000 7f390be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f390c15dd00 0x7f390c0c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:26.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.144+0000 7f390aa00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c0d46a0 0x7f390c0cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:26.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.144+0000 7f390be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f390c15dd00 0x7f390c0c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59808/0 (socket says 172.21.15.175:59808) 2024-09-11T00:23:26.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.144+0000 7f390be00640 1 -- 172.21.15.175:0/2257874063 learned_addr learned my addr 172.21.15.175:0/2257874063 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T00:23:26.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.144+0000 7f390b400640 1 --2- 172.21.15.175:0/2257874063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f390c0d2870 0x7f390c0a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:26.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.144+0000 7f390aa00640 1 -- 172.21.15.175:0/2257874063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f390c15dd00 msgr2=0x7f390c0c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:26.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.144+0000 7f390aa00640 1 --2- 172.21.15.175:0/2257874063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f390c15dd00 0x7f390c0c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.144+0000 7f390aa00640 1 -- 172.21.15.175:0/2257874063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f390c0d2870 msgr2=0x7f390c0a1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:26.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.144+0000 7f390aa00640 1 --2- 172.21.15.175:0/2257874063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f390c0d2870 0x7f390c0a1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.144+0000 7f390aa00640 1 -- 172.21.15.175:0/2257874063 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390c0c7750 con 0x7f390c0d46a0 2024-09-11T00:23:26.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.144+0000 7f390aa00640 1 --2- 172.21.15.175:0/2257874063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c0d46a0 0x7f390c0cbac0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f38f800e790 tx=0x7f38f800ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:26.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.145+0000 7f3903400640 1 -- 172.21.15.175:0/2257874063 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f800eea0 con 0x7f390c0d46a0 2024-09-11T00:23:26.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.145+0000 7f3903400640 1 -- 172.21.15.175:0/2257874063 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38f800cdb0 con 0x7f390c0d46a0 2024-09-11T00:23:26.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.145+0000 7f3903400640 1 -- 172.21.15.175:0/2257874063 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f8010690 con 0x7f390c0d46a0 2024-09-11T00:23:26.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.145+0000 7f3911000640 1 -- 172.21.15.175:0/2257874063 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f390c0cc4d0 con 0x7f390c0d46a0 2024-09-11T00:23:26.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.145+0000 7f3911000640 1 -- 172.21.15.175:0/2257874063 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f390c0cca90 con 0x7f390c0d46a0 2024-09-11T00:23:26.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.145+0000 7f3903400640 1 -- 172.21.15.175:0/2257874063 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f38f8010830 con 0x7f390c0d46a0 2024-09-11T00:23:26.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.145+0000 7f3903400640 1 -- 172.21.15.175:0/2257874063 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f38f8018c40 con 0x7f390c0d46a0 2024-09-11T00:23:26.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.146+0000 7f3911000640 1 -- 172.21.15.175:0/2257874063 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f390c0cfa10 con 0x7f390c0d46a0 2024-09-11T00:23:26.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.148+0000 7f3903400640 1 -- 172.21.15.175:0/2257874063 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f38f8010b50 con 0x7f390c0d46a0 2024-09-11T00:23:26.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.222+0000 7f3911000640 1 -- 172.21.15.175:0/2257874063 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e2f6f616-b5db-466e-942f-e2762171a8ad", "id": 5} v 0) -- 0x7f390c0b9b00 con 0x7f390c0d46a0 2024-09-11T00:23:26.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.226+0000 7f3903400640 1 -- 172.21.15.175:0/2257874063 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e2f6f616-b5db-466e-942f-e2762171a8ad", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f38f8010d30 con 0x7f390c0d46a0 2024-09-11T00:23:26.227 INFO:teuthology.orchestra.run.smithi175.stdout:5 2024-09-11T00:23:26.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.227+0000 7f3911000640 1 -- 172.21.15.175:0/2257874063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c0d46a0 msgr2=0x7f390c0cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:26.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.227+0000 7f3911000640 1 --2- 172.21.15.175:0/2257874063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c0d46a0 0x7f390c0cbac0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f38f800e790 tx=0x7f38f800ec50 comp rx=0 tx=0).stop 2024-09-11T00:23:26.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.227+0000 7f3911000640 1 -- 172.21.15.175:0/2257874063 shutdown_connections 2024-09-11T00:23:26.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.227+0000 7f3911000640 1 --2- 172.21.15.175:0/2257874063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f390c15dd00 0x7f390c0c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.227+0000 7f3911000640 1 --2- 172.21.15.175:0/2257874063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390c0d46a0 0x7f390c0cbac0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.227+0000 7f3911000640 1 --2- 172.21.15.175:0/2257874063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f390c0d2870 0x7f390c0a1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.227+0000 7f3911000640 1 -- 172.21.15.175:0/2257874063 >> 172.21.15.175:0/2257874063 conn(0x7f390c0d3b80 msgr2=0x7f390c15cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:26.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.227+0000 7f3911000640 1 -- 172.21.15.175:0/2257874063 shutdown_connections 2024-09-11T00:23:26.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.227+0000 7f3911000640 1 -- 172.21.15.175:0/2257874063 wait complete. 2024-09-11T00:23:26.243 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 807ac045-bf63-4ff6-9a06-7f7022f9ef32 6 2024-09-11T00:23:26.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.396+0000 7f5b43e00640 1 -- 172.21.15.175:0/2465507509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b440d46a0 msgr2=0x7f5b440d2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:26.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.396+0000 7f5b43e00640 1 --2- 172.21.15.175:0/2465507509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b440d46a0 0x7f5b440d2160 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009830 tx=0x7f5b2c02a5a0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.396+0000 7f5b43e00640 1 -- 172.21.15.175:0/2465507509 shutdown_connections 2024-09-11T00:23:26.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.396+0000 7f5b43e00640 1 --2- 172.21.15.175:0/2465507509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b440d46a0 0x7f5b440d2160 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.396+0000 7f5b43e00640 1 --2- 172.21.15.175:0/2465507509 >> v2:172.21.15.40:3300/0 conn(0x7f5b4415dd00 0x7f5b440d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.396+0000 7f5b43e00640 1 -- 172.21.15.175:0/2465507509 >> 172.21.15.175:0/2465507509 conn(0x7f5b440d3b80 msgr2=0x7f5b440d3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:26.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.396+0000 7f5b43e00640 1 -- 172.21.15.175:0/2465507509 shutdown_connections 2024-09-11T00:23:26.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.396+0000 7f5b43e00640 1 -- 172.21.15.175:0/2465507509 wait complete. 2024-09-11T00:23:26.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.398+0000 7f5b43e00640 1 Processor -- start 2024-09-11T00:23:26.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.398+0000 7f5b43e00640 1 -- start start 2024-09-11T00:23:26.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.399+0000 7f5b43e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b440d26a0 0x7f5b4415baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:26.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.399+0000 7f5b43e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b440d46a0 0x7f5b4415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:26.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.399+0000 7f5b43e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b4415dd00 0x7f5b441f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:26.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.399+0000 7f5b43e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4406d140 con 0x7f5b440d46a0 2024-09-11T00:23:26.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.399+0000 7f5b43e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4406cfc0 con 0x7f5b4415dd00 2024-09-11T00:23:26.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.399+0000 7f5b43e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5b44161ef0 con 0x7f5b440d26a0 2024-09-11T00:23:26.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.399+0000 7f5b42a00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b440d26a0 0x7f5b4415baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:26.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.399+0000 7f5b42a00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b440d26a0 0x7f5b4415baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:57066/0 (socket says 172.21.15.175:57066) 2024-09-11T00:23:26.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.399+0000 7f5b42a00640 1 -- 172.21.15.175:0/2579145343 learned_addr learned my addr 172.21.15.175:0/2579145343 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T00:23:26.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.399+0000 7f5b3be00640 1 --2- 172.21.15.175:0/2579145343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b440d46a0 0x7f5b4415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:26.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.399+0000 7f5b43400640 1 --2- 172.21.15.175:0/2579145343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b4415dd00 0x7f5b441f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:26.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.399+0000 7f5b42a00640 1 -- 172.21.15.175:0/2579145343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b4415dd00 msgr2=0x7f5b441f46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:26.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.399+0000 7f5b42a00640 1 --2- 172.21.15.175:0/2579145343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b4415dd00 0x7f5b441f46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.400+0000 7f5b42a00640 1 -- 172.21.15.175:0/2579145343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b440d46a0 msgr2=0x7f5b4415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:26.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.400+0000 7f5b42a00640 1 --2- 172.21.15.175:0/2579145343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b440d46a0 0x7f5b4415ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.400+0000 7f5b42a00640 1 -- 172.21.15.175:0/2579145343 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b441f5110 con 0x7f5b440d26a0 2024-09-11T00:23:26.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.400+0000 7f5b3be00640 1 --2- 172.21.15.175:0/2579145343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b440d46a0 0x7f5b4415ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:23:26.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.400+0000 7f5b42a00640 1 --2- 172.21.15.175:0/2579145343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b440d26a0 0x7f5b4415baf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5b3400e7c0 tx=0x7f5b3400ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:26.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.400+0000 7f5b3aa00640 1 -- 172.21.15.175:0/2579145343 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3400ccc0 con 0x7f5b440d26a0 2024-09-11T00:23:26.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.400+0000 7f5b3aa00640 1 -- 172.21.15.175:0/2579145343 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b34010430 con 0x7f5b440d26a0 2024-09-11T00:23:26.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.400+0000 7f5b3aa00640 1 -- 172.21.15.175:0/2579145343 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b34010860 con 0x7f5b440d26a0 2024-09-11T00:23:26.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.400+0000 7f5b43e00640 1 -- 172.21.15.175:0/2579145343 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b441f53f0 con 0x7f5b440d26a0 2024-09-11T00:23:26.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.400+0000 7f5b43e00640 1 -- 172.21.15.175:0/2579145343 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b4415e760 con 0x7f5b440d26a0 2024-09-11T00:23:26.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.400+0000 7f5b3aa00640 1 -- 172.21.15.175:0/2579145343 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f5b34010a00 con 0x7f5b440d26a0 2024-09-11T00:23:26.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.401+0000 7f5b3aa00640 1 -- 172.21.15.175:0/2579145343 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f5b34010d20 con 0x7f5b440d26a0 2024-09-11T00:23:26.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.401+0000 7f5b43e00640 1 -- 172.21.15.175:0/2579145343 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b441f5630 con 0x7f5b440d26a0 2024-09-11T00:23:26.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.403+0000 7f5b3aa00640 1 -- 172.21.15.175:0/2579145343 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f5b441f5630 con 0x7f5b440d26a0 2024-09-11T00:23:26.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.477+0000 7f5b43e00640 1 -- 172.21.15.175:0/2579145343 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "807ac045-bf63-4ff6-9a06-7f7022f9ef32", "id": 6} v 0) -- 0x7f5b44162340 con 0x7f5b440d26a0 2024-09-11T00:23:26.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.481+0000 7f5b3aa00640 1 -- 172.21.15.175:0/2579145343 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "807ac045-bf63-4ff6-9a06-7f7022f9ef32", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f5b34018c40 con 0x7f5b440d26a0 2024-09-11T00:23:26.482 INFO:teuthology.orchestra.run.smithi175.stdout:6 2024-09-11T00:23:26.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.482+0000 7f5b43e00640 1 -- 172.21.15.175:0/2579145343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b440d26a0 msgr2=0x7f5b4415baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:26.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.482+0000 7f5b43e00640 1 --2- 172.21.15.175:0/2579145343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b440d26a0 0x7f5b4415baf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5b3400e7c0 tx=0x7f5b3400ec80 comp rx=0 tx=0).stop 2024-09-11T00:23:26.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.482+0000 7f5b43e00640 1 -- 172.21.15.175:0/2579145343 shutdown_connections 2024-09-11T00:23:26.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.482+0000 7f5b43e00640 1 --2- 172.21.15.175:0/2579145343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b4415dd00 0x7f5b441f46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.482+0000 7f5b43e00640 1 --2- 172.21.15.175:0/2579145343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b440d46a0 0x7f5b4415ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.482+0000 7f5b43e00640 1 --2- 172.21.15.175:0/2579145343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b440d26a0 0x7f5b4415baf0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.482+0000 7f5b43e00640 1 -- 172.21.15.175:0/2579145343 >> 172.21.15.175:0/2579145343 conn(0x7f5b440d3b80 msgr2=0x7f5b440b80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:26.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.482+0000 7f5b43e00640 1 -- 172.21.15.175:0/2579145343 shutdown_connections 2024-09-11T00:23:26.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.482+0000 7f5b43e00640 1 -- 172.21.15.175:0/2579145343 wait complete. 2024-09-11T00:23:26.498 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 8e0b3293-390f-4b43-b29d-babdc5e88f77 7 2024-09-11T00:23:26.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.651+0000 7ff431000640 1 -- 172.21.15.175:0/4143929779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff42c15bcc0 msgr2=0x7ff42c0cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:26.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.651+0000 7ff431000640 1 --2- 172.21.15.175:0/4143929779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff42c15bcc0 0x7ff42c0cb420 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff41c005fd0 tx=0x7ff41c02a5d0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.651+0000 7ff431000640 1 -- 172.21.15.175:0/4143929779 shutdown_connections 2024-09-11T00:23:26.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.651+0000 7ff431000640 1 --2- 172.21.15.175:0/4143929779 >> v2:172.21.15.175:3300/0 conn(0x7ff42c0cba70 0x7ff42c0cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.651+0000 7ff431000640 1 --2- 172.21.15.175:0/4143929779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff42c15bcc0 0x7ff42c0cb420 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.651+0000 7ff431000640 1 -- 172.21.15.175:0/4143929779 >> 172.21.15.175:0/4143929779 conn(0x7ff42c0cfbb0 msgr2=0x7ff42c0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:26.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.651+0000 7ff431000640 1 -- 172.21.15.175:0/4143929779 shutdown_connections 2024-09-11T00:23:26.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.651+0000 7ff431000640 1 -- 172.21.15.175:0/4143929779 wait complete. 2024-09-11T00:23:26.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.653+0000 7ff431000640 1 Processor -- start 2024-09-11T00:23:26.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.653+0000 7ff431000640 1 -- start start 2024-09-11T00:23:26.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.654+0000 7ff431000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff42c0ca200 0x7ff42c14d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:26.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.654+0000 7ff431000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff42c0cba70 0x7ff42c0ae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:26.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.654+0000 7ff431000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff42c15bcc0 0x7ff42c0ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:26.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.654+0000 7ff431000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c15f940 con 0x7ff42c0cba70 2024-09-11T00:23:26.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.654+0000 7ff431000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c15f7c0 con 0x7ff42c0ca200 2024-09-11T00:23:26.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.654+0000 7ff431000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff42c0cadc0 con 0x7ff42c15bcc0 2024-09-11T00:23:26.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.654+0000 7ff429e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff42c0ca200 0x7ff42c14d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:26.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.654+0000 7ff42a800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff42c15bcc0 0x7ff42c0ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:26.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.654+0000 7ff429e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff42c0ca200 0x7ff42c14d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59834/0 (socket says 172.21.15.175:59834) 2024-09-11T00:23:26.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.654+0000 7ff429e00640 1 -- 172.21.15.175:0/1080676684 learned_addr learned my addr 172.21.15.175:0/1080676684 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-11T00:23:26.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.654+0000 7ff429400640 1 --2- 172.21.15.175:0/1080676684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff42c0cba70 0x7ff42c0ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:26.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.655+0000 7ff42a800640 1 -- 172.21.15.175:0/1080676684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff42c0ca200 msgr2=0x7ff42c14d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:26.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.655+0000 7ff42a800640 1 --2- 172.21.15.175:0/1080676684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff42c0ca200 0x7ff42c14d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.655+0000 7ff42a800640 1 -- 172.21.15.175:0/1080676684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff42c0cba70 msgr2=0x7ff42c0ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:26.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.655+0000 7ff42a800640 1 --2- 172.21.15.175:0/1080676684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff42c0cba70 0x7ff42c0ae280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.655+0000 7ff42a800640 1 -- 172.21.15.175:0/1080676684 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff42c0c8370 con 0x7ff42c15bcc0 2024-09-11T00:23:26.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.655+0000 7ff429e00640 1 --2- 172.21.15.175:0/1080676684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff42c0ca200 0x7ff42c14d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:23:26.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.655+0000 7ff42a800640 1 --2- 172.21.15.175:0/1080676684 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff42c15bcc0 0x7ff42c0ce340 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff42400c760 tx=0x7ff42400cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:26.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.655+0000 7ff422000640 1 -- 172.21.15.175:0/1080676684 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424003b70 con 0x7ff42c15bcc0 2024-09-11T00:23:26.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.655+0000 7ff422000640 1 -- 172.21.15.175:0/1080676684 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff424003d10 con 0x7ff42c15bcc0 2024-09-11T00:23:26.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.655+0000 7ff422000640 1 -- 172.21.15.175:0/1080676684 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424005330 con 0x7ff42c15bcc0 2024-09-11T00:23:26.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.655+0000 7ff431000640 1 -- 172.21.15.175:0/1080676684 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff42c0aecd0 con 0x7ff42c15bcc0 2024-09-11T00:23:26.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.656+0000 7ff431000640 1 -- 172.21.15.175:0/1080676684 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff42c0cdc50 con 0x7ff42c15bcc0 2024-09-11T00:23:26.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.656+0000 7ff422000640 1 -- 172.21.15.175:0/1080676684 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7ff4240054d0 con 0x7ff42c15bcc0 2024-09-11T00:23:26.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.656+0000 7ff422000640 1 -- 172.21.15.175:0/1080676684 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7ff424012620 con 0x7ff42c15bcc0 2024-09-11T00:23:26.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.657+0000 7ff431000640 1 -- 172.21.15.175:0/1080676684 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff42c06fa00 con 0x7ff42c15bcc0 2024-09-11T00:23:26.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.659+0000 7ff422000640 1 -- 172.21.15.175:0/1080676684 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7ff4240057f0 con 0x7ff42c15bcc0 2024-09-11T00:23:26.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.733+0000 7ff431000640 1 -- 172.21.15.175:0/1080676684 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8e0b3293-390f-4b43-b29d-babdc5e88f77", "id": 7} v 0) -- 0x7ff42c158860 con 0x7ff42c15bcc0 2024-09-11T00:23:26.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.738+0000 7ff422000640 1 -- 172.21.15.175:0/1080676684 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e0b3293-390f-4b43-b29d-babdc5e88f77", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7ff42400a640 con 0x7ff42c15bcc0 2024-09-11T00:23:26.739 INFO:teuthology.orchestra.run.smithi175.stdout:7 2024-09-11T00:23:26.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.739+0000 7ff431000640 1 -- 172.21.15.175:0/1080676684 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff42c15bcc0 msgr2=0x7ff42c0ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:26.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.739+0000 7ff431000640 1 --2- 172.21.15.175:0/1080676684 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff42c15bcc0 0x7ff42c0ce340 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff42400c760 tx=0x7ff42400cc20 comp rx=0 tx=0).stop 2024-09-11T00:23:26.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.739+0000 7ff431000640 1 -- 172.21.15.175:0/1080676684 shutdown_connections 2024-09-11T00:23:26.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.739+0000 7ff431000640 1 --2- 172.21.15.175:0/1080676684 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff42c15bcc0 0x7ff42c0ce340 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.739+0000 7ff431000640 1 --2- 172.21.15.175:0/1080676684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff42c0cba70 0x7ff42c0ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.739+0000 7ff431000640 1 --2- 172.21.15.175:0/1080676684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff42c0ca200 0x7ff42c14d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:26.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.739+0000 7ff431000640 1 -- 172.21.15.175:0/1080676684 >> 172.21.15.175:0/1080676684 conn(0x7ff42c0cfbb0 msgr2=0x7ff42c0b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:26.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.739+0000 7ff431000640 1 -- 172.21.15.175:0/1080676684 shutdown_connections 2024-09-11T00:23:26.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:23:26.739+0000 7ff431000640 1 -- 172.21.15.175:0/1080676684 wait complete. 2024-09-11T00:23:26.754 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-11T00:23:26.754 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-11T00:23:26.758 INFO:tasks.ceph.osd.0:Started 2024-09-11T00:23:26.758 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T00:23:26.759 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-11T00:23:26.762 INFO:tasks.ceph.osd.1:Started 2024-09-11T00:23:26.762 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T00:23:26.762 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-11T00:23:26.767 INFO:tasks.ceph.osd.2:Started 2024-09-11T00:23:26.767 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-11T00:23:26.767 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-11T00:23:26.771 INFO:tasks.ceph.osd.3:Started 2024-09-11T00:23:26.772 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-11T00:23:26.772 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-11T00:23:26.775 INFO:tasks.ceph.osd.4:Started 2024-09-11T00:23:26.776 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-11T00:23:26.776 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-11T00:23:26.779 INFO:tasks.ceph.osd.5:Started 2024-09-11T00:23:26.779 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-11T00:23:26.779 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-11T00:23:26.783 INFO:tasks.ceph.osd.6:Started 2024-09-11T00:23:26.783 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-11T00:23:26.783 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-11T00:23:26.787 INFO:tasks.ceph.osd.7:Started 2024-09-11T00:23:26.788 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:23:27.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.008+0000 7f4cce000640 1 -- 172.21.15.40:0/523033165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc80cc180 msgr2=0x7f4cc80cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:27.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.008+0000 7f4cce000640 1 --2- 172.21.15.40:0/523033165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc80cc180 0x7f4cc80cb420 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009830 tx=0x7f4cb002a5c0 comp rx=0 tx=0).stop 2024-09-11T00:23:27.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.008+0000 7f4cce000640 1 -- 172.21.15.40:0/523033165 shutdown_connections 2024-09-11T00:23:27.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.008+0000 7f4cce000640 1 --2- 172.21.15.40:0/523033165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc80cc180 0x7f4cc80cb420 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:27.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.008+0000 7f4cce000640 1 -- 172.21.15.40:0/523033165 >> 172.21.15.40:0/523033165 conn(0x7f4cc80cfbb0 msgr2=0x7f4cc80cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:27.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.008+0000 7f4cce000640 1 -- 172.21.15.40:0/523033165 shutdown_connections 2024-09-11T00:23:27.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.008+0000 7f4cce000640 1 -- 172.21.15.40:0/523033165 wait complete. 2024-09-11T00:23:27.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.010+0000 7f4cce000640 1 Processor -- start 2024-09-11T00:23:27.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.010+0000 7f4cce000640 1 -- start start 2024-09-11T00:23:27.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.011+0000 7f4cce000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cc806e910 0x7f4cc81f7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:27.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.011+0000 7f4cce000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cc80cc180 0x7f4cc81f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:27.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.011+0000 7f4cce000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc815bcc0 0x7f4cc81f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:27.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.011+0000 7f4cce000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc806f450 con 0x7f4cc80cc180 2024-09-11T00:23:27.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.011+0000 7f4cce000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc815f9d0 con 0x7f4cc815bcc0 2024-09-11T00:23:27.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.011+0000 7f4cce000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc806f5d0 con 0x7f4cc806e910 2024-09-11T00:23:27.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.012+0000 7f4cbea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cc80cc180 0x7f4cc81f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:27.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.012+0000 7f4cbea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cc80cc180 0x7f4cc81f5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60636/0 (socket says 172.21.15.40:60636) 2024-09-11T00:23:27.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.012+0000 7f4cbea00640 1 -- 172.21.15.40:0/3012721261 learned_addr learned my addr 172.21.15.40:0/3012721261 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:27.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.012+0000 7f4cc7400640 1 --2- 172.21.15.40:0/3012721261 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cc806e910 0x7f4cc81f7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:27.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.012+0000 7f4cc7e00640 1 --2- 172.21.15.40:0/3012721261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc815bcc0 0x7f4cc81f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:27.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.012+0000 7f4cbea00640 1 -- 172.21.15.40:0/3012721261 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cc806e910 msgr2=0x7f4cc81f7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:27.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.012+0000 7f4cbea00640 1 --2- 172.21.15.40:0/3012721261 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cc806e910 0x7f4cc81f7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:27.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.012+0000 7f4cbea00640 1 -- 172.21.15.40:0/3012721261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc815bcc0 msgr2=0x7f4cc81f51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:27.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.012+0000 7f4cbea00640 1 --2- 172.21.15.40:0/3012721261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc815bcc0 0x7f4cc81f51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:27.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.012+0000 7f4cbea00640 1 -- 172.21.15.40:0/3012721261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc81f5730 con 0x7f4cc80cc180 2024-09-11T00:23:27.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.012+0000 7f4cbea00640 1 --2- 172.21.15.40:0/3012721261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cc80cc180 0x7f4cc81f5930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009780 tx=0x7f4cb0032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:27.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.013+0000 7f4cbfe00640 1 -- 172.21.15.40:0/3012721261 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0040070 con 0x7f4cc80cc180 2024-09-11T00:23:27.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.013+0000 7f4cbfe00640 1 -- 172.21.15.40:0/3012721261 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cb0005310 con 0x7f4cc80cc180 2024-09-11T00:23:27.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.013+0000 7f4cbfe00640 1 -- 172.21.15.40:0/3012721261 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0005c90 con 0x7f4cc80cc180 2024-09-11T00:23:27.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.013+0000 7f4cce000640 1 -- 172.21.15.40:0/3012721261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc80c39d0 con 0x7f4cc80cc180 2024-09-11T00:23:27.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.013+0000 7f4cce000640 1 -- 172.21.15.40:0/3012721261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc80c3f90 con 0x7f4cc80cc180 2024-09-11T00:23:27.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.013+0000 7f4cbfe00640 1 -- 172.21.15.40:0/3012721261 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f4cb004c030 con 0x7f4cc80cc180 2024-09-11T00:23:27.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.013+0000 7f4cbfe00640 1 -- 172.21.15.40:0/3012721261 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f4cb00035f0 con 0x7f4cc80cc180 2024-09-11T00:23:27.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.014+0000 7f4cce000640 1 -- 172.21.15.40:0/3012721261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc806fa20 con 0x7f4cc80cc180 2024-09-11T00:23:27.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.016+0000 7f4cbfe00640 1 -- 172.21.15.40:0/3012721261 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f4cc81f5730 con 0x7f4cc80cc180 2024-09-11T00:23:27.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.082+0000 7f4cce000640 1 -- 172.21.15.40:0/3012721261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4cc80b1340 con 0x7f4cc80cc180 2024-09-11T00:23:27.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.083+0000 7f4cbfe00640 1 -- 172.21.15.40:0/3012721261 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f4cb0004d40 con 0x7f4cc80cc180 2024-09-11T00:23:27.086 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:23:27.086 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":10,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","created":"2024-09-11T00:23:22.512139+0000","modified":"2024-09-11T00:23:26.734953+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T00:23:26.734953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ee10e123-8817-4d94-a340-73d00121af37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f90895e9-8660-42b9-8aba-3f9d4d130b5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a190497a-2aba-4748-8f1d-7e372259d65a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8be32ced-898a-46f2-b850-1517667766b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9867fdfc-6f93-466e-b768-b5a1da7157de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e2f6f616-b5db-466e-942f-e2762171a8ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"807ac045-bf63-4ff6-9a06-7f7022f9ef32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8e0b3293-390f-4b43-b29d-babdc5e88f77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:23:27.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.084+0000 7f4cce000640 1 -- 172.21.15.40:0/3012721261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cc80cc180 msgr2=0x7f4cc81f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:27.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.084+0000 7f4cce000640 1 --2- 172.21.15.40:0/3012721261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cc80cc180 0x7f4cc81f5930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009780 tx=0x7f4cb0032c10 comp rx=0 tx=0).stop 2024-09-11T00:23:27.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.084+0000 7f4cce000640 1 -- 172.21.15.40:0/3012721261 shutdown_connections 2024-09-11T00:23:27.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.084+0000 7f4cce000640 1 --2- 172.21.15.40:0/3012721261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc815bcc0 0x7f4cc81f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:27.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.084+0000 7f4cce000640 1 --2- 172.21.15.40:0/3012721261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cc80cc180 0x7f4cc81f5930 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:27.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.084+0000 7f4cce000640 1 --2- 172.21.15.40:0/3012721261 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cc806e910 0x7f4cc81f7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:27.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.084+0000 7f4cce000640 1 -- 172.21.15.40:0/3012721261 >> 172.21.15.40:0/3012721261 conn(0x7f4cc80cfbb0 msgr2=0x7f4cc80c9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:27.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.084+0000 7f4cce000640 1 -- 172.21.15.40:0/3012721261 shutdown_connections 2024-09-11T00:23:27.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:27.084+0000 7f4cce000640 1 -- 172.21.15.40:0/3012721261 wait complete. 2024-09-11T00:23:27.102 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-11T00:23:27.102 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-11T00:23:27.909 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T00:23:28.052 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.049+0000 7f65d6200640 1 -- 172.21.15.40:0/398799318 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65d00b5c80 msgr2=0x7f65d00b6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:28.052 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.049+0000 7f65d6200640 1 --2- 172.21.15.40:0/398799318 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65d00b5c80 0x7f65d00b6c20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f65c8005fd0 tx=0x7f65c802a8b0 comp rx=0 tx=0).stop 2024-09-11T00:23:28.053 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.049+0000 7f65d6200640 1 -- 172.21.15.40:0/398799318 shutdown_connections 2024-09-11T00:23:28.053 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.049+0000 7f65d6200640 1 --2- 172.21.15.40:0/398799318 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65d00b5c80 0x7f65d00b6c20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:28.053 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.049+0000 7f65d6200640 1 --2- 172.21.15.40:0/398799318 >> v2:172.21.15.40:3300/0 conn(0x7f65d00b4ab0 0x7f65d00d48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:28.053 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.049+0000 7f65d6200640 1 -- 172.21.15.40:0/398799318 >> 172.21.15.40:0/398799318 conn(0x7f65d00d3dd0 msgr2=0x7f65d00d41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:28.053 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.050+0000 7f65d6200640 1 -- 172.21.15.40:0/398799318 shutdown_connections 2024-09-11T00:23:28.053 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.050+0000 7f65d6200640 1 -- 172.21.15.40:0/398799318 wait complete. 2024-09-11T00:23:28.053 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.051+0000 7f65d6200640 1 Processor -- start 2024-09-11T00:23:28.053 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.051+0000 7f65d6200640 1 -- start start 2024-09-11T00:23:28.055 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.052+0000 7f65d6200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d00b4ab0 0x7f65d01f8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:28.055 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.052+0000 7f65d6200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65d00b5c80 0x7f65d014f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:28.055 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.052+0000 7f65d6200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65d0161420 0x7f65d00ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:28.056 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.052+0000 7f65d6200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f65d00b7160 con 0x7f65d00b4ab0 2024-09-11T00:23:28.056 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.052+0000 7f65d6200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f65d00d2ed0 con 0x7f65d00b5c80 2024-09-11T00:23:28.056 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.052+0000 7f65d6200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f65d00b72e0 con 0x7f65d0161420 2024-09-11T00:23:28.056 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.053+0000 7f65cf400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d00b4ab0 0x7f65d01f8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:28.056 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.053+0000 7f65cfe00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65d0161420 0x7f65d00ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:28.056 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.053+0000 7f65cf400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d00b4ab0 0x7f65d01f8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58874/0 (socket says 172.21.15.40:58874) 2024-09-11T00:23:28.056 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.053+0000 7f65c7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65d00b5c80 0x7f65d014f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:28.056 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.053+0000 7f65cf400640 1 -- 172.21.15.40:0/2443432738 learned_addr learned my addr 172.21.15.40:0/2443432738 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:28.056 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.053+0000 7f65cf400640 1 -- 172.21.15.40:0/2443432738 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65d0161420 msgr2=0x7f65d00ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:28.056 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.053+0000 7f65cf400640 1 --2- 172.21.15.40:0/2443432738 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65d0161420 0x7f65d00ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:28.056 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.053+0000 7f65cf400640 1 -- 172.21.15.40:0/2443432738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65d00b5c80 msgr2=0x7f65d014f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:28.056 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.053+0000 7f65cf400640 1 --2- 172.21.15.40:0/2443432738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65d00b5c80 0x7f65d014f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:28.057 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.053+0000 7f65cf400640 1 -- 172.21.15.40:0/2443432738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d00cd900 con 0x7f65d00b4ab0 2024-09-11T00:23:28.057 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.053+0000 7f65c7e00640 1 --2- 172.21.15.40:0/2443432738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65d00b5c80 0x7f65d014f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:23:28.058 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.054+0000 7f65cf400640 1 --2- 172.21.15.40:0/2443432738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d00b4ab0 0x7f65d01f8dc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f65c000c430 tx=0x7f65c000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:28.058 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.054+0000 7f65c7400640 1 -- 172.21.15.40:0/2443432738 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0017070 con 0x7f65d00b4ab0 2024-09-11T00:23:28.058 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.054+0000 7f65c7400640 1 -- 172.21.15.40:0/2443432738 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65c00053e0 con 0x7f65d00b4ab0 2024-09-11T00:23:28.058 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.054+0000 7f65c7400640 1 -- 172.21.15.40:0/2443432738 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c00038a0 con 0x7f65d00b4ab0 2024-09-11T00:23:28.058 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.054+0000 7f65d6200640 1 -- 172.21.15.40:0/2443432738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d01f82e0 con 0x7f65d00b4ab0 2024-09-11T00:23:28.058 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.054+0000 7f65d6200640 1 -- 172.21.15.40:0/2443432738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d014f5c0 con 0x7f65d00b4ab0 2024-09-11T00:23:28.058 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.055+0000 7f65d6200640 1 -- 172.21.15.40:0/2443432738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d00d48c0 con 0x7f65d00b4ab0 2024-09-11T00:23:28.058 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.055+0000 7f65c7400640 1 -- 172.21.15.40:0/2443432738 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 2) ==== 50324+0+0 (secure 0 0 0) 0x7f65c0003a40 con 0x7f65d00b4ab0 2024-09-11T00:23:28.058 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.056+0000 7f65c7400640 1 -- 172.21.15.40:0/2443432738 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f65c0051350 con 0x7f65d00b4ab0 2024-09-11T00:23:28.060 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.058+0000 7f65c7400640 1 -- 172.21.15.40:0/2443432738 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f65c0033950 con 0x7f65d00b4ab0 2024-09-11T00:23:28.125 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.123+0000 7f65d6200640 1 -- 172.21.15.40:0/2443432738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65d00d1340 con 0x7f65d00b4ab0 2024-09-11T00:23:28.126 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.124+0000 7f65c7400640 1 -- 172.21.15.40:0/2443432738 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f65c0011cf0 con 0x7f65d00b4ab0 2024-09-11T00:23:28.126 INFO:teuthology.misc.health.smithi040.stdout: 2024-09-11T00:23:28.126 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":10,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","created":"2024-09-11T00:23:22.512139+0000","modified":"2024-09-11T00:23:26.734953+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T00:23:26.734953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ee10e123-8817-4d94-a340-73d00121af37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f90895e9-8660-42b9-8aba-3f9d4d130b5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a190497a-2aba-4748-8f1d-7e372259d65a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8be32ced-898a-46f2-b850-1517667766b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9867fdfc-6f93-466e-b768-b5a1da7157de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e2f6f616-b5db-466e-942f-e2762171a8ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"807ac045-bf63-4ff6-9a06-7f7022f9ef32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8e0b3293-390f-4b43-b29d-babdc5e88f77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:23:28.127 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.125+0000 7f65d6200640 1 -- 172.21.15.40:0/2443432738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d00b4ab0 msgr2=0x7f65d01f8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:28.127 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.125+0000 7f65d6200640 1 --2- 172.21.15.40:0/2443432738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d00b4ab0 0x7f65d01f8dc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f65c000c430 tx=0x7f65c000c8f0 comp rx=0 tx=0).stop 2024-09-11T00:23:28.127 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.125+0000 7f65d6200640 1 -- 172.21.15.40:0/2443432738 shutdown_connections 2024-09-11T00:23:28.128 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.125+0000 7f65d6200640 1 --2- 172.21.15.40:0/2443432738 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65d0161420 0x7f65d00ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:28.128 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.125+0000 7f65d6200640 1 --2- 172.21.15.40:0/2443432738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65d00b5c80 0x7f65d014f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:28.128 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.125+0000 7f65d6200640 1 --2- 172.21.15.40:0/2443432738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d00b4ab0 0x7f65d01f8dc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:28.128 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.125+0000 7f65d6200640 1 -- 172.21.15.40:0/2443432738 >> 172.21.15.40:0/2443432738 conn(0x7f65d00d3dd0 msgr2=0x7f65d00b9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:28.128 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.125+0000 7f65d6200640 1 -- 172.21.15.40:0/2443432738 shutdown_connections 2024-09-11T00:23:28.128 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:28.125+0000 7f65d6200640 1 -- 172.21.15.40:0/2443432738 wait complete. 2024-09-11T00:23:28.139 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-11T00:23:28.298 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-11T00:23:28.296+0000 7f2811010640 -1 Falling back to public interface 2024-09-11T00:23:28.320 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-09-11T00:23:28.319+0000 7fd6a2e0c640 -1 Falling back to public interface 2024-09-11T00:23:28.330 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-11T00:23:28.328+0000 7f982f80d640 -1 Falling back to public interface 2024-09-11T00:23:28.333 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-11T00:23:28.331+0000 7fdea1644640 -1 Falling back to public interface 2024-09-11T00:23:28.341 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-11T00:23:28.335+0000 7f866c1a8640 -1 Falling back to public interface 2024-09-11T00:23:28.536 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-09-11T00:23:28.535+0000 7f97c12ef640 -1 Falling back to public interface 2024-09-11T00:23:28.600 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-09-11T00:23:28.599+0000 7f270240b640 -1 Falling back to public interface 2024-09-11T00:23:28.783 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-11T00:23:28.782+0000 7f98b3000640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-11T00:23:28.784 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-09-11T00:23:28.782+0000 7f98b3000640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-11T00:23:28.873 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-09-11T00:23:28.872+0000 7f45fd413640 -1 Falling back to public interface 2024-09-11T00:23:31.919 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-11T00:23:31.916+0000 7f2811010640 -1 osd.0 0 log_to_monitors true 2024-09-11T00:23:32.014 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-09-11T00:23:32.013+0000 7fd6a2e0c640 -1 osd.7 0 log_to_monitors true 2024-09-11T00:23:32.106 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-11T00:23:32.103+0000 7fdea1644640 -1 osd.2 0 log_to_monitors true 2024-09-11T00:23:32.313 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-11T00:23:32.311+0000 7f866c1a8640 -1 osd.1 0 log_to_monitors true 2024-09-11T00:23:32.454 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-09-11T00:23:32.453+0000 7f97c12ef640 -1 osd.4 0 log_to_monitors true 2024-09-11T00:23:32.571 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-11T00:23:32.569+0000 7f982f80d640 -1 osd.3 0 log_to_monitors true 2024-09-11T00:23:32.607 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-09-11T00:23:32.606+0000 7f270240b640 -1 osd.6 0 log_to_monitors true 2024-09-11T00:23:32.862 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-09-11T00:23:32.861+0000 7f45fd413640 -1 osd.5 0 log_to_monitors true 2024-09-11T00:23:34.075 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-11T00:23:34.073+0000 7f280b800640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T00:23:34.183 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-11T00:23:34.181+0000 7f2801800640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:23:34.946 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T00:23:35.137 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.134+0000 7fe134600640 1 -- 172.21.15.40:0/3436969959 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe12c0cd7b0 msgr2=0x7fe12c0d00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:35.137 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.134+0000 7fe134600640 1 --2- 172.21.15.40:0/3436969959 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe12c0cd7b0 0x7fe12c0d00f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe118009830 tx=0x7fe11802a480 comp rx=0 tx=0).stop 2024-09-11T00:23:35.137 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.134+0000 7fe134600640 1 -- 172.21.15.40:0/3436969959 shutdown_connections 2024-09-11T00:23:35.137 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.134+0000 7fe134600640 1 --2- 172.21.15.40:0/3436969959 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe12c0cd7b0 0x7fe12c0d00f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.137 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.134+0000 7fe134600640 1 --2- 172.21.15.40:0/3436969959 >> v2:172.21.15.175:3300/0 conn(0x7fe12c15bd40 0x7fe12c0cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.137 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.134+0000 7fe134600640 1 -- 172.21.15.40:0/3436969959 >> 172.21.15.40:0/3436969959 conn(0x7fe12c074a90 msgr2=0x7fe12c09aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:35.137 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.135+0000 7fe134600640 1 -- 172.21.15.40:0/3436969959 shutdown_connections 2024-09-11T00:23:35.138 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.135+0000 7fe134600640 1 -- 172.21.15.40:0/3436969959 wait complete. 2024-09-11T00:23:35.139 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.137+0000 7fe134600640 1 Processor -- start 2024-09-11T00:23:35.140 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.138+0000 7fe134600640 1 -- start start 2024-09-11T00:23:35.141 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.139+0000 7fe134600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe12c0cd7b0 0x7fe12c0cb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.142 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.139+0000 7fe134600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe12c0d0630 0x7fe12c0b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.142 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.139+0000 7fe134600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c15bd40 0x7fe12c0c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.143 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.139+0000 7fe134600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe12c0c72d0 con 0x7fe12c0cd7b0 2024-09-11T00:23:35.143 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.139+0000 7fe134600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe12c0c7150 con 0x7fe12c15bd40 2024-09-11T00:23:35.143 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.139+0000 7fe134600640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe12c0c7450 con 0x7fe12c0d0630 2024-09-11T00:23:35.143 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.139+0000 7fe131200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe12c0d0630 0x7fe12c0b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.143 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.140+0000 7fe131200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe12c0d0630 0x7fe12c0b5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.40:50906/0 (socket says 172.21.15.40:50906) 2024-09-11T00:23:35.143 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.140+0000 7fe131200640 1 -- 172.21.15.40:0/4103337263 learned_addr learned my addr 172.21.15.40:0/4103337263 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:35.143 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.140+0000 7fe132600640 1 --2- 172.21.15.40:0/4103337263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c15bd40 0x7fe12c0c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.143 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.140+0000 7fe131200640 1 -- 172.21.15.40:0/4103337263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c15bd40 msgr2=0x7fe12c0c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:35.143 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.140+0000 7fe131200640 1 --2- 172.21.15.40:0/4103337263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c15bd40 0x7fe12c0c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.143 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.140+0000 7fe131200640 1 -- 172.21.15.40:0/4103337263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe12c0cd7b0 msgr2=0x7fe12c0cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:35.143 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.140+0000 7fe131200640 1 --2- 172.21.15.40:0/4103337263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe12c0cd7b0 0x7fe12c0cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.143 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.140+0000 7fe131200640 1 -- 172.21.15.40:0/4103337263 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe12c06ddd0 con 0x7fe12c0d0630 2024-09-11T00:23:35.144 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.141+0000 7fe131200640 1 --2- 172.21.15.40:0/4103337263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe12c0d0630 0x7fe12c0b5d00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe118009950 tx=0x7fe118032c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:35.144 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.141+0000 7fe129600640 1 -- 172.21.15.40:0/4103337263 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe118040070 con 0x7fe12c0d0630 2024-09-11T00:23:35.145 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.141+0000 7fe129600640 1 -- 172.21.15.40:0/4103337263 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1180038e0 con 0x7fe12c0d0630 2024-09-11T00:23:35.145 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.141+0000 7fe134600640 1 -- 172.21.15.40:0/4103337263 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe12c06e0b0 con 0x7fe12c0d0630 2024-09-11T00:23:35.145 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.141+0000 7fe134600640 1 -- 172.21.15.40:0/4103337263 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe12c06e670 con 0x7fe12c0d0630 2024-09-11T00:23:35.145 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.141+0000 7fe129600640 1 -- 172.21.15.40:0/4103337263 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe118003d30 con 0x7fe12c0d0630 2024-09-11T00:23:35.147 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.144+0000 7fe134600640 1 -- 172.21.15.40:0/4103337263 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe12c06e870 con 0x7fe12c0d0630 2024-09-11T00:23:35.147 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.145+0000 7fe129600640 1 -- 172.21.15.40:0/4103337263 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 4) ==== 100545+0+0 (secure 0 0 0) 0x7fe118045460 con 0x7fe12c0d0630 2024-09-11T00:23:35.149 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.146+0000 7fe129600640 1 --2- 172.21.15.40:0/4103337263 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe10c077ee0 0x7fe10c07a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.149 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.146+0000 7fe129600640 1 -- 172.21.15.40:0/4103337263 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(13..13 src has 1..13) ==== 2231+0+0 (secure 0 0 0) 0x7fe1180ba770 con 0x7fe12c0d0630 2024-09-11T00:23:35.149 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.147+0000 7fe131c00640 1 --2- 172.21.15.40:0/4103337263 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe10c077ee0 0x7fe10c07a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.150 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.148+0000 7fe131c00640 1 --2- 172.21.15.40:0/4103337263 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe10c077ee0 0x7fe10c07a3a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe1200058c0 tx=0x7fe120005850 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:35.159 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.157+0000 7fe129600640 1 -- 172.21.15.40:0/4103337263 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe12c06e870 con 0x7fe12c0d0630 2024-09-11T00:23:35.519 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.517+0000 7fe134600640 1 -- 172.21.15.40:0/4103337263 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe12c0d00f0 con 0x7fe12c0d0630 2024-09-11T00:23:35.522 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.519+0000 7fe129600640 1 -- 172.21.15.40:0/4103337263 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7543 (secure 0 0 0) 0x7fe11804a060 con 0x7fe12c0d0630 2024-09-11T00:23:35.522 INFO:teuthology.misc.health.smithi040.stdout: 2024-09-11T00:23:35.522 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":14,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","created":"2024-09-11T00:23:22.512139+0000","modified":"2024-09-11T00:23:35.142650+0000","last_up_change":"2024-09-11T00:23:35.142650+0000","last_in_change":"2024-09-11T00:23:26.734953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ee10e123-8817-4d94-a340-73d00121af37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6801","nonce":973366008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6803","nonce":973366008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6807","nonce":973366008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6805","nonce":973366008}]},"public_addr":"172.21.15.40:6801/973366008","cluster_addr":"172.21.15.40:6803/973366008","heartbeat_back_addr":"172.21.15.40:6807/973366008","heartbeat_front_addr":"172.21.15.40:6805/973366008","state":["exists","up"]},{"osd":1,"uuid":"f90895e9-8660-42b9-8aba-3f9d4d130b5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a190497a-2aba-4748-8f1d-7e372259d65a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8be32ced-898a-46f2-b850-1517667766b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9867fdfc-6f93-466e-b768-b5a1da7157de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e2f6f616-b5db-466e-942f-e2762171a8ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"807ac045-bf63-4ff6-9a06-7f7022f9ef32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8e0b3293-390f-4b43-b29d-babdc5e88f77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:23:35.525 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.523+0000 7fe134600640 1 -- 172.21.15.40:0/4103337263 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe10c077ee0 msgr2=0x7fe10c07a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:35.525 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.523+0000 7fe134600640 1 --2- 172.21.15.40:0/4103337263 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe10c077ee0 0x7fe10c07a3a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe1200058c0 tx=0x7fe120005850 comp rx=0 tx=0).stop 2024-09-11T00:23:35.526 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.523+0000 7fe134600640 1 -- 172.21.15.40:0/4103337263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe12c0d0630 msgr2=0x7fe12c0b5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:35.526 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.523+0000 7fe134600640 1 --2- 172.21.15.40:0/4103337263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe12c0d0630 0x7fe12c0b5d00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe118009950 tx=0x7fe118032c10 comp rx=0 tx=0).stop 2024-09-11T00:23:35.526 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.523+0000 7fe134600640 1 -- 172.21.15.40:0/4103337263 shutdown_connections 2024-09-11T00:23:35.526 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.523+0000 7fe134600640 1 --2- 172.21.15.40:0/4103337263 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe10c077ee0 0x7fe10c07a3a0 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe1200058c0 tx=0x7fe120005850 comp rx=0 tx=0).stop 2024-09-11T00:23:35.526 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.523+0000 7fe134600640 1 --2- 172.21.15.40:0/4103337263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c15bd40 0x7fe12c0c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.526 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.523+0000 7fe134600640 1 --2- 172.21.15.40:0/4103337263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe12c0d0630 0x7fe12c0b5d00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.526 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.523+0000 7fe134600640 1 --2- 172.21.15.40:0/4103337263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe12c0cd7b0 0x7fe12c0cb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.526 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.523+0000 7fe134600640 1 -- 172.21.15.40:0/4103337263 >> 172.21.15.40:0/4103337263 conn(0x7fe12c074a90 msgr2=0x7fe12c15e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:35.526 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.523+0000 7fe134600640 1 -- 172.21.15.40:0/4103337263 shutdown_connections 2024-09-11T00:23:35.528 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:35.526+0000 7fe134600640 1 -- 172.21.15.40:0/4103337263 wait complete. 2024-09-11T00:23:35.549 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-11T00:23:35.841 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-11T00:23:35.839+0000 7f8667000640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T00:23:35.850 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-11T00:23:35.846+0000 7f865d000640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:23:35.868 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-11T00:23:35.865+0000 7f982a200640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T00:23:35.874 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-11T00:23:35.872+0000 7f9820200640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:23:35.889 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-11T00:23:35.887+0000 7fde9ce00640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T00:23:35.895 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-11T00:23:35.893+0000 7fde92400640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:23:36.204 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-09-11T00:23:36.203+0000 7f97bc200640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T00:23:36.212 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-09-11T00:23:36.211+0000 7f97b2200640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:23:36.228 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-09-11T00:23:36.227+0000 7f45f7c00640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T00:23:36.231 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-09-11T00:23:36.230+0000 7f26fd600640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T00:23:36.235 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-09-11T00:23:36.234+0000 7f45edc00640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:23:36.239 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-09-11T00:23:36.239+0000 7f26f2c00640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:23:36.320 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-09-11T00:23:36.319+0000 7fd69e000640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T00:23:36.330 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-09-11T00:23:36.329+0000 7fd693600640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:23:42.355 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T00:23:42.467 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:23:42.471 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:23:42.508 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.507+0000 7fc7be800640 1 -- 172.21.15.40:0/4056137175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80b4c80 msgr2=0x7fc7b80cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:42.509 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.507+0000 7fc7be800640 1 --2- 172.21.15.40:0/4056137175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80b4c80 0x7fc7b80cee70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009830 tx=0x7fc7b002a5c0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.509 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.507+0000 7fc7be800640 1 -- 172.21.15.40:0/4056137175 shutdown_connections 2024-09-11T00:23:42.509 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.507+0000 7fc7be800640 1 --2- 172.21.15.40:0/4056137175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80b4c80 0x7fc7b80cee70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.509 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.507+0000 7fc7be800640 1 -- 172.21.15.40:0/4056137175 >> 172.21.15.40:0/4056137175 conn(0x7fc7b809cf50 msgr2=0x7fc7b80d3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:42.509 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.507+0000 7fc7be800640 1 -- 172.21.15.40:0/4056137175 shutdown_connections 2024-09-11T00:23:42.509 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.507+0000 7fc7be800640 1 -- 172.21.15.40:0/4056137175 wait complete. 2024-09-11T00:23:42.510 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.509+0000 7fc7be800640 1 Processor -- start 2024-09-11T00:23:42.510 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.509+0000 7fc7be800640 1 -- start start 2024-09-11T00:23:42.512 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.510+0000 7fc7be800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7b80b4c80 0x7fc7b8155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.512 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.510+0000 7fc7be800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80b5de0 0x7fc7b80b84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.512 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.510+0000 7fc7be800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7b8161470 0x7fc7b81f7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.512 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.510+0000 7fc7be800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b80cf530 con 0x7fc7b80b5de0 2024-09-11T00:23:42.513 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.510+0000 7fc7be800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b80cf3b0 con 0x7fc7b8161470 2024-09-11T00:23:42.513 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.510+0000 7fc7be800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc7b80cf6b0 con 0x7fc7b80b4c80 2024-09-11T00:23:42.513 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.510+0000 7fc7bca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80b5de0 0x7fc7b80b84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.513 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.510+0000 7fc7bca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80b5de0 0x7fc7b80b84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53586/0 (socket says 172.21.15.40:53586) 2024-09-11T00:23:42.513 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.510+0000 7fc7bca00640 1 -- 172.21.15.40:0/4162433836 learned_addr learned my addr 172.21.15.40:0/4162433836 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:42.513 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.510+0000 7fc7bde00640 1 --2- 172.21.15.40:0/4162433836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7b8161470 0x7fc7b81f7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.513 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.510+0000 7fc7bd400640 1 --2- 172.21.15.40:0/4162433836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7b80b4c80 0x7fc7b8155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.513 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.510+0000 7fc7bca00640 1 -- 172.21.15.40:0/4162433836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7b80b4c80 msgr2=0x7fc7b8155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:42.513 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.510+0000 7fc7bca00640 1 --2- 172.21.15.40:0/4162433836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7b80b4c80 0x7fc7b8155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.513 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.510+0000 7fc7bca00640 1 -- 172.21.15.40:0/4162433836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7b8161470 msgr2=0x7fc7b81f7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:42.513 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.510+0000 7fc7bca00640 1 --2- 172.21.15.40:0/4162433836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7b8161470 0x7fc7b81f7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.513 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.510+0000 7fc7bca00640 1 -- 172.21.15.40:0/4162433836 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b8157450 con 0x7fc7b80b5de0 2024-09-11T00:23:42.514 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.511+0000 7fc7bca00640 1 --2- 172.21.15.40:0/4162433836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80b5de0 0x7fc7b80b84e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400c500 tx=0x7fc7a400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:42.514 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.511+0000 7fc7b5600640 1 -- 172.21.15.40:0/4162433836 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4016020 con 0x7fc7b80b5de0 2024-09-11T00:23:42.514 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.511+0000 7fc7b5600640 1 -- 172.21.15.40:0/4162433836 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7a4012920 con 0x7fc7b80b5de0 2024-09-11T00:23:42.514 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.511+0000 7fc7be800640 1 -- 172.21.15.40:0/4162433836 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b80b8ec0 con 0x7fc7b80b5de0 2024-09-11T00:23:42.514 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.511+0000 7fc7b5600640 1 -- 172.21.15.40:0/4162433836 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4012d90 con 0x7fc7b80b5de0 2024-09-11T00:23:42.514 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.511+0000 7fc7be800640 1 -- 172.21.15.40:0/4162433836 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b81576d0 con 0x7fc7b80b5de0 2024-09-11T00:23:42.514 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.512+0000 7fc7be800640 1 -- 172.21.15.40:0/4162433836 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7b80d3c50 con 0x7fc7b80b5de0 2024-09-11T00:23:42.515 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.514+0000 7fc7b5600640 1 -- 172.21.15.40:0/4162433836 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc7a401b400 con 0x7fc7b80b5de0 2024-09-11T00:23:42.516 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.514+0000 7fc7b5600640 1 --2- 172.21.15.40:0/4162433836 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc798077f70 0x7fc79807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.516 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.515+0000 7fc7b5600640 1 -- 172.21.15.40:0/4162433836 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fc7a409a0f0 con 0x7fc7b80b5de0 2024-09-11T00:23:42.516 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.515+0000 7fc7bd400640 1 --2- 172.21.15.40:0/4162433836 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc798077f70 0x7fc79807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.516 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.515+0000 7fc7bd400640 1 --2- 172.21.15.40:0/4162433836 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc798077f70 0x7fc79807a430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0012e0 tx=0x7fc7ac009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:42.519 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.518+0000 7fc7b5600640 1 -- 172.21.15.40:0/4162433836 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc7a4020030 con 0x7fc7b80b5de0 2024-09-11T00:23:42.717 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.715+0000 7fc7be800640 1 -- 172.21.15.40:0/4162433836 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7b80d1e30 con 0x7fc7b80b5de0 2024-09-11T00:23:42.717 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.716+0000 7fc7b5600640 1 -- 172.21.15.40:0/4162433836 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12872 (secure 0 0 0) 0x7fc7b8157450 con 0x7fc7b80b5de0 2024-09-11T00:23:42.718 INFO:teuthology.misc.health.smithi040.stdout: 2024-09-11T00:23:42.718 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":18,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","created":"2024-09-11T00:23:22.512139+0000","modified":"2024-09-11T00:23:39.892244+0000","last_up_change":"2024-09-11T00:23:36.842446+0000","last_in_change":"2024-09-11T00:23:26.734953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:23:37.800502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee10e123-8817-4d94-a340-73d00121af37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6801","nonce":973366008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6803","nonce":973366008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6807","nonce":973366008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6805","nonce":973366008}]},"public_addr":"172.21.15.40:6801/973366008","cluster_addr":"172.21.15.40:6803/973366008","heartbeat_back_addr":"172.21.15.40:6807/973366008","heartbeat_front_addr":"172.21.15.40:6805/973366008","state":["exists","up"]},{"osd":1,"uuid":"f90895e9-8660-42b9-8aba-3f9d4d130b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6823","nonce":2542266029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6827","nonce":2542266029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6831","nonce":2542266029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6829","nonce":2542266029}]},"public_addr":"172.21.15.40:6823/2542266029","cluster_addr":"172.21.15.40:6827/2542266029","heartbeat_back_addr":"172.21.15.40:6831/2542266029","heartbeat_front_addr":"172.21.15.40:6829/2542266029","state":["exists","up"]},{"osd":2,"uuid":"a190497a-2aba-4748-8f1d-7e372259d65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6815","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6817","nonce":559505356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6819","nonce":559505356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6826","nonce":559505356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6822","nonce":559505356}]},"public_addr":"172.21.15.40:6817/559505356","cluster_addr":"172.21.15.40:6819/559505356","heartbeat_back_addr":"172.21.15.40:6826/559505356","heartbeat_front_addr":"172.21.15.40:6822/559505356","state":["exists","up"]},{"osd":3,"uuid":"8be32ced-898a-46f2-b850-1517667766b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6809","nonce":503633839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6811","nonce":503633839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6816","nonce":503633839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6813","nonce":503633839}]},"public_addr":"172.21.15.40:6809/503633839","cluster_addr":"172.21.15.40:6811/503633839","heartbeat_back_addr":"172.21.15.40:6816/503633839","heartbeat_front_addr":"172.21.15.40:6813/503633839","state":["exists","up"]},{"osd":4,"uuid":"9867fdfc-6f93-466e-b768-b5a1da7157de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6811","nonce":2418348042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6813","nonce":2418348042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6817","nonce":2418348042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6815","nonce":2418348042}]},"public_addr":"172.21.15.175:6811/2418348042","cluster_addr":"172.21.15.175:6813/2418348042","heartbeat_back_addr":"172.21.15.175:6817/2418348042","heartbeat_front_addr":"172.21.15.175:6815/2418348042","state":["exists","up"]},{"osd":5,"uuid":"e2f6f616-b5db-466e-942f-e2762171a8ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6827","nonce":520822300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6829","nonce":520822300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6833","nonce":520822300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6831","nonce":520822300}]},"public_addr":"172.21.15.175:6827/520822300","cluster_addr":"172.21.15.175:6829/520822300","heartbeat_back_addr":"172.21.15.175:6833/520822300","heartbeat_front_addr":"172.21.15.175:6831/520822300","state":["exists","up"]},{"osd":6,"uuid":"807ac045-bf63-4ff6-9a06-7f7022f9ef32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6819","nonce":1431736593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6821","nonce":1431736593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6825","nonce":1431736593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6823","nonce":1431736593}]},"public_addr":"172.21.15.175:6819/1431736593","cluster_addr":"172.21.15.175:6821/1431736593","heartbeat_back_addr":"172.21.15.175:6825/1431736593","heartbeat_front_addr":"172.21.15.175:6823/1431736593","state":["exists","up"]},{"osd":7,"uuid":"8e0b3293-390f-4b43-b29d-babdc5e88f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6803","nonce":3300317000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6805","nonce":3300317000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6809","nonce":3300317000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6807","nonce":3300317000}]},"public_addr":"172.21.15.175:6803/3300317000","cluster_addr":"172.21.15.175:6805/3300317000","heartbeat_back_addr":"172.21.15.175:6809/3300317000","heartbeat_front_addr":"172.21.15.175:6807/3300317000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:32.967062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.266558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.063509+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.616332+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.431077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.866822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.645225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.016210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:23:42.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.718+0000 7fc7be800640 1 -- 172.21.15.40:0/4162433836 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc798077f70 msgr2=0x7fc79807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:42.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.718+0000 7fc7be800640 1 --2- 172.21.15.40:0/4162433836 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc798077f70 0x7fc79807a430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0012e0 tx=0x7fc7ac009040 comp rx=0 tx=0).stop 2024-09-11T00:23:42.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.718+0000 7fc7be800640 1 -- 172.21.15.40:0/4162433836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80b5de0 msgr2=0x7fc7b80b84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:42.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.718+0000 7fc7be800640 1 --2- 172.21.15.40:0/4162433836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80b5de0 0x7fc7b80b84e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400c500 tx=0x7fc7a400c9c0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.718+0000 7fc7be800640 1 -- 172.21.15.40:0/4162433836 shutdown_connections 2024-09-11T00:23:42.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.718+0000 7fc7be800640 1 --2- 172.21.15.40:0/4162433836 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc798077f70 0x7fc79807a430 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.718+0000 7fc7be800640 1 --2- 172.21.15.40:0/4162433836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7b8161470 0x7fc7b81f7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.721 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.718+0000 7fc7be800640 1 --2- 172.21.15.40:0/4162433836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80b5de0 0x7fc7b80b84e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.721 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.718+0000 7fc7be800640 1 --2- 172.21.15.40:0/4162433836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7b80b4c80 0x7fc7b8155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.721 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.718+0000 7fc7be800640 1 -- 172.21.15.40:0/4162433836 >> 172.21.15.40:0/4162433836 conn(0x7fc7b809cf50 msgr2=0x7fc7b81605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:42.721 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.719+0000 7fc7be800640 1 -- 172.21.15.40:0/4162433836 shutdown_connections 2024-09-11T00:23:42.721 INFO:teuthology.misc.health.smithi040.stderr:2024-09-11T00:23:42.719+0000 7fc7be800640 1 -- 172.21.15.40:0/4162433836 wait complete. 2024-09-11T00:23:42.732 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-11T00:23:42.732 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-11T00:23:42.733 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T00:23:42.733 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T00:23:42.737 INFO:tasks.ceph.mds.a:Started 2024-09-11T00:23:42.737 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T00:23:42.737 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T00:23:42.740 INFO:tasks.ceph.mds.c:Started 2024-09-11T00:23:42.740 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T00:23:42.741 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T00:23:42.744 INFO:tasks.ceph.mds.b:Started 2024-09-11T00:23:42.745 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T00:23:42.745 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T00:23:42.748 INFO:tasks.ceph.mds.d:Started 2024-09-11T00:23:42.748 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-11T00:23:42.749 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:23:42.868 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2024-09-11T00:23:42.870 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2024-09-11T00:23:42.876 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2024-09-11T00:23:42.877 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2024-09-11T00:23:42.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.916+0000 7f84d2e00640 1 -- 172.21.15.40:0/1396339415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84b0003a50 msgr2=0x7f84b0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:42.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.916+0000 7f84d2e00640 1 --2- 172.21.15.40:0/1396339415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84b0003a50 0x7f84b0003e70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f84bc009b50 tx=0x7f84b0005830 comp rx=0 tx=0).stop 2024-09-11T00:23:42.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.916+0000 7f84d0e00640 1 -- 172.21.15.40:0/1396339415 reap_dead start 2024-09-11T00:23:42.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.916+0000 7f84d2e00640 1 -- 172.21.15.40:0/1396339415 shutdown_connections 2024-09-11T00:23:42.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.916+0000 7f84d2e00640 1 -- 172.21.15.40:0/1396339415 >> 172.21.15.40:0/1396339415 conn(0x7f84cc0cfbb0 msgr2=0x7f84cc0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:42.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.916+0000 7f84d2e00640 1 -- 172.21.15.40:0/1396339415 shutdown_connections 2024-09-11T00:23:42.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.916+0000 7f84d2e00640 1 -- 172.21.15.40:0/1396339415 wait complete. 2024-09-11T00:23:42.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.918+0000 7f84d2e00640 1 Processor -- start 2024-09-11T00:23:42.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.918+0000 7f84d2e00640 1 -- start start 2024-09-11T00:23:42.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.919+0000 7f84d2e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84b0003a50 0x7f84cc150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.919+0000 7f84d2e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84cc151410 0x7f84cc1529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.919+0000 7f84d2e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84cc157270 0x7f84cc152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.919+0000 7f84d2e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc165d20 con 0x7f84cc157270 2024-09-11T00:23:42.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.919+0000 7f84d2e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc0cde40 con 0x7f84cc151410 2024-09-11T00:23:42.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.919+0000 7f84d2e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f84cc165ea0 con 0x7f84b0003a50 2024-09-11T00:23:42.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.919+0000 7f84d0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84cc157270 0x7f84cc152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.919+0000 7f84c3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84cc151410 0x7f84cc1529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.919+0000 7f84d0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84cc157270 0x7f84cc152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53640/0 (socket says 172.21.15.40:53640) 2024-09-11T00:23:42.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.919+0000 7f84d0e00640 1 -- 172.21.15.40:0/907679189 learned_addr learned my addr 172.21.15.40:0/907679189 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:42.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.919+0000 7f84cbe00640 1 --2- 172.21.15.40:0/907679189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84b0003a50 0x7f84cc150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.920+0000 7f84d0e00640 1 -- 172.21.15.40:0/907679189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84b0003a50 msgr2=0x7f84cc150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:42.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.920+0000 7f84d0e00640 1 --2- 172.21.15.40:0/907679189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84b0003a50 0x7f84cc150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.920+0000 7f84d0e00640 1 -- 172.21.15.40:0/907679189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84cc151410 msgr2=0x7f84cc1529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:42.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.920+0000 7f84d0e00640 1 --2- 172.21.15.40:0/907679189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84cc151410 0x7f84cc1529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.920+0000 7f84d0e00640 1 -- 172.21.15.40:0/907679189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84cc155420 con 0x7f84cc157270 2024-09-11T00:23:42.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.920+0000 7f84c3400640 1 --2- 172.21.15.40:0/907679189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84cc151410 0x7f84cc1529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:23:42.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.920+0000 7f84d0e00640 1 --2- 172.21.15.40:0/907679189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84cc157270 0x7f84cc152ef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f84cc0d0cb0 tx=0x7f84c400f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:42.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.920+0000 7f84c8c00640 1 -- 172.21.15.40:0/907679189 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c4004b20 con 0x7f84cc157270 2024-09-11T00:23:42.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.920+0000 7f84c8c00640 1 -- 172.21.15.40:0/907679189 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84c4004cc0 con 0x7f84cc157270 2024-09-11T00:23:42.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.920+0000 7f84c8c00640 1 -- 172.21.15.40:0/907679189 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c4003bd0 con 0x7f84cc157270 2024-09-11T00:23:42.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.920+0000 7f84d2e00640 1 -- 172.21.15.40:0/907679189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84cc155700 con 0x7f84cc157270 2024-09-11T00:23:42.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.920+0000 7f84d2e00640 1 -- 172.21.15.40:0/907679189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84cc155cc0 con 0x7f84cc157270 2024-09-11T00:23:42.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.922+0000 7f84d2e00640 1 -- 172.21.15.40:0/907679189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84cc15e3b0 con 0x7f84cc157270 2024-09-11T00:23:42.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.923+0000 7f84c8c00640 1 -- 172.21.15.40:0/907679189 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f84c4018070 con 0x7f84cc157270 2024-09-11T00:23:42.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.923+0000 7f84c8c00640 1 --2- 172.21.15.40:0/907679189 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f84a8077fa0 0x7f84a807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.924+0000 7f84c8c00640 1 -- 172.21.15.40:0/907679189 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f84c4099f20 con 0x7f84cc157270 2024-09-11T00:23:42.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.924+0000 7f84cbe00640 1 --2- 172.21.15.40:0/907679189 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f84a8077fa0 0x7f84a807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.925+0000 7f84cbe00640 1 --2- 172.21.15.40:0/907679189 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f84a8077fa0 0x7f84a807a460 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f84bc009b50 tx=0x7f84bc02d040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:42.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:42.928+0000 7f84c8c00640 1 -- 172.21.15.40:0/907679189 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f84c4062680 con 0x7f84cc157270 2024-09-11T00:23:43.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:43.162+0000 7f84d2e00640 1 -- 172.21.15.40:0/907679189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84cc0b5b30 con 0x7f84cc157270 2024-09-11T00:23:43.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:43.162+0000 7f84c8c00640 1 -- 172.21.15.40:0/907679189 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f84c40670b0 con 0x7f84cc157270 2024-09-11T00:23:43.164 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:23:43.164 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":2,"btime":"2024-09-11T00:23:42:875136+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2724658296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2724658296},{"type":"v1","addr":"172.21.15.40:6833","nonce":2724658296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T00:23:43.164 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 2 2024-09-11T00:23:43.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:43.165+0000 7f84d2e00640 1 -- 172.21.15.40:0/907679189 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f84a8077fa0 msgr2=0x7f84a807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:43.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:43.165+0000 7f84d2e00640 1 --2- 172.21.15.40:0/907679189 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f84a8077fa0 0x7f84a807a460 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f84bc009b50 tx=0x7f84bc02d040 comp rx=0 tx=0).stop 2024-09-11T00:23:43.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:43.165+0000 7f84d2e00640 1 -- 172.21.15.40:0/907679189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84cc157270 msgr2=0x7f84cc152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:43.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:43.165+0000 7f84d2e00640 1 --2- 172.21.15.40:0/907679189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84cc157270 0x7f84cc152ef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f84cc0d0cb0 tx=0x7f84c400f3c0 comp rx=0 tx=0).stop 2024-09-11T00:23:43.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:43.165+0000 7f84d2e00640 1 -- 172.21.15.40:0/907679189 shutdown_connections 2024-09-11T00:23:43.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:43.165+0000 7f84d2e00640 1 --2- 172.21.15.40:0/907679189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84cc157270 0x7f84cc152ef0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:43.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:43.165+0000 7f84d2e00640 1 --2- 172.21.15.40:0/907679189 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f84a8077fa0 0x7f84a807a460 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:43.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:43.165+0000 7f84d2e00640 1 --2- 172.21.15.40:0/907679189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84cc151410 0x7f84cc1529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:43.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:43.165+0000 7f84d2e00640 1 --2- 172.21.15.40:0/907679189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84b0003a50 0x7f84cc150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:43.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:43.165+0000 7f84d2e00640 1 -- 172.21.15.40:0/907679189 >> 172.21.15.40:0/907679189 conn(0x7f84cc0cfbb0 msgr2=0x7f84cc153f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:43.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:43.165+0000 7f84d2e00640 1 -- 172.21.15.40:0/907679189 shutdown_connections 2024-09-11T00:23:43.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:43.165+0000 7f84d2e00640 1 -- 172.21.15.40:0/907679189 wait complete. 2024-09-11T00:23:45.182 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:23:45.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.353+0000 7f0748a00640 1 -- 172.21.15.40:0/3428632628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0728005280 msgr2=0x7f072800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:45.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.353+0000 7f0748a00640 1 --2- 172.21.15.40:0/3428632628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0728005280 0x7f072800b9c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f073c00c560 tx=0x7f0728005830 comp rx=0 tx=0).stop 2024-09-11T00:23:45.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.353+0000 7f0748a00640 1 -- 172.21.15.40:0/3428632628 shutdown_connections 2024-09-11T00:23:45.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.353+0000 7f0748a00640 1 --2- 172.21.15.40:0/3428632628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0728005280 0x7f072800b9c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.353+0000 7f0748a00640 1 -- 172.21.15.40:0/3428632628 >> 172.21.15.40:0/3428632628 conn(0x7f07440d3c20 msgr2=0x7f07440d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:45.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.353+0000 7f0748a00640 1 -- 172.21.15.40:0/3428632628 shutdown_connections 2024-09-11T00:23:45.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.353+0000 7f0748a00640 1 -- 172.21.15.40:0/3428632628 wait complete. 2024-09-11T00:23:45.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.354+0000 7f0748a00640 1 Processor -- start 2024-09-11T00:23:45.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.355+0000 7f0748a00640 1 -- start start 2024-09-11T00:23:45.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.355+0000 7f0748a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0728005280 0x7f074415a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.355+0000 7f0748a00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07441f4f00 0x7f07440cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.355+0000 7f0748a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07440cbc00 0x7f07441f7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.355+0000 7f0748a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f07440d02d0 con 0x7f0728005280 2024-09-11T00:23:45.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.355+0000 7f0748a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f07440d4ab0 con 0x7f07440cbc00 2024-09-11T00:23:45.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.355+0000 7f0748a00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f07440d0450 con 0x7f07441f4f00 2024-09-11T00:23:45.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.356+0000 7f0742800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0728005280 0x7f074415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.356+0000 7f0742800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0728005280 0x7f074415a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53658/0 (socket says 172.21.15.40:53658) 2024-09-11T00:23:45.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.356+0000 7f0742800640 1 -- 172.21.15.40:0/3271693338 learned_addr learned my addr 172.21.15.40:0/3271693338 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:45.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.356+0000 7f0743200640 1 --2- 172.21.15.40:0/3271693338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07440cbc00 0x7f07441f7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.356+0000 7f0739e00640 1 --2- 172.21.15.40:0/3271693338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07441f4f00 0x7f07440cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.356+0000 7f0742800640 1 -- 172.21.15.40:0/3271693338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07441f4f00 msgr2=0x7f07440cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:45.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.356+0000 7f0742800640 1 --2- 172.21.15.40:0/3271693338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07441f4f00 0x7f07440cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.356+0000 7f0742800640 1 -- 172.21.15.40:0/3271693338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07440cbc00 msgr2=0x7f07441f7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:45.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.356+0000 7f0742800640 1 --2- 172.21.15.40:0/3271693338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07440cbc00 0x7f07441f7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.356+0000 7f0742800640 1 -- 172.21.15.40:0/3271693338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07440cdce0 con 0x7f0728005280 2024-09-11T00:23:45.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.356+0000 7f0742800640 1 --2- 172.21.15.40:0/3271693338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0728005280 0x7f074415a600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0734011ab0 tx=0x7f0734011eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:45.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.357+0000 7f073b400640 1 -- 172.21.15.40:0/3271693338 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073400fcf0 con 0x7f0728005280 2024-09-11T00:23:45.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.357+0000 7f073b400640 1 -- 172.21.15.40:0/3271693338 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0734016070 con 0x7f0728005280 2024-09-11T00:23:45.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.357+0000 7f073b400640 1 -- 172.21.15.40:0/3271693338 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0734012670 con 0x7f0728005280 2024-09-11T00:23:45.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.357+0000 7f0748a00640 1 -- 172.21.15.40:0/3271693338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07441f5710 con 0x7f0728005280 2024-09-11T00:23:45.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.357+0000 7f0748a00640 1 -- 172.21.15.40:0/3271693338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07441f5cd0 con 0x7f0728005280 2024-09-11T00:23:45.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.358+0000 7f0748a00640 1 -- 172.21.15.40:0/3271693338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07440cc010 con 0x7f0728005280 2024-09-11T00:23:45.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.359+0000 7f073b400640 1 -- 172.21.15.40:0/3271693338 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0734012810 con 0x7f0728005280 2024-09-11T00:23:45.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.360+0000 7f073b400640 1 --2- 172.21.15.40:0/3271693338 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0720077fa0 0x7f072007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.360+0000 7f073b400640 1 -- 172.21.15.40:0/3271693338 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f073409a530 con 0x7f0728005280 2024-09-11T00:23:45.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.360+0000 7f0739e00640 1 --2- 172.21.15.40:0/3271693338 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0720077fa0 0x7f072007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.361+0000 7f0739e00640 1 --2- 172.21.15.40:0/3271693338 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0720077fa0 0x7f072007a460 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f07440b96a0 tx=0x7f072c006b10 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:45.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.364+0000 7f073b400640 1 -- 172.21.15.40:0/3271693338 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f07440cc010 con 0x7f0728005280 2024-09-11T00:23:45.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.594+0000 7f0748a00640 1 -- 172.21.15.40:0/3271693338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07440ce730 con 0x7f0728005280 2024-09-11T00:23:45.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.595+0000 7f073b400640 1 -- 172.21.15.40:0/3271693338 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3912 (secure 0 0 0) 0x7f0734062c90 con 0x7f0728005280 2024-09-11T00:23:45.597 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:23:45.597 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":3,"btime":"2024-09-11T00:23:43:878166+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3825015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3825015784},{"type":"v1","addr":"172.21.15.175:6836","nonce":3825015784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4334,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1127011821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1127011821},{"type":"v1","addr":"172.21.15.175:6837","nonce":1127011821}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2724658296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2724658296},{"type":"v1","addr":"172.21.15.40:6833","nonce":2724658296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4356,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3237981730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3237981730},{"type":"v1","addr":"172.21.15.40:6835","nonce":3237981730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-11T00:23:45.597 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 3 2024-09-11T00:23:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.597+0000 7f0748a00640 1 -- 172.21.15.40:0/3271693338 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0720077fa0 msgr2=0x7f072007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.597+0000 7f0748a00640 1 --2- 172.21.15.40:0/3271693338 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0720077fa0 0x7f072007a460 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f07440b96a0 tx=0x7f072c006b10 comp rx=0 tx=0).stop 2024-09-11T00:23:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.597+0000 7f0748a00640 1 -- 172.21.15.40:0/3271693338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0728005280 msgr2=0x7f074415a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.597+0000 7f0748a00640 1 --2- 172.21.15.40:0/3271693338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0728005280 0x7f074415a600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0734011ab0 tx=0x7f0734011eb0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.597+0000 7f0748a00640 1 -- 172.21.15.40:0/3271693338 shutdown_connections 2024-09-11T00:23:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.597+0000 7f0748a00640 1 --2- 172.21.15.40:0/3271693338 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0720077fa0 0x7f072007a460 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.597+0000 7f0748a00640 1 --2- 172.21.15.40:0/3271693338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07440cbc00 0x7f07441f7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.597+0000 7f0748a00640 1 --2- 172.21.15.40:0/3271693338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07441f4f00 0x7f07440cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.597+0000 7f0748a00640 1 --2- 172.21.15.40:0/3271693338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0728005280 0x7f074415a600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.597+0000 7f0748a00640 1 -- 172.21.15.40:0/3271693338 >> 172.21.15.40:0/3271693338 conn(0x7f07440d3c20 msgr2=0x7f07440b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.597+0000 7f0748a00640 1 -- 172.21.15.40:0/3271693338 shutdown_connections 2024-09-11T00:23:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.597+0000 7f0748a00640 1 -- 172.21.15.40:0/3271693338 wait complete. 2024-09-11T00:23:45.615 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T00:23:45.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.772+0000 7f74f3e00640 1 -- 172.21.15.40:0/2700790715 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74f406efa0 msgr2=0x7f74f4073830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:45.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.772+0000 7f74f3e00640 1 --2- 172.21.15.40:0/2700790715 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74f406efa0 0x7f74f4073830 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f74dc005fd0 tx=0x7f74dc02a670 comp rx=0 tx=0).stop 2024-09-11T00:23:45.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.772+0000 7f74f3e00640 1 -- 172.21.15.40:0/2700790715 shutdown_connections 2024-09-11T00:23:45.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.772+0000 7f74f3e00640 1 --2- 172.21.15.40:0/2700790715 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74f406efa0 0x7f74f4073830 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.772+0000 7f74f3e00640 1 -- 172.21.15.40:0/2700790715 >> 172.21.15.40:0/2700790715 conn(0x7f74f40cf770 msgr2=0x7f74f40cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:45.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.772+0000 7f74f3e00640 1 -- 172.21.15.40:0/2700790715 shutdown_connections 2024-09-11T00:23:45.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.772+0000 7f74f3e00640 1 -- 172.21.15.40:0/2700790715 wait complete. 2024-09-11T00:23:45.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.774+0000 7f74f3e00640 1 Processor -- start 2024-09-11T00:23:45.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.774+0000 7f74f3e00640 1 -- start start 2024-09-11T00:23:45.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.775+0000 7f74f3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74f406efa0 0x7f74f41f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.775+0000 7f74f3e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74f40ae640 0x7f74f41f8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.775+0000 7f74f3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74f415baa0 0x7f74f415a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.775+0000 7f74f3e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f74f415c750 con 0x7f74f406efa0 2024-09-11T00:23:45.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.775+0000 7f74f3e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f74f415c5d0 con 0x7f74f415baa0 2024-09-11T00:23:45.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.775+0000 7f74f3e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f74f415c8d0 con 0x7f74f40ae640 2024-09-11T00:23:45.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.775+0000 7f74f2a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74f406efa0 0x7f74f41f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.775+0000 7f74f2a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74f406efa0 0x7f74f41f5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53676/0 (socket says 172.21.15.40:53676) 2024-09-11T00:23:45.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.775+0000 7f74f2a00640 1 -- 172.21.15.40:0/989314693 learned_addr learned my addr 172.21.15.40:0/989314693 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:45.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.776+0000 7f74ea000640 1 --2- 172.21.15.40:0/989314693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74f40ae640 0x7f74f41f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.776+0000 7f74f2a00640 1 -- 172.21.15.40:0/989314693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74f40ae640 msgr2=0x7f74f41f8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:45.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.776+0000 7f74f3400640 1 --2- 172.21.15.40:0/989314693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74f415baa0 0x7f74f415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.776+0000 7f74f2a00640 1 --2- 172.21.15.40:0/989314693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74f40ae640 0x7f74f41f8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.776+0000 7f74f2a00640 1 -- 172.21.15.40:0/989314693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74f415baa0 msgr2=0x7f74f415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:45.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.776+0000 7f74f2a00640 1 --2- 172.21.15.40:0/989314693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74f415baa0 0x7f74f415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.776+0000 7f74f2a00640 1 -- 172.21.15.40:0/989314693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f41f8d90 con 0x7f74f406efa0 2024-09-11T00:23:45.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.776+0000 7f74ea000640 1 --2- 172.21.15.40:0/989314693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74f40ae640 0x7f74f41f8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:45.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.776+0000 7f74f3400640 1 --2- 172.21.15.40:0/989314693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74f415baa0 0x7f74f415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:45.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.776+0000 7f74f2a00640 1 --2- 172.21.15.40:0/989314693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74f406efa0 0x7f74f41f5340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f74e400c3a0 tx=0x7f74e400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:45.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.776+0000 7f74eb400640 1 -- 172.21.15.40:0/989314693 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e4017070 con 0x7f74f406efa0 2024-09-11T00:23:45.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.776+0000 7f74eb400640 1 -- 172.21.15.40:0/989314693 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74e40035f0 con 0x7f74f406efa0 2024-09-11T00:23:45.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.776+0000 7f74eb400640 1 -- 172.21.15.40:0/989314693 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e4003a40 con 0x7f74f406efa0 2024-09-11T00:23:45.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.776+0000 7f74f3e00640 1 -- 172.21.15.40:0/989314693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f40c8540 con 0x7f74f406efa0 2024-09-11T00:23:45.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.777+0000 7f74f3e00640 1 -- 172.21.15.40:0/989314693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f40c8b00 con 0x7f74f406efa0 2024-09-11T00:23:45.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.777+0000 7f74f3e00640 1 -- 172.21.15.40:0/989314693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74f4074010 con 0x7f74f406efa0 2024-09-11T00:23:45.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.779+0000 7f74eb400640 1 -- 172.21.15.40:0/989314693 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f74e4003be0 con 0x7f74f406efa0 2024-09-11T00:23:45.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.779+0000 7f74eb400640 1 --2- 172.21.15.40:0/989314693 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f74d0077f70 0x7f74d007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.780+0000 7f74eb400640 1 -- 172.21.15.40:0/989314693 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f74e4098fd0 con 0x7f74f406efa0 2024-09-11T00:23:45.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.780+0000 7f74ea000640 1 --2- 172.21.15.40:0/989314693 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f74d0077f70 0x7f74d007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.780+0000 7f74ea000640 1 --2- 172.21.15.40:0/989314693 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f74d0077f70 0x7f74d007a430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f74dc033000 tx=0x7f74dc004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:45.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.783+0000 7f74eb400640 1 -- 172.21.15.40:0/989314693 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f74e4061e10 con 0x7f74f406efa0 2024-09-11T00:23:45.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.980+0000 7f74f3e00640 1 -- 172.21.15.40:0/989314693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f74f40cfbf0 con 0x7f74f406efa0 2024-09-11T00:23:45.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.980+0000 7f74eb400640 1 -- 172.21.15.40:0/989314693 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f74e4061710 con 0x7f74f406efa0 2024-09-11T00:23:45.982 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:23:45.982 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2024-09-11T00:23:45.982 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:23:45.982 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2024-09-11T00:23:45.982 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2024-09-11T00:23:45.982 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:23:45.982 INFO:teuthology.orchestra.run.smithi040.stdout:] 2024-09-11T00:23:45.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.982+0000 7f74f3e00640 1 -- 172.21.15.40:0/989314693 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f74d0077f70 msgr2=0x7f74d007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:45.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.982+0000 7f74f3e00640 1 --2- 172.21.15.40:0/989314693 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f74d0077f70 0x7f74d007a430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f74dc033000 tx=0x7f74dc004730 comp rx=0 tx=0).stop 2024-09-11T00:23:45.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.982+0000 7f74f3e00640 1 -- 172.21.15.40:0/989314693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74f406efa0 msgr2=0x7f74f41f5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:45.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.982+0000 7f74f3e00640 1 --2- 172.21.15.40:0/989314693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74f406efa0 0x7f74f41f5340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f74e400c3a0 tx=0x7f74e400c860 comp rx=0 tx=0).stop 2024-09-11T00:23:45.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.982+0000 7f74f3e00640 1 -- 172.21.15.40:0/989314693 shutdown_connections 2024-09-11T00:23:45.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.982+0000 7f74f3e00640 1 --2- 172.21.15.40:0/989314693 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f74d0077f70 0x7f74d007a430 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.982+0000 7f74f3e00640 1 --2- 172.21.15.40:0/989314693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74f415baa0 0x7f74f415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.982+0000 7f74f3e00640 1 --2- 172.21.15.40:0/989314693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74f40ae640 0x7f74f41f8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.982+0000 7f74f3e00640 1 --2- 172.21.15.40:0/989314693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74f406efa0 0x7f74f41f5340 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.982+0000 7f74f3e00640 1 -- 172.21.15.40:0/989314693 >> 172.21.15.40:0/989314693 conn(0x7f74f40cf770 msgr2=0x7f74f40cb810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:45.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.982+0000 7f74f3e00640 1 -- 172.21.15.40:0/989314693 shutdown_connections 2024-09-11T00:23:45.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:45.983+0000 7f74f3e00640 1 -- 172.21.15.40:0/989314693 wait complete. 2024-09-11T00:23:45.999 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T00:23:45.999 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T00:23:46.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.163+0000 7fc10f200640 1 -- 172.21.15.40:0/336982135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0f4003fd0 msgr2=0x7fc0f4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:46.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.163+0000 7fc10f200640 1 --2- 172.21.15.40:0/336982135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0f4003fd0 0x7fc0f4004800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800c260 tx=0x7fc0f4005830 comp rx=0 tx=0).stop 2024-09-11T00:23:46.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.163+0000 7fc10e800640 1 -- 172.21.15.40:0/336982135 reap_dead start 2024-09-11T00:23:46.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.163+0000 7fc10f200640 1 -- 172.21.15.40:0/336982135 shutdown_connections 2024-09-11T00:23:46.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.163+0000 7fc10f200640 1 -- 172.21.15.40:0/336982135 >> 172.21.15.40:0/336982135 conn(0x7fc1100cf850 msgr2=0x7fc1100cfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:46.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.163+0000 7fc10f200640 1 -- 172.21.15.40:0/336982135 shutdown_connections 2024-09-11T00:23:46.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.163+0000 7fc10f200640 1 -- 172.21.15.40:0/336982135 wait complete. 2024-09-11T00:23:46.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.165+0000 7fc10f200640 1 Processor -- start 2024-09-11T00:23:46.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.165+0000 7fc10f200640 1 -- start start 2024-09-11T00:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.166+0000 7fc10f200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0f4003fd0 0x7fc110151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.166+0000 7fc10f200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1100b3ab0 0x7fc110154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.166+0000 7fc10f200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc110155470 0x7fc1100c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.166+0000 7fc10f200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc1100724c0 con 0x7fc110155470 2024-09-11T00:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.166+0000 7fc10f200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc110072340 con 0x7fc0f4003fd0 2024-09-11T00:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.166+0000 7fc10f200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc110072640 con 0x7fc1100b3ab0 2024-09-11T00:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.166+0000 7fc10e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc110155470 0x7fc1100c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.166+0000 7fc10e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc110155470 0x7fc1100c6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53696/0 (socket says 172.21.15.40:53696) 2024-09-11T00:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.166+0000 7fc10e800640 1 -- 172.21.15.40:0/2532816388 learned_addr learned my addr 172.21.15.40:0/2532816388 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.167+0000 7fc10de00640 1 --2- 172.21.15.40:0/2532816388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0f4003fd0 0x7fc110151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.167+0000 7fc105400640 1 --2- 172.21.15.40:0/2532816388 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1100b3ab0 0x7fc110154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.167+0000 7fc10e800640 1 -- 172.21.15.40:0/2532816388 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1100b3ab0 msgr2=0x7fc110154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.167+0000 7fc10e800640 1 --2- 172.21.15.40:0/2532816388 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1100b3ab0 0x7fc110154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.167+0000 7fc10e800640 1 -- 172.21.15.40:0/2532816388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0f4003fd0 msgr2=0x7fc110151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.167+0000 7fc10e800640 1 --2- 172.21.15.40:0/2532816388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0f4003fd0 0x7fc110151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.167+0000 7fc10e800640 1 -- 172.21.15.40:0/2532816388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1100b2a10 con 0x7fc110155470 2024-09-11T00:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.167+0000 7fc105400640 1 --2- 172.21.15.40:0/2532816388 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1100b3ab0 0x7fc110154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.167+0000 7fc10e800640 1 --2- 172.21.15.40:0/2532816388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc110155470 0x7fc1100c6a20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc108011b00 tx=0x7fc108009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.167+0000 7fc106a00640 1 -- 172.21.15.40:0/2532816388 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108004b20 con 0x7fc110155470 2024-09-11T00:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.167+0000 7fc106a00640 1 -- 172.21.15.40:0/2532816388 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc108004cc0 con 0x7fc110155470 2024-09-11T00:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.167+0000 7fc106a00640 1 -- 172.21.15.40:0/2532816388 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108003bd0 con 0x7fc110155470 2024-09-11T00:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.167+0000 7fc10f200640 1 -- 172.21.15.40:0/2532816388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1100b2cf0 con 0x7fc110155470 2024-09-11T00:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.167+0000 7fc10f200640 1 -- 172.21.15.40:0/2532816388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1100b32b0 con 0x7fc110155470 2024-09-11T00:23:46.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.169+0000 7fc10f200640 1 -- 172.21.15.40:0/2532816388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1100cc1f0 con 0x7fc110155470 2024-09-11T00:23:46.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.170+0000 7fc106a00640 1 -- 172.21.15.40:0/2532816388 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc108018070 con 0x7fc110155470 2024-09-11T00:23:46.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.170+0000 7fc106a00640 1 --2- 172.21.15.40:0/2532816388 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc0ec077f70 0x7fc0ec07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:46.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.171+0000 7fc106a00640 1 -- 172.21.15.40:0/2532816388 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fc108099d20 con 0x7fc110155470 2024-09-11T00:23:46.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.171+0000 7fc10de00640 1 --2- 172.21.15.40:0/2532816388 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc0ec077f70 0x7fc0ec07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:46.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.172+0000 7fc10de00640 1 --2- 172.21.15.40:0/2532816388 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc0ec077f70 0x7fc0ec07a430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc100009c10 tx=0x7fc100005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:46.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.175+0000 7fc106a00640 1 -- 172.21.15.40:0/2532816388 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc108062b70 con 0x7fc110155470 2024-09-11T00:23:46.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.370+0000 7fc10f200640 1 -- 172.21.15.40:0/2532816388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc1100d0560 con 0x7fc110155470 2024-09-11T00:23:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.896+0000 7fc106a00640 1 -- 172.21.15.40:0/2532816388 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7fc108062470 con 0x7fc110155470 2024-09-11T00:23:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2024-09-11T00:23:46.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.899+0000 7fc10f200640 1 -- 172.21.15.40:0/2532816388 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc0ec077f70 msgr2=0x7fc0ec07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:46.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.899+0000 7fc10f200640 1 --2- 172.21.15.40:0/2532816388 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc0ec077f70 0x7fc0ec07a430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc100009c10 tx=0x7fc100005f90 comp rx=0 tx=0).stop 2024-09-11T00:23:46.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.899+0000 7fc10f200640 1 -- 172.21.15.40:0/2532816388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc110155470 msgr2=0x7fc1100c6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:46.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.899+0000 7fc10f200640 1 --2- 172.21.15.40:0/2532816388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc110155470 0x7fc1100c6a20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc108011b00 tx=0x7fc108009200 comp rx=0 tx=0).stop 2024-09-11T00:23:46.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.899+0000 7fc10f200640 1 -- 172.21.15.40:0/2532816388 shutdown_connections 2024-09-11T00:23:46.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.899+0000 7fc10f200640 1 --2- 172.21.15.40:0/2532816388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc110155470 0x7fc1100c6a20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:46.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.899+0000 7fc10f200640 1 --2- 172.21.15.40:0/2532816388 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1100b3ab0 0x7fc110154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:46.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.899+0000 7fc10f200640 1 --2- 172.21.15.40:0/2532816388 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc0ec077f70 0x7fc0ec07a430 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:46.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.899+0000 7fc10f200640 1 --2- 172.21.15.40:0/2532816388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0f4003fd0 0x7fc110151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:46.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.899+0000 7fc10f200640 1 -- 172.21.15.40:0/2532816388 >> 172.21.15.40:0/2532816388 conn(0x7fc1100cf850 msgr2=0x7fc1100b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:46.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.900+0000 7fc10f200640 1 -- 172.21.15.40:0/2532816388 shutdown_connections 2024-09-11T00:23:46.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:46.901+0000 7fc10f200640 1 -- 172.21.15.40:0/2532816388 wait complete. 2024-09-11T00:23:46.924 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T00:23:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.090+0000 7f2357e00640 1 -- 172.21.15.40:0/10722100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2358073f40 msgr2=0x7f235806edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.090+0000 7f2357e00640 1 --2- 172.21.15.40:0/10722100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2358073f40 0x7f235806edd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f235806e2a0 tx=0x7f235002aa10 comp rx=0 tx=0).stop 2024-09-11T00:23:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.090+0000 7f2357e00640 1 -- 172.21.15.40:0/10722100 shutdown_connections 2024-09-11T00:23:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.090+0000 7f2357e00640 1 --2- 172.21.15.40:0/10722100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2358073f40 0x7f235806edd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.090+0000 7f2357e00640 1 --2- 172.21.15.40:0/10722100 >> v2:172.21.15.175:3300/0 conn(0x7f235815baa0 0x7f235806e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.090+0000 7f2357e00640 1 -- 172.21.15.40:0/10722100 >> 172.21.15.40:0/10722100 conn(0x7f23580cf770 msgr2=0x7f23580cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.090+0000 7f2357e00640 1 -- 172.21.15.40:0/10722100 shutdown_connections 2024-09-11T00:23:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.090+0000 7f2357e00640 1 -- 172.21.15.40:0/10722100 wait complete. 2024-09-11T00:23:47.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.091+0000 7f2357e00640 1 Processor -- start 2024-09-11T00:23:47.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.092+0000 7f2357e00640 1 -- start start 2024-09-11T00:23:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.092+0000 7f2357e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2358073f40 0x7f23581f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.092+0000 7f2357e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23580ae640 0x7f23580c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.092+0000 7f2357e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f235815baa0 0x7f23581f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.092+0000 7f2357e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f235815be80 con 0x7f2358073f40 2024-09-11T00:23:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.093+0000 7f2357e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f23580b5760 con 0x7f23580ae640 2024-09-11T00:23:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.093+0000 7f2357e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f235815c000 con 0x7f235815baa0 2024-09-11T00:23:47.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.093+0000 7f2356a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2358073f40 0x7f23581f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:47.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.093+0000 7f2356a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2358073f40 0x7f23581f2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53710/0 (socket says 172.21.15.40:53710) 2024-09-11T00:23:47.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.093+0000 7f2356a00640 1 -- 172.21.15.40:0/3287201649 learned_addr learned my addr 172.21.15.40:0/3287201649 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:47.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.093+0000 7f234e000640 1 --2- 172.21.15.40:0/3287201649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23580ae640 0x7f23580c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:47.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.093+0000 7f2357400640 1 --2- 172.21.15.40:0/3287201649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f235815baa0 0x7f23581f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:47.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.093+0000 7f2356a00640 1 -- 172.21.15.40:0/3287201649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f235815baa0 msgr2=0x7f23581f5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:47.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.093+0000 7f2356a00640 1 --2- 172.21.15.40:0/3287201649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f235815baa0 0x7f23581f5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:47.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.093+0000 7f2356a00640 1 -- 172.21.15.40:0/3287201649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23580ae640 msgr2=0x7f23580c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:47.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.093+0000 7f2356a00640 1 --2- 172.21.15.40:0/3287201649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23580ae640 0x7f23580c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:47.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.093+0000 7f2356a00640 1 -- 172.21.15.40:0/3287201649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23580c8030 con 0x7f2358073f40 2024-09-11T00:23:47.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.093+0000 7f2357400640 1 --2- 172.21.15.40:0/3287201649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f235815baa0 0x7f23581f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:47.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.093+0000 7f234e000640 1 --2- 172.21.15.40:0/3287201649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23580ae640 0x7f23580c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.093+0000 7f2356a00640 1 --2- 172.21.15.40:0/3287201649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2358073f40 0x7f23581f2ed0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f234800b440 tx=0x7f234800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.094+0000 7f234f400640 1 -- 172.21.15.40:0/3287201649 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2348015020 con 0x7f2358073f40 2024-09-11T00:23:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.094+0000 7f234f400640 1 -- 172.21.15.40:0/3287201649 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2348011980 con 0x7f2358073f40 2024-09-11T00:23:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.094+0000 7f234f400640 1 -- 172.21.15.40:0/3287201649 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2348011dd0 con 0x7f2358073f40 2024-09-11T00:23:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.094+0000 7f2357e00640 1 -- 172.21.15.40:0/3287201649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23580c8310 con 0x7f2358073f40 2024-09-11T00:23:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.094+0000 7f2357e00640 1 -- 172.21.15.40:0/3287201649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23580c88d0 con 0x7f2358073f40 2024-09-11T00:23:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.095+0000 7f2357e00640 1 -- 172.21.15.40:0/3287201649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23580ce680 con 0x7f2358073f40 2024-09-11T00:23:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.097+0000 7f234f400640 1 -- 172.21.15.40:0/3287201649 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2348024480 con 0x7f2358073f40 2024-09-11T00:23:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.098+0000 7f234f400640 1 --2- 172.21.15.40:0/3287201649 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2334077f70 0x7f233407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:47.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.098+0000 7f234f400640 1 -- 172.21.15.40:0/3287201649 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f234809a4e0 con 0x7f2358073f40 2024-09-11T00:23:47.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.099+0000 7f234e000640 1 --2- 172.21.15.40:0/3287201649 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2334077f70 0x7f233407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:47.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.099+0000 7f234e000640 1 --2- 172.21.15.40:0/3287201649 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2334077f70 0x7f233407a430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23581eff20 tx=0x7f2340009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:47.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.102+0000 7f234f400640 1 -- 172.21.15.40:0/3287201649 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f234801f020 con 0x7f2358073f40 2024-09-11T00:23:47.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.299+0000 7f2357e00640 1 -- 172.21.15.40:0/3287201649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2358076060 con 0x7f2358073f40 2024-09-11T00:23:47.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.902+0000 7f234f400640 1 -- 172.21.15.40:0/3287201649 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) ==== 170+0+0 (secure 0 0 0) 0x7f234800d040 con 0x7f2358073f40 2024-09-11T00:23:47.903 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2024-09-11T00:23:47.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.906+0000 7f2357e00640 1 -- 172.21.15.40:0/3287201649 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2334077f70 msgr2=0x7f233407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:47.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.906+0000 7f2357e00640 1 --2- 172.21.15.40:0/3287201649 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2334077f70 0x7f233407a430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23581eff20 tx=0x7f2340009040 comp rx=0 tx=0).stop 2024-09-11T00:23:47.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.906+0000 7f2357e00640 1 -- 172.21.15.40:0/3287201649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2358073f40 msgr2=0x7f23581f2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:47.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.906+0000 7f2357e00640 1 --2- 172.21.15.40:0/3287201649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2358073f40 0x7f23581f2ed0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f234800b440 tx=0x7f234800b900 comp rx=0 tx=0).stop 2024-09-11T00:23:47.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.906+0000 7f2357e00640 1 -- 172.21.15.40:0/3287201649 shutdown_connections 2024-09-11T00:23:47.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.906+0000 7f2357e00640 1 --2- 172.21.15.40:0/3287201649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f235815baa0 0x7f23581f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:47.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.906+0000 7f2357e00640 1 --2- 172.21.15.40:0/3287201649 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2334077f70 0x7f233407a430 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:47.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.906+0000 7f2357e00640 1 --2- 172.21.15.40:0/3287201649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23580ae640 0x7f23580c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:47.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.906+0000 7f2357e00640 1 --2- 172.21.15.40:0/3287201649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2358073f40 0x7f23581f2ed0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:47.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.906+0000 7f2357e00640 1 -- 172.21.15.40:0/3287201649 >> 172.21.15.40:0/3287201649 conn(0x7f23580cf770 msgr2=0x7f23580b4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:47.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.906+0000 7f2357e00640 1 -- 172.21.15.40:0/3287201649 shutdown_connections 2024-09-11T00:23:47.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:47.907+0000 7f2357e00640 1 -- 172.21.15.40:0/3287201649 wait complete. 2024-09-11T00:23:47.943 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T00:23:48.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.105+0000 7f40a8e00640 1 -- 172.21.15.40:0/3313730841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40a415bcc0 msgr2=0x7f40a40cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:48.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.105+0000 7f40a8e00640 1 --2- 172.21.15.40:0/3313730841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40a415bcc0 0x7f40a40cb420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4094009860 tx=0x7f409402a540 comp rx=0 tx=0).stop 2024-09-11T00:23:48.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.105+0000 7f40a8e00640 1 -- 172.21.15.40:0/3313730841 shutdown_connections 2024-09-11T00:23:48.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.105+0000 7f40a8e00640 1 --2- 172.21.15.40:0/3313730841 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40a406f920 0x7f40a40cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.105+0000 7f40a8e00640 1 --2- 172.21.15.40:0/3313730841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40a415bcc0 0x7f40a40cb420 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.105+0000 7f40a8e00640 1 -- 172.21.15.40:0/3313730841 >> 172.21.15.40:0/3313730841 conn(0x7f40a40cfbb0 msgr2=0x7f40a40cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.105+0000 7f40a8e00640 1 -- 172.21.15.40:0/3313730841 shutdown_connections 2024-09-11T00:23:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.105+0000 7f40a8e00640 1 -- 172.21.15.40:0/3313730841 wait complete. 2024-09-11T00:23:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.107+0000 7f40a8e00640 1 Processor -- start 2024-09-11T00:23:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.107+0000 7f40a8e00640 1 -- start start 2024-09-11T00:23:48.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.108+0000 7f40a8e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40a406f920 0x7f40a4158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.108+0000 7f40a8e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40a40cba70 0x7f40a41f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.108+0000 7f40a8e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40a415bcc0 0x7f40a41f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.108+0000 7f40a8e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f40a415f940 con 0x7f40a40cba70 2024-09-11T00:23:48.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.108+0000 7f40a8e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f40a415f7c0 con 0x7f40a406f920 2024-09-11T00:23:48.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.108+0000 7f40a8e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f40a40ca910 con 0x7f40a415bcc0 2024-09-11T00:23:48.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.108+0000 7f4099400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40a40cba70 0x7f40a41f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.108+0000 7f4099400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40a40cba70 0x7f40a41f2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42090/0 (socket says 172.21.15.40:42090) 2024-09-11T00:23:48.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.108+0000 7f4099400640 1 -- 172.21.15.40:0/2679611823 learned_addr learned my addr 172.21.15.40:0/2679611823 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:48.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.109+0000 7f40a2800640 1 --2- 172.21.15.40:0/2679611823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40a415bcc0 0x7f40a41f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.109+0000 7f40a1e00640 1 --2- 172.21.15.40:0/2679611823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40a406f920 0x7f40a4158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.109+0000 7f4099400640 1 -- 172.21.15.40:0/2679611823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40a415bcc0 msgr2=0x7f40a41f26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:48.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.109+0000 7f4099400640 1 --2- 172.21.15.40:0/2679611823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40a415bcc0 0x7f40a41f26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.109+0000 7f4099400640 1 -- 172.21.15.40:0/2679611823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40a406f920 msgr2=0x7f40a4158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:48.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.109+0000 7f4099400640 1 --2- 172.21.15.40:0/2679611823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40a406f920 0x7f40a4158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.109+0000 7f4099400640 1 -- 172.21.15.40:0/2679611823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a41587a0 con 0x7f40a40cba70 2024-09-11T00:23:48.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.109+0000 7f4099400640 1 --2- 172.21.15.40:0/2679611823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40a40cba70 0x7f40a41f2160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f408c00c500 tx=0x7f408c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:48.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.109+0000 7f409aa00640 1 -- 172.21.15.40:0/2679611823 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408c017070 con 0x7f40a40cba70 2024-09-11T00:23:48.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.109+0000 7f409aa00640 1 -- 172.21.15.40:0/2679611823 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f408c0035f0 con 0x7f40a40cba70 2024-09-11T00:23:48.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.109+0000 7f409aa00640 1 -- 172.21.15.40:0/2679611823 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408c003a40 con 0x7f40a40cba70 2024-09-11T00:23:48.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.109+0000 7f40a8e00640 1 -- 172.21.15.40:0/2679611823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40a41f2ce0 con 0x7f40a40cba70 2024-09-11T00:23:48.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.109+0000 7f40a8e00640 1 -- 172.21.15.40:0/2679611823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40a41f3580 con 0x7f40a40cba70 2024-09-11T00:23:48.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.110+0000 7f40a8e00640 1 -- 172.21.15.40:0/2679611823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40a41f3370 con 0x7f40a40cba70 2024-09-11T00:23:48.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.112+0000 7f409aa00640 1 -- 172.21.15.40:0/2679611823 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f408c003be0 con 0x7f40a40cba70 2024-09-11T00:23:48.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.113+0000 7f409aa00640 1 --2- 172.21.15.40:0/2679611823 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4080077f70 0x7f408007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.114+0000 7f409aa00640 1 -- 172.21.15.40:0/2679611823 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f408c099530 con 0x7f40a40cba70 2024-09-11T00:23:48.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.114+0000 7f40a1e00640 1 --2- 172.21.15.40:0/2679611823 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4080077f70 0x7f408007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.114+0000 7f40a1e00640 1 --2- 172.21.15.40:0/2679611823 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4080077f70 0x7f408007a430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4094034000 tx=0x7f4094004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:48.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.118+0000 7f409aa00640 1 -- 172.21.15.40:0/2679611823 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f408c062080 con 0x7f40a40cba70 2024-09-11T00:23:48.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.350+0000 7f40a8e00640 1 -- 172.21.15.40:0/2679611823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f40a40b31b0 con 0x7f40a40cba70 2024-09-11T00:23:48.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.905+0000 7f409aa00640 1 -- 172.21.15.40:0/2679611823 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f408c061980 con 0x7f40a40cba70 2024-09-11T00:23:48.906 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 2 and data pool 3 2024-09-11T00:23:48.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.908+0000 7f40a8e00640 1 -- 172.21.15.40:0/2679611823 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4080077f70 msgr2=0x7f408007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:48.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.908+0000 7f40a8e00640 1 --2- 172.21.15.40:0/2679611823 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4080077f70 0x7f408007a430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4094034000 tx=0x7f4094004730 comp rx=0 tx=0).stop 2024-09-11T00:23:48.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.908+0000 7f40a8e00640 1 -- 172.21.15.40:0/2679611823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40a40cba70 msgr2=0x7f40a41f2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:48.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.908+0000 7f40a8e00640 1 --2- 172.21.15.40:0/2679611823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40a40cba70 0x7f40a41f2160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f408c00c500 tx=0x7f408c00c9c0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.909+0000 7f40a8e00640 1 -- 172.21.15.40:0/2679611823 shutdown_connections 2024-09-11T00:23:48.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.909+0000 7f40a8e00640 1 --2- 172.21.15.40:0/2679611823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40a415bcc0 0x7f40a41f26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.909+0000 7f40a8e00640 1 --2- 172.21.15.40:0/2679611823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40a40cba70 0x7f40a41f2160 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f408c00c500 tx=0x7f408c00c9c0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.909+0000 7f40a8e00640 1 --2- 172.21.15.40:0/2679611823 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4080077f70 0x7f408007a430 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4094034000 tx=0x7f4094004730 comp rx=0 tx=0).stop 2024-09-11T00:23:48.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.909+0000 7f40a8e00640 1 --2- 172.21.15.40:0/2679611823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40a406f920 0x7f40a4158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.909+0000 7f40a8e00640 1 -- 172.21.15.40:0/2679611823 >> 172.21.15.40:0/2679611823 conn(0x7f40a40cfbb0 msgr2=0x7f40a40b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:48.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.911+0000 7f40a8e00640 1 -- 172.21.15.40:0/2679611823 shutdown_connections 2024-09-11T00:23:48.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:48.912+0000 7f40a8e00640 1 -- 172.21.15.40:0/2679611823 wait complete. 2024-09-11T00:23:48.961 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:23:49.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.121+0000 7fc8a6c00640 1 -- 172.21.15.40:0/1409607108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a015baa0 msgr2=0x7fc8a006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.121+0000 7fc8a6c00640 1 --2- 172.21.15.40:0/1409607108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a015baa0 0x7fc8a006e890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc894005fd0 tx=0x7fc89402a5d0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.122+0000 7fc8a6c00640 1 -- 172.21.15.40:0/1409607108 shutdown_connections 2024-09-11T00:23:49.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.122+0000 7fc8a6c00640 1 --2- 172.21.15.40:0/1409607108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a015baa0 0x7fc8a006e890 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.122+0000 7fc8a6c00640 1 -- 172.21.15.40:0/1409607108 >> 172.21.15.40:0/1409607108 conn(0x7fc8a00cf770 msgr2=0x7fc8a00cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:49.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.122+0000 7fc8a6c00640 1 -- 172.21.15.40:0/1409607108 shutdown_connections 2024-09-11T00:23:49.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.122+0000 7fc8a6c00640 1 -- 172.21.15.40:0/1409607108 wait complete. 2024-09-11T00:23:49.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.123+0000 7fc8a6c00640 1 Processor -- start 2024-09-11T00:23:49.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.123+0000 7fc8a6c00640 1 -- start start 2024-09-11T00:23:49.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.124+0000 7fc8a6c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a0073f40 0x7fc8a00c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.124+0000 7fc8a6c00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8a00ae640 0x7fc8a00c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.124+0000 7fc8a6c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a015baa0 0x7fc8a01f8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.124+0000 7fc8a6c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a015c710 con 0x7fc8a0073f40 2024-09-11T00:23:49.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.124+0000 7fc8a6c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a015c590 con 0x7fc8a015baa0 2024-09-11T00:23:49.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.124+0000 7fc8a6c00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc8a015c890 con 0x7fc8a00ae640 2024-09-11T00:23:49.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.125+0000 7fc8a5800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a0073f40 0x7fc8a00c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.125+0000 7fc8a5800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a0073f40 0x7fc8a00c3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42110/0 (socket says 172.21.15.40:42110) 2024-09-11T00:23:49.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.125+0000 7fc8a5800640 1 -- 172.21.15.40:0/3119640428 learned_addr learned my addr 172.21.15.40:0/3119640428 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:49.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.125+0000 7fc8a6200640 1 --2- 172.21.15.40:0/3119640428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a015baa0 0x7fc8a01f8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.125+0000 7fc8a4e00640 1 --2- 172.21.15.40:0/3119640428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8a00ae640 0x7fc8a00c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.125+0000 7fc8a5800640 1 -- 172.21.15.40:0/3119640428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8a00ae640 msgr2=0x7fc8a00c3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.125+0000 7fc8a5800640 1 --2- 172.21.15.40:0/3119640428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8a00ae640 0x7fc8a00c3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.125+0000 7fc8a5800640 1 -- 172.21.15.40:0/3119640428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a015baa0 msgr2=0x7fc8a01f8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.125+0000 7fc8a5800640 1 --2- 172.21.15.40:0/3119640428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a015baa0 0x7fc8a01f8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.125+0000 7fc8a5800640 1 -- 172.21.15.40:0/3119640428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a00c44d0 con 0x7fc8a0073f40 2024-09-11T00:23:49.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.125+0000 7fc8a4e00640 1 --2- 172.21.15.40:0/3119640428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8a00ae640 0x7fc8a00c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:49.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.125+0000 7fc8a5800640 1 --2- 172.21.15.40:0/3119640428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a0073f40 0x7fc8a00c3e60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc894034040 tx=0x7fc8940038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:49.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.126+0000 7fc89d600640 1 -- 172.21.15.40:0/3119640428 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89403e030 con 0x7fc8a0073f40 2024-09-11T00:23:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.126+0000 7fc89d600640 1 -- 172.21.15.40:0/3119640428 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc894003ca0 con 0x7fc8a0073f40 2024-09-11T00:23:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.126+0000 7fc8a6c00640 1 -- 172.21.15.40:0/3119640428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a00c47b0 con 0x7fc8a0073f40 2024-09-11T00:23:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.126+0000 7fc89d600640 1 -- 172.21.15.40:0/3119640428 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc894035040 con 0x7fc8a0073f40 2024-09-11T00:23:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.126+0000 7fc8a6c00640 1 -- 172.21.15.40:0/3119640428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a01f7b60 con 0x7fc8a0073f40 2024-09-11T00:23:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.127+0000 7fc8a6c00640 1 -- 172.21.15.40:0/3119640428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a006ef40 con 0x7fc8a0073f40 2024-09-11T00:23:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.128+0000 7fc89d600640 1 -- 172.21.15.40:0/3119640428 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc894004a00 con 0x7fc8a0073f40 2024-09-11T00:23:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.129+0000 7fc89d600640 1 --2- 172.21.15.40:0/3119640428 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc880077f70 0x7fc88007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.129+0000 7fc89d600640 1 -- 172.21.15.40:0/3119640428 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc8940ba490 con 0x7fc8a0073f40 2024-09-11T00:23:49.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.130+0000 7fc8a4e00640 1 --2- 172.21.15.40:0/3119640428 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc880077f70 0x7fc88007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.130+0000 7fc8a4e00640 1 --2- 172.21.15.40:0/3119640428 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc880077f70 0x7fc88007a430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00ae3d0 tx=0x7fc88c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:49.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.133+0000 7fc89d600640 1 -- 172.21.15.40:0/3119640428 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc8940829d0 con 0x7fc8a0073f40 2024-09-11T00:23:49.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.327+0000 7fc8a6c00640 1 -- 172.21.15.40:0/3119640428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8a00008d0 con 0x7fc8a0073f40 2024-09-11T00:23:49.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.328+0000 7fc89d600640 1 -- 172.21.15.40:0/3119640428 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16654 (secure 0 0 0) 0x7fc894087400 con 0x7fc8a0073f40 2024-09-11T00:23:49.330 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:23:49.330 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":21,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","created":"2024-09-11T00:23:22.512139+0000","modified":"2024-09-11T00:23:48.351719+0000","last_up_change":"2024-09-11T00:23:36.842446+0000","last_in_change":"2024-09-11T00:23:26.734953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:23:37.800502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:23:46.379819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:23:47.307802+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee10e123-8817-4d94-a340-73d00121af37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6801","nonce":973366008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6803","nonce":973366008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6807","nonce":973366008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6805","nonce":973366008}]},"public_addr":"172.21.15.40:6801/973366008","cluster_addr":"172.21.15.40:6803/973366008","heartbeat_back_addr":"172.21.15.40:6807/973366008","heartbeat_front_addr":"172.21.15.40:6805/973366008","state":["exists","up"]},{"osd":1,"uuid":"f90895e9-8660-42b9-8aba-3f9d4d130b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6823","nonce":2542266029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6827","nonce":2542266029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6831","nonce":2542266029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6829","nonce":2542266029}]},"public_addr":"172.21.15.40:6823/2542266029","cluster_addr":"172.21.15.40:6827/2542266029","heartbeat_back_addr":"172.21.15.40:6831/2542266029","heartbeat_front_addr":"172.21.15.40:6829/2542266029","state":["exists","up"]},{"osd":2,"uuid":"a190497a-2aba-4748-8f1d-7e372259d65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6815","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6817","nonce":559505356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6819","nonce":559505356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6826","nonce":559505356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6822","nonce":559505356}]},"public_addr":"172.21.15.40:6817/559505356","cluster_addr":"172.21.15.40:6819/559505356","heartbeat_back_addr":"172.21.15.40:6826/559505356","heartbeat_front_addr":"172.21.15.40:6822/559505356","state":["exists","up"]},{"osd":3,"uuid":"8be32ced-898a-46f2-b850-1517667766b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6809","nonce":503633839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6811","nonce":503633839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6816","nonce":503633839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6813","nonce":503633839}]},"public_addr":"172.21.15.40:6809/503633839","cluster_addr":"172.21.15.40:6811/503633839","heartbeat_back_addr":"172.21.15.40:6816/503633839","heartbeat_front_addr":"172.21.15.40:6813/503633839","state":["exists","up"]},{"osd":4,"uuid":"9867fdfc-6f93-466e-b768-b5a1da7157de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6811","nonce":2418348042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6813","nonce":2418348042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6817","nonce":2418348042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6815","nonce":2418348042}]},"public_addr":"172.21.15.175:6811/2418348042","cluster_addr":"172.21.15.175:6813/2418348042","heartbeat_back_addr":"172.21.15.175:6817/2418348042","heartbeat_front_addr":"172.21.15.175:6815/2418348042","state":["exists","up"]},{"osd":5,"uuid":"e2f6f616-b5db-466e-942f-e2762171a8ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6827","nonce":520822300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6829","nonce":520822300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6833","nonce":520822300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6831","nonce":520822300}]},"public_addr":"172.21.15.175:6827/520822300","cluster_addr":"172.21.15.175:6829/520822300","heartbeat_back_addr":"172.21.15.175:6833/520822300","heartbeat_front_addr":"172.21.15.175:6831/520822300","state":["exists","up"]},{"osd":6,"uuid":"807ac045-bf63-4ff6-9a06-7f7022f9ef32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6819","nonce":1431736593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6821","nonce":1431736593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6825","nonce":1431736593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6823","nonce":1431736593}]},"public_addr":"172.21.15.175:6819/1431736593","cluster_addr":"172.21.15.175:6821/1431736593","heartbeat_back_addr":"172.21.15.175:6825/1431736593","heartbeat_front_addr":"172.21.15.175:6823/1431736593","state":["exists","up"]},{"osd":7,"uuid":"8e0b3293-390f-4b43-b29d-babdc5e88f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6803","nonce":3300317000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6805","nonce":3300317000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6809","nonce":3300317000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6807","nonce":3300317000}]},"public_addr":"172.21.15.175:6803/3300317000","cluster_addr":"172.21.15.175:6805/3300317000","heartbeat_back_addr":"172.21.15.175:6809/3300317000","heartbeat_front_addr":"172.21.15.175:6807/3300317000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:32.967062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.266558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.063509+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.616332+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.431077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.866822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.645225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.016210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:23:49.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.330+0000 7fc8a6c00640 1 -- 172.21.15.40:0/3119640428 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc880077f70 msgr2=0x7fc88007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.330+0000 7fc8a6c00640 1 --2- 172.21.15.40:0/3119640428 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc880077f70 0x7fc88007a430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00ae3d0 tx=0x7fc88c009040 comp rx=0 tx=0).stop 2024-09-11T00:23:49.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.330+0000 7fc8a6c00640 1 -- 172.21.15.40:0/3119640428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a0073f40 msgr2=0x7fc8a00c3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.330+0000 7fc8a6c00640 1 --2- 172.21.15.40:0/3119640428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a0073f40 0x7fc8a00c3e60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc894034040 tx=0x7fc8940038a0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.331+0000 7fc8a6c00640 1 -- 172.21.15.40:0/3119640428 shutdown_connections 2024-09-11T00:23:49.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.331+0000 7fc8a6c00640 1 --2- 172.21.15.40:0/3119640428 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc880077f70 0x7fc88007a430 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.331+0000 7fc8a6c00640 1 --2- 172.21.15.40:0/3119640428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a015baa0 0x7fc8a01f8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.331+0000 7fc8a6c00640 1 --2- 172.21.15.40:0/3119640428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8a00ae640 0x7fc8a00c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.331+0000 7fc8a6c00640 1 --2- 172.21.15.40:0/3119640428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a0073f40 0x7fc8a00c3e60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.331+0000 7fc8a6c00640 1 -- 172.21.15.40:0/3119640428 >> 172.21.15.40:0/3119640428 conn(0x7fc8a00cf770 msgr2=0x7fc8a006f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:49.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.331+0000 7fc8a6c00640 1 -- 172.21.15.40:0/3119640428 shutdown_connections 2024-09-11T00:23:49.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.331+0000 7fc8a6c00640 1 -- 172.21.15.40:0/3119640428 wait complete. 2024-09-11T00:23:49.348 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:23:49.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.507+0000 7fd528e00640 1 -- 172.21.15.40:0/3394903141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd52415ec70 msgr2=0x7fd52415e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.507+0000 7fd528e00640 1 --2- 172.21.15.40:0/3394903141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd52415ec70 0x7fd52415e3b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd514009830 tx=0x7fd51402a5c0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.507+0000 7fd528e00640 1 -- 172.21.15.40:0/3394903141 shutdown_connections 2024-09-11T00:23:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.507+0000 7fd528e00640 1 --2- 172.21.15.40:0/3394903141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd52415ec70 0x7fd52415e3b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.507+0000 7fd528e00640 1 -- 172.21.15.40:0/3394903141 >> 172.21.15.40:0/3394903141 conn(0x7fd5240cfbb0 msgr2=0x7fd5240cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.507+0000 7fd528e00640 1 -- 172.21.15.40:0/3394903141 shutdown_connections 2024-09-11T00:23:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.507+0000 7fd528e00640 1 -- 172.21.15.40:0/3394903141 wait complete. 2024-09-11T00:23:49.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.508+0000 7fd528e00640 1 Processor -- start 2024-09-11T00:23:49.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.509+0000 7fd528e00640 1 -- start start 2024-09-11T00:23:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.509+0000 7fd528e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5240cd780 0x7fd52414e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.510+0000 7fd528e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd52415ec70 0x7fd5240c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.510+0000 7fd528e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd52415f050 0x7fd5240c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.510+0000 7fd528e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd524169450 con 0x7fd52415ec70 2024-09-11T00:23:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.510+0000 7fd528e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd5240ce070 con 0x7fd52415f050 2024-09-11T00:23:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.510+0000 7fd528e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd5241695d0 con 0x7fd5240cd780 2024-09-11T00:23:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.510+0000 7fd51be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd52415ec70 0x7fd5240c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.510+0000 7fd51be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd52415ec70 0x7fd5240c94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42116/0 (socket says 172.21.15.40:42116) 2024-09-11T00:23:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.510+0000 7fd51be00640 1 -- 172.21.15.40:0/1307756236 learned_addr learned my addr 172.21.15.40:0/1307756236 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.510+0000 7fd521e00640 1 --2- 172.21.15.40:0/1307756236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5240cd780 0x7fd52414e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.510+0000 7fd522800640 1 --2- 172.21.15.40:0/1307756236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd52415f050 0x7fd5240c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.510+0000 7fd51be00640 1 -- 172.21.15.40:0/1307756236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5240cd780 msgr2=0x7fd52414e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.510+0000 7fd51be00640 1 --2- 172.21.15.40:0/1307756236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5240cd780 0x7fd52414e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.510+0000 7fd51be00640 1 -- 172.21.15.40:0/1307756236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd52415f050 msgr2=0x7fd5240c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.510+0000 7fd51be00640 1 --2- 172.21.15.40:0/1307756236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd52415f050 0x7fd5240c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.510+0000 7fd51be00640 1 -- 172.21.15.40:0/1307756236 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd52414ef00 con 0x7fd52415ec70 2024-09-11T00:23:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.510+0000 7fd522800640 1 --2- 172.21.15.40:0/1307756236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd52415f050 0x7fd5240c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.511+0000 7fd51be00640 1 --2- 172.21.15.40:0/1307756236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd52415ec70 0x7fd5240c94b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00c430 tx=0x7fd50c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.511+0000 7fd51a000640 1 -- 172.21.15.40:0/1307756236 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c011850 con 0x7fd52415ec70 2024-09-11T00:23:49.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.511+0000 7fd528e00640 1 -- 172.21.15.40:0/1307756236 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd524156da0 con 0x7fd52415ec70 2024-09-11T00:23:49.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.511+0000 7fd51a000640 1 -- 172.21.15.40:0/1307756236 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd50c017070 con 0x7fd52415ec70 2024-09-11T00:23:49.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.511+0000 7fd51a000640 1 -- 172.21.15.40:0/1307756236 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c011da0 con 0x7fd52415ec70 2024-09-11T00:23:49.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.511+0000 7fd528e00640 1 -- 172.21.15.40:0/1307756236 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd524157360 con 0x7fd52415ec70 2024-09-11T00:23:49.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.512+0000 7fd528e00640 1 -- 172.21.15.40:0/1307756236 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd52415e3b0 con 0x7fd52415ec70 2024-09-11T00:23:49.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.513+0000 7fd51a000640 1 -- 172.21.15.40:0/1307756236 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd50c01c460 con 0x7fd52415ec70 2024-09-11T00:23:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.515+0000 7fd51a000640 1 --2- 172.21.15.40:0/1307756236 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fd500077fa0 0x7fd50007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.515+0000 7fd51a000640 1 -- 172.21.15.40:0/1307756236 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd50c099a90 con 0x7fd52415ec70 2024-09-11T00:23:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.515+0000 7fd521e00640 1 --2- 172.21.15.40:0/1307756236 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fd500077fa0 0x7fd50007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.516+0000 7fd521e00640 1 --2- 172.21.15.40:0/1307756236 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fd500077fa0 0x7fd50007a460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd514034000 tx=0x7fd514004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:49.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.519+0000 7fd51a000640 1 -- 172.21.15.40:0/1307756236 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd50c062500 con 0x7fd52415ec70 2024-09-11T00:23:49.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.713+0000 7fd528e00640 1 -- 172.21.15.40:0/1307756236 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5240b5b30 con 0x7fd52415ec70 2024-09-11T00:23:49.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.714+0000 7fd51a000640 1 -- 172.21.15.40:0/1307756236 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16654 (secure 0 0 0) 0x7fd50c061e00 con 0x7fd52415ec70 2024-09-11T00:23:49.715 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:23:49.716 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":21,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","created":"2024-09-11T00:23:22.512139+0000","modified":"2024-09-11T00:23:48.351719+0000","last_up_change":"2024-09-11T00:23:36.842446+0000","last_in_change":"2024-09-11T00:23:26.734953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:23:37.800502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:23:46.379819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:23:47.307802+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee10e123-8817-4d94-a340-73d00121af37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6801","nonce":973366008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6803","nonce":973366008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6807","nonce":973366008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6805","nonce":973366008}]},"public_addr":"172.21.15.40:6801/973366008","cluster_addr":"172.21.15.40:6803/973366008","heartbeat_back_addr":"172.21.15.40:6807/973366008","heartbeat_front_addr":"172.21.15.40:6805/973366008","state":["exists","up"]},{"osd":1,"uuid":"f90895e9-8660-42b9-8aba-3f9d4d130b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6823","nonce":2542266029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6827","nonce":2542266029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6831","nonce":2542266029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6829","nonce":2542266029}]},"public_addr":"172.21.15.40:6823/2542266029","cluster_addr":"172.21.15.40:6827/2542266029","heartbeat_back_addr":"172.21.15.40:6831/2542266029","heartbeat_front_addr":"172.21.15.40:6829/2542266029","state":["exists","up"]},{"osd":2,"uuid":"a190497a-2aba-4748-8f1d-7e372259d65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6815","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6817","nonce":559505356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6819","nonce":559505356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6826","nonce":559505356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6822","nonce":559505356}]},"public_addr":"172.21.15.40:6817/559505356","cluster_addr":"172.21.15.40:6819/559505356","heartbeat_back_addr":"172.21.15.40:6826/559505356","heartbeat_front_addr":"172.21.15.40:6822/559505356","state":["exists","up"]},{"osd":3,"uuid":"8be32ced-898a-46f2-b850-1517667766b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6809","nonce":503633839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6811","nonce":503633839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6816","nonce":503633839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6813","nonce":503633839}]},"public_addr":"172.21.15.40:6809/503633839","cluster_addr":"172.21.15.40:6811/503633839","heartbeat_back_addr":"172.21.15.40:6816/503633839","heartbeat_front_addr":"172.21.15.40:6813/503633839","state":["exists","up"]},{"osd":4,"uuid":"9867fdfc-6f93-466e-b768-b5a1da7157de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6811","nonce":2418348042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6813","nonce":2418348042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6817","nonce":2418348042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6815","nonce":2418348042}]},"public_addr":"172.21.15.175:6811/2418348042","cluster_addr":"172.21.15.175:6813/2418348042","heartbeat_back_addr":"172.21.15.175:6817/2418348042","heartbeat_front_addr":"172.21.15.175:6815/2418348042","state":["exists","up"]},{"osd":5,"uuid":"e2f6f616-b5db-466e-942f-e2762171a8ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6827","nonce":520822300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6829","nonce":520822300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6833","nonce":520822300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6831","nonce":520822300}]},"public_addr":"172.21.15.175:6827/520822300","cluster_addr":"172.21.15.175:6829/520822300","heartbeat_back_addr":"172.21.15.175:6833/520822300","heartbeat_front_addr":"172.21.15.175:6831/520822300","state":["exists","up"]},{"osd":6,"uuid":"807ac045-bf63-4ff6-9a06-7f7022f9ef32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6819","nonce":1431736593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6821","nonce":1431736593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6825","nonce":1431736593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6823","nonce":1431736593}]},"public_addr":"172.21.15.175:6819/1431736593","cluster_addr":"172.21.15.175:6821/1431736593","heartbeat_back_addr":"172.21.15.175:6825/1431736593","heartbeat_front_addr":"172.21.15.175:6823/1431736593","state":["exists","up"]},{"osd":7,"uuid":"8e0b3293-390f-4b43-b29d-babdc5e88f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6803","nonce":3300317000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6805","nonce":3300317000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6809","nonce":3300317000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6807","nonce":3300317000}]},"public_addr":"172.21.15.175:6803/3300317000","cluster_addr":"172.21.15.175:6805/3300317000","heartbeat_back_addr":"172.21.15.175:6809/3300317000","heartbeat_front_addr":"172.21.15.175:6807/3300317000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:32.967062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.266558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.063509+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.616332+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.431077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.866822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.645225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.016210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:23:49.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.716+0000 7fd528e00640 1 -- 172.21.15.40:0/1307756236 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fd500077fa0 msgr2=0x7fd50007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.716+0000 7fd528e00640 1 --2- 172.21.15.40:0/1307756236 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fd500077fa0 0x7fd50007a460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd514034000 tx=0x7fd514004730 comp rx=0 tx=0).stop 2024-09-11T00:23:49.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.716+0000 7fd528e00640 1 -- 172.21.15.40:0/1307756236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd52415ec70 msgr2=0x7fd5240c94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.716+0000 7fd528e00640 1 --2- 172.21.15.40:0/1307756236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd52415ec70 0x7fd5240c94b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00c430 tx=0x7fd50c00c8f0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.716+0000 7fd528e00640 1 -- 172.21.15.40:0/1307756236 shutdown_connections 2024-09-11T00:23:49.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.716+0000 7fd528e00640 1 --2- 172.21.15.40:0/1307756236 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fd500077fa0 0x7fd50007a460 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.716+0000 7fd528e00640 1 --2- 172.21.15.40:0/1307756236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd52415f050 0x7fd5240c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.716+0000 7fd528e00640 1 --2- 172.21.15.40:0/1307756236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd52415ec70 0x7fd5240c94b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.716+0000 7fd528e00640 1 --2- 172.21.15.40:0/1307756236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5240cd780 0x7fd52414e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.716+0000 7fd528e00640 1 -- 172.21.15.40:0/1307756236 >> 172.21.15.40:0/1307756236 conn(0x7fd5240cfbb0 msgr2=0x7fd5240b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:49.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.716+0000 7fd528e00640 1 -- 172.21.15.40:0/1307756236 shutdown_connections 2024-09-11T00:23:49.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.716+0000 7fd528e00640 1 -- 172.21.15.40:0/1307756236 wait complete. 2024-09-11T00:23:49.734 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T00:23:49.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.896+0000 7f8888400640 1 -- 172.21.15.40:0/3606834096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88800cd780 msgr2=0x7f88800cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.896+0000 7f8888400640 1 --2- 172.21.15.40:0/3606834096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88800cd780 0x7f88800cdbd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8878005fd0 tx=0x7f887802a830 comp rx=0 tx=0).stop 2024-09-11T00:23:49.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.897+0000 7f8888400640 1 -- 172.21.15.40:0/3606834096 shutdown_connections 2024-09-11T00:23:49.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.897+0000 7f8888400640 1 --2- 172.21.15.40:0/3606834096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88800cd780 0x7f88800cdbd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.897+0000 7f8888400640 1 --2- 172.21.15.40:0/3606834096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f888015f050 0x7f888015e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.897+0000 7f8888400640 1 -- 172.21.15.40:0/3606834096 >> 172.21.15.40:0/3606834096 conn(0x7f88800cfbb0 msgr2=0x7f88800cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:49.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.897+0000 7f8888400640 1 -- 172.21.15.40:0/3606834096 shutdown_connections 2024-09-11T00:23:49.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.897+0000 7f8888400640 1 -- 172.21.15.40:0/3606834096 wait complete. 2024-09-11T00:23:49.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.898+0000 7f8888400640 1 Processor -- start 2024-09-11T00:23:49.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.898+0000 7f8888400640 1 -- start start 2024-09-11T00:23:49.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.899+0000 7f8888400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88800cd780 0x7f8880151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.899+0000 7f8888400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f888015ec70 0x7f88801f8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.899+0000 7f8888400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f888015f050 0x7f88801f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.899+0000 7f8888400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f88801680c0 con 0x7f88800cd780 2024-09-11T00:23:49.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.899+0000 7f8888400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8880167f40 con 0x7f888015f050 2024-09-11T00:23:49.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.899+0000 7f8888400640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8880168240 con 0x7f888015ec70 2024-09-11T00:23:49.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.899+0000 7f8885a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88800cd780 0x7f8880151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.900+0000 7f8885a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88800cd780 0x7f8880151160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42126/0 (socket says 172.21.15.40:42126) 2024-09-11T00:23:49.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.900+0000 7f8885a00640 1 -- 172.21.15.40:0/1582119715 learned_addr learned my addr 172.21.15.40:0/1582119715 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:49.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.900+0000 7f8886400640 1 --2- 172.21.15.40:0/1582119715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f888015f050 0x7f88801f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.900+0000 7f8885000640 1 --2- 172.21.15.40:0/1582119715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f888015ec70 0x7f88801f8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.900+0000 7f8885a00640 1 -- 172.21.15.40:0/1582119715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f888015ec70 msgr2=0x7f88801f8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.900+0000 7f8885a00640 1 --2- 172.21.15.40:0/1582119715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f888015ec70 0x7f88801f8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.900+0000 7f8885a00640 1 -- 172.21.15.40:0/1582119715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f888015f050 msgr2=0x7f88801f88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.900+0000 7f8885a00640 1 --2- 172.21.15.40:0/1582119715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f888015f050 0x7f88801f88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.900+0000 7f8885a00640 1 -- 172.21.15.40:0/1582119715 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88800c91a0 con 0x7f88800cd780 2024-09-11T00:23:49.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.900+0000 7f8885a00640 1 --2- 172.21.15.40:0/1582119715 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88800cd780 0x7f8880151160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f887400c700 tx=0x7f887400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:49.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.900+0000 7f887d600640 1 -- 172.21.15.40:0/1582119715 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887400a840 con 0x7f88800cd780 2024-09-11T00:23:49.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.901+0000 7f887d600640 1 -- 172.21.15.40:0/1582119715 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8874017070 con 0x7f88800cd780 2024-09-11T00:23:49.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.901+0000 7f887d600640 1 -- 172.21.15.40:0/1582119715 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887400ad90 con 0x7f88800cd780 2024-09-11T00:23:49.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.901+0000 7f8888400640 1 -- 172.21.15.40:0/1582119715 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88800c9480 con 0x7f88800cd780 2024-09-11T00:23:49.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.901+0000 7f8888400640 1 -- 172.21.15.40:0/1582119715 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88800c9a40 con 0x7f88800cd780 2024-09-11T00:23:49.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.902+0000 7f8888400640 1 -- 172.21.15.40:0/1582119715 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88800cdbd0 con 0x7f88800cd780 2024-09-11T00:23:49.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.903+0000 7f887d600640 1 -- 172.21.15.40:0/1582119715 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f887401c460 con 0x7f88800cd780 2024-09-11T00:23:49.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.904+0000 7f887d600640 1 --2- 172.21.15.40:0/1582119715 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8860077f70 0x7f886007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.904+0000 7f887d600640 1 -- 172.21.15.40:0/1582119715 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8874099ba0 con 0x7f88800cd780 2024-09-11T00:23:49.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.904+0000 7f8885000640 1 --2- 172.21.15.40:0/1582119715 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8860077f70 0x7f886007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.905+0000 7f8885000640 1 --2- 172.21.15.40:0/1582119715 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8860077f70 0x7f886007a430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f88800b54b0 tx=0x7f886c005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:49.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:49.908+0000 7f887d600640 1 -- 172.21.15.40:0/1582119715 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8874061fb0 con 0x7f88800cd780 2024-09-11T00:23:50.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:50.142+0000 7f8888400640 1 -- 172.21.15.40:0/1582119715 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f88800b5b30 con 0x7f88800cd780 2024-09-11T00:23:50.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:50.937+0000 7f887d600640 1 -- 172.21.15.40:0/1582119715 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f88740669e0 con 0x7f88800cd780 2024-09-11T00:23:50.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:50.940+0000 7f8888400640 1 -- 172.21.15.40:0/1582119715 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8860077f70 msgr2=0x7f886007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:50.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:50.940+0000 7f8888400640 1 --2- 172.21.15.40:0/1582119715 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8860077f70 0x7f886007a430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f88800b54b0 tx=0x7f886c005f90 comp rx=0 tx=0).stop 2024-09-11T00:23:50.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:50.940+0000 7f8888400640 1 -- 172.21.15.40:0/1582119715 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88800cd780 msgr2=0x7f8880151160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:50.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:50.940+0000 7f8888400640 1 --2- 172.21.15.40:0/1582119715 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88800cd780 0x7f8880151160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f887400c700 tx=0x7f887400cbc0 comp rx=0 tx=0).stop 2024-09-11T00:23:50.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:50.940+0000 7f8888400640 1 -- 172.21.15.40:0/1582119715 shutdown_connections 2024-09-11T00:23:50.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:50.940+0000 7f8888400640 1 --2- 172.21.15.40:0/1582119715 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8860077f70 0x7f886007a430 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:50.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:50.940+0000 7f8888400640 1 --2- 172.21.15.40:0/1582119715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f888015f050 0x7f88801f88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:50.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:50.940+0000 7f8888400640 1 --2- 172.21.15.40:0/1582119715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f888015ec70 0x7f88801f8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:50.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:50.940+0000 7f8888400640 1 --2- 172.21.15.40:0/1582119715 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88800cd780 0x7f8880151160 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:50.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:50.940+0000 7f8888400640 1 -- 172.21.15.40:0/1582119715 >> 172.21.15.40:0/1582119715 conn(0x7f88800cfbb0 msgr2=0x7f888006f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:50.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:50.940+0000 7f8888400640 1 -- 172.21.15.40:0/1582119715 shutdown_connections 2024-09-11T00:23:50.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:50.940+0000 7f8888400640 1 -- 172.21.15.40:0/1582119715 wait complete. 2024-09-11T00:23:50.959 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T00:23:50.959 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T00:23:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.122+0000 7fb9c3e00640 1 -- 172.21.15.40:0/2769025601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9bc0cd780 msgr2=0x7fb9bc0cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.122+0000 7fb9c3e00640 1 --2- 172.21.15.40:0/2769025601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9bc0cd780 0x7fb9bc0cdbd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4005fd0 tx=0x7fb9b402a5d0 comp rx=0 tx=0).stop 2024-09-11T00:23:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.122+0000 7fb9c3e00640 1 -- 172.21.15.40:0/2769025601 shutdown_connections 2024-09-11T00:23:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.122+0000 7fb9c3e00640 1 --2- 172.21.15.40:0/2769025601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9bc0cd780 0x7fb9bc0cdbd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.122+0000 7fb9c3e00640 1 --2- 172.21.15.40:0/2769025601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9bc15f050 0x7fb9bc15e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.122+0000 7fb9c3e00640 1 -- 172.21.15.40:0/2769025601 >> 172.21.15.40:0/2769025601 conn(0x7fb9bc0cfbb0 msgr2=0x7fb9bc0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.123+0000 7fb9c3e00640 1 -- 172.21.15.40:0/2769025601 shutdown_connections 2024-09-11T00:23:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.123+0000 7fb9c3e00640 1 -- 172.21.15.40:0/2769025601 wait complete. 2024-09-11T00:23:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.124+0000 7fb9c3e00640 1 Processor -- start 2024-09-11T00:23:51.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.124+0000 7fb9c3e00640 1 -- start start 2024-09-11T00:23:51.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.125+0000 7fb9c3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9bc0cd780 0x7fb9bc0b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:51.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.125+0000 7fb9c3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9bc15ec70 0x7fb9bc0c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:51.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.125+0000 7fb9c3e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9bc15f050 0x7fb9bc0c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:51.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.125+0000 7fb9c3e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc1680c0 con 0x7fb9bc0cd780 2024-09-11T00:23:51.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.125+0000 7fb9c3e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc167f40 con 0x7fb9bc15ec70 2024-09-11T00:23:51.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.125+0000 7fb9c3e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb9bc168240 con 0x7fb9bc15f050 2024-09-11T00:23:51.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.125+0000 7fb9c1400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9bc0cd780 0x7fb9bc0b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:51.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.125+0000 7fb9c1400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9bc0cd780 0x7fb9bc0b5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42142/0 (socket says 172.21.15.40:42142) 2024-09-11T00:23:51.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.125+0000 7fb9c1400640 1 -- 172.21.15.40:0/2358456689 learned_addr learned my addr 172.21.15.40:0/2358456689 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:51.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.125+0000 7fb9c0a00640 1 --2- 172.21.15.40:0/2358456689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9bc15ec70 0x7fb9bc0c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:51.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.125+0000 7fb9c1e00640 1 --2- 172.21.15.40:0/2358456689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9bc15f050 0x7fb9bc0c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:51.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.126+0000 7fb9c1400640 1 -- 172.21.15.40:0/2358456689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9bc15f050 msgr2=0x7fb9bc0c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:51.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.126+0000 7fb9c1400640 1 --2- 172.21.15.40:0/2358456689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9bc15f050 0x7fb9bc0c6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:51.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.126+0000 7fb9c1400640 1 -- 172.21.15.40:0/2358456689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9bc15ec70 msgr2=0x7fb9bc0c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:51.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.126+0000 7fb9c1400640 1 --2- 172.21.15.40:0/2358456689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9bc15ec70 0x7fb9bc0c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:51.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.126+0000 7fb9c1400640 1 -- 172.21.15.40:0/2358456689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9bc0c9270 con 0x7fb9bc0cd780 2024-09-11T00:23:51.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.126+0000 7fb9c1e00640 1 --2- 172.21.15.40:0/2358456689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9bc15f050 0x7fb9bc0c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:51.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.126+0000 7fb9c1400640 1 --2- 172.21.15.40:0/2358456689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9bc0cd780 0x7fb9bc0b5380 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000c870 tx=0x7fb9b000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:51.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.126+0000 7fb9b9600640 1 -- 172.21.15.40:0/2358456689 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0003b70 con 0x7fb9bc0cd780 2024-09-11T00:23:51.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.126+0000 7fb9b9600640 1 -- 172.21.15.40:0/2358456689 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9b0003d10 con 0x7fb9bc0cd780 2024-09-11T00:23:51.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.126+0000 7fb9b9600640 1 -- 172.21.15.40:0/2358456689 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b000aab0 con 0x7fb9bc0cd780 2024-09-11T00:23:51.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.126+0000 7fb9c3e00640 1 -- 172.21.15.40:0/2358456689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9bc0c9550 con 0x7fb9bc0cd780 2024-09-11T00:23:51.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.126+0000 7fb9c3e00640 1 -- 172.21.15.40:0/2358456689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9bc0c9b10 con 0x7fb9bc0cd780 2024-09-11T00:23:51.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.127+0000 7fb9c3e00640 1 -- 172.21.15.40:0/2358456689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9bc0cdbd0 con 0x7fb9bc0cd780 2024-09-11T00:23:51.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.128+0000 7fb9b9600640 1 -- 172.21.15.40:0/2358456689 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb9b000ac50 con 0x7fb9bc0cd780 2024-09-11T00:23:51.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.129+0000 7fb9b9600640 1 --2- 172.21.15.40:0/2358456689 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb99c077f70 0x7fb99c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:51.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.129+0000 7fb9b9600640 1 -- 172.21.15.40:0/2358456689 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb9b0099b30 con 0x7fb9bc0cd780 2024-09-11T00:23:51.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.130+0000 7fb9c0a00640 1 --2- 172.21.15.40:0/2358456689 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb99c077f70 0x7fb99c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:51.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.131+0000 7fb9c0a00640 1 --2- 172.21.15.40:0/2358456689 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb99c077f70 0x7fb99c07a430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc152e40 tx=0x7fb9a8005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:51.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.134+0000 7fb9b9600640 1 -- 172.21.15.40:0/2358456689 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb9b0062620 con 0x7fb9bc0cd780 2024-09-11T00:23:51.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.367+0000 7fb9c3e00640 1 -- 172.21.15.40:0/2358456689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb9bc0b5b30 con 0x7fb9bc0cd780 2024-09-11T00:23:51.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.944+0000 7fb9b9600640 1 -- 172.21.15.40:0/2358456689 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fb9b0061f20 con 0x7fb9bc0cd780 2024-09-11T00:23:51.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.947+0000 7fb9c3e00640 1 -- 172.21.15.40:0/2358456689 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb99c077f70 msgr2=0x7fb99c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:51.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.947+0000 7fb9c3e00640 1 --2- 172.21.15.40:0/2358456689 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb99c077f70 0x7fb99c07a430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc152e40 tx=0x7fb9a8005f90 comp rx=0 tx=0).stop 2024-09-11T00:23:51.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.947+0000 7fb9c3e00640 1 -- 172.21.15.40:0/2358456689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9bc0cd780 msgr2=0x7fb9bc0b5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:51.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.947+0000 7fb9c3e00640 1 --2- 172.21.15.40:0/2358456689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9bc0cd780 0x7fb9bc0b5380 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000c870 tx=0x7fb9b000cd30 comp rx=0 tx=0).stop 2024-09-11T00:23:51.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.947+0000 7fb9c3e00640 1 -- 172.21.15.40:0/2358456689 shutdown_connections 2024-09-11T00:23:51.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.947+0000 7fb9c3e00640 1 --2- 172.21.15.40:0/2358456689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9bc15f050 0x7fb9bc0c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:51.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.947+0000 7fb9c3e00640 1 --2- 172.21.15.40:0/2358456689 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb99c077f70 0x7fb99c07a430 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:51.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.947+0000 7fb9c3e00640 1 --2- 172.21.15.40:0/2358456689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9bc15ec70 0x7fb9bc0c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:51.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.947+0000 7fb9c3e00640 1 --2- 172.21.15.40:0/2358456689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9bc0cd780 0x7fb9bc0b5380 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:51.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.947+0000 7fb9c3e00640 1 -- 172.21.15.40:0/2358456689 >> 172.21.15.40:0/2358456689 conn(0x7fb9bc0cfbb0 msgr2=0x7fb9bc14dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:51.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.947+0000 7fb9c3e00640 1 -- 172.21.15.40:0/2358456689 shutdown_connections 2024-09-11T00:23:51.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:51.947+0000 7fb9c3e00640 1 -- 172.21.15.40:0/2358456689 wait complete. 2024-09-11T00:23:51.966 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T00:23:51.966 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:23:52.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.128+0000 7f601b200640 1 -- 172.21.15.40:0/2800723218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6014161500 msgr2=0x7f60140aea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:52.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.128+0000 7f601b200640 1 --2- 172.21.15.40:0/2800723218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6014161500 0x7f60140aea00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6004009830 tx=0x7f600402a510 comp rx=0 tx=0).stop 2024-09-11T00:23:52.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.128+0000 7f601b200640 1 -- 172.21.15.40:0/2800723218 shutdown_connections 2024-09-11T00:23:52.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.128+0000 7f601b200640 1 --2- 172.21.15.40:0/2800723218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60140d1140 0x7f6014071630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:52.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.128+0000 7f601b200640 1 --2- 172.21.15.40:0/2800723218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6014161500 0x7f60140aea00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:52.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.128+0000 7f601b200640 1 -- 172.21.15.40:0/2800723218 >> 172.21.15.40:0/2800723218 conn(0x7f60140d1d50 msgr2=0x7f60140d2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:52.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.128+0000 7f601b200640 1 -- 172.21.15.40:0/2800723218 shutdown_connections 2024-09-11T00:23:52.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.128+0000 7f601b200640 1 -- 172.21.15.40:0/2800723218 wait complete. 2024-09-11T00:23:52.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.130+0000 7f601b200640 1 Processor -- start 2024-09-11T00:23:52.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.130+0000 7f601b200640 1 -- start start 2024-09-11T00:23:52.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.131+0000 7f601b200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6014071b70 0x7f60141f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:52.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.131+0000 7f601b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60140d1140 0x7f6014156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:52.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.131+0000 7f601b200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6014161500 0x7f60140ce570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:52.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.131+0000 7f601b200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f60140d0c60 con 0x7f6014161500 2024-09-11T00:23:52.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.131+0000 7f601b200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f60140b1090 con 0x7f60140d1140 2024-09-11T00:23:52.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.131+0000 7f601b200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f60140d0de0 con 0x7f6014071b70 2024-09-11T00:23:52.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.131+0000 7f6019200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6014161500 0x7f60140ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:52.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.131+0000 7f6019200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6014161500 0x7f60140ce570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42160/0 (socket says 172.21.15.40:42160) 2024-09-11T00:23:52.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.131+0000 7f6019200640 1 -- 172.21.15.40:0/2013321276 learned_addr learned my addr 172.21.15.40:0/2013321276 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:52.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.131+0000 7f6013e00640 1 --2- 172.21.15.40:0/2013321276 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6014071b70 0x7f60141f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:52.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.131+0000 7f6013400640 1 --2- 172.21.15.40:0/2013321276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60140d1140 0x7f6014156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:52.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.131+0000 7f6019200640 1 -- 172.21.15.40:0/2013321276 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6014071b70 msgr2=0x7f60141f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:52.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.131+0000 7f6019200640 1 --2- 172.21.15.40:0/2013321276 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6014071b70 0x7f60141f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:52.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.131+0000 7f6019200640 1 -- 172.21.15.40:0/2013321276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60140d1140 msgr2=0x7f6014156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:52.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.131+0000 7f6019200640 1 --2- 172.21.15.40:0/2013321276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60140d1140 0x7f6014156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:52.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.131+0000 7f6019200640 1 -- 172.21.15.40:0/2013321276 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60140caa50 con 0x7f6014161500 2024-09-11T00:23:52.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.132+0000 7f6019200640 1 --2- 172.21.15.40:0/2013321276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6014161500 0x7f60140ce570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f600c00c770 tx=0x7f600c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:52.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.132+0000 7f600be00640 1 -- 172.21.15.40:0/2013321276 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c017070 con 0x7f6014161500 2024-09-11T00:23:52.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.132+0000 7f600be00640 1 -- 172.21.15.40:0/2013321276 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f600c005070 con 0x7f6014161500 2024-09-11T00:23:52.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.132+0000 7f600be00640 1 -- 172.21.15.40:0/2013321276 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c0054c0 con 0x7f6014161500 2024-09-11T00:23:52.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.132+0000 7f601b200640 1 -- 172.21.15.40:0/2013321276 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60141f8af0 con 0x7f6014161500 2024-09-11T00:23:52.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.132+0000 7f601b200640 1 -- 172.21.15.40:0/2013321276 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6014156350 con 0x7f6014161500 2024-09-11T00:23:52.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.133+0000 7f601b200640 1 -- 172.21.15.40:0/2013321276 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f601406e4b0 con 0x7f6014161500 2024-09-11T00:23:52.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.134+0000 7f600be00640 1 -- 172.21.15.40:0/2013321276 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f600c005660 con 0x7f6014161500 2024-09-11T00:23:52.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.135+0000 7f600be00640 1 --2- 172.21.15.40:0/2013321276 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5ff4077fa0 0x7f5ff407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:52.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.135+0000 7f600be00640 1 -- 172.21.15.40:0/2013321276 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f600c099700 con 0x7f6014161500 2024-09-11T00:23:52.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.136+0000 7f6013e00640 1 --2- 172.21.15.40:0/2013321276 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5ff4077fa0 0x7f5ff407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:52.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.136+0000 7f6013e00640 1 --2- 172.21.15.40:0/2013321276 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5ff4077fa0 0x7f5ff407a460 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6004034000 tx=0x7f6004004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:52.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.140+0000 7f600be00640 1 -- 172.21.15.40:0/2013321276 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f60140caa50 con 0x7f6014161500 2024-09-11T00:23:52.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.371+0000 7f601b200640 1 -- 172.21.15.40:0/2013321276 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60140b26f0 con 0x7f6014161500 2024-09-11T00:23:52.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.371+0000 7f600be00640 1 -- 172.21.15.40:0/2013321276 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7f600c061b10 con 0x7f6014161500 2024-09-11T00:23:52.373 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:23:52.373 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"btime":"2024-09-11T00:23:51:938503+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3825015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3825015784},{"type":"v1","addr":"172.21.15.175:6836","nonce":3825015784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4334,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1127011821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1127011821},{"type":"v1","addr":"172.21.15.175:6837","nonce":1127011821}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2724658296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2724658296},{"type":"v1","addr":"172.21.15.40:6833","nonce":2724658296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:23:48.351685+0000","modified":"2024-09-11T00:23:51.368958+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4356":{"gid":4356,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3237981730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3237981730},{"type":"v1","addr":"172.21.15.40:6835","nonce":3237981730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4356,"qdb_cluster":[4356]},"id":1}]} 2024-09-11T00:23:52.373 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-11T00:23:52.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.374+0000 7f601b200640 1 -- 172.21.15.40:0/2013321276 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5ff4077fa0 msgr2=0x7f5ff407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:52.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.374+0000 7f601b200640 1 --2- 172.21.15.40:0/2013321276 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5ff4077fa0 0x7f5ff407a460 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6004034000 tx=0x7f6004004730 comp rx=0 tx=0).stop 2024-09-11T00:23:52.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.374+0000 7f601b200640 1 -- 172.21.15.40:0/2013321276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6014161500 msgr2=0x7f60140ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:52.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.374+0000 7f601b200640 1 --2- 172.21.15.40:0/2013321276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6014161500 0x7f60140ce570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f600c00c770 tx=0x7f600c00cc30 comp rx=0 tx=0).stop 2024-09-11T00:23:52.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.374+0000 7f601b200640 1 -- 172.21.15.40:0/2013321276 shutdown_connections 2024-09-11T00:23:52.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.374+0000 7f601b200640 1 --2- 172.21.15.40:0/2013321276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6014161500 0x7f60140ce570 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:52.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.374+0000 7f601b200640 1 --2- 172.21.15.40:0/2013321276 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5ff4077fa0 0x7f5ff407a460 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:52.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.374+0000 7f601b200640 1 --2- 172.21.15.40:0/2013321276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60140d1140 0x7f6014156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:52.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.374+0000 7f601b200640 1 --2- 172.21.15.40:0/2013321276 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6014071b70 0x7f60141f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:52.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.374+0000 7f601b200640 1 -- 172.21.15.40:0/2013321276 >> 172.21.15.40:0/2013321276 conn(0x7f60140d1d50 msgr2=0x7f6014160800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:52.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.374+0000 7f601b200640 1 -- 172.21.15.40:0/2013321276 shutdown_connections 2024-09-11T00:23:52.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.374+0000 7f601b200640 1 -- 172.21.15.40:0/2013321276 wait complete. 2024-09-11T00:23:52.391 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:23:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.549+0000 7f9333200640 1 -- 172.21.15.40:0/78635481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9318003a50 msgr2=0x7f9318003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.549+0000 7f9333200640 1 --2- 172.21.15.40:0/78635481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9318003a50 0x7f9318003e70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9324006fd0 tx=0x7f9318005830 comp rx=0 tx=0).stop 2024-09-11T00:23:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.549+0000 7f9333200640 1 -- 172.21.15.40:0/78635481 shutdown_connections 2024-09-11T00:23:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.549+0000 7f9333200640 1 --2- 172.21.15.40:0/78635481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9318003a50 0x7f9318003e70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.549+0000 7f9333200640 1 -- 172.21.15.40:0/78635481 >> 172.21.15.40:0/78635481 conn(0x7f93340d3c20 msgr2=0x7f93340d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.550+0000 7f9333200640 1 -- 172.21.15.40:0/78635481 shutdown_connections 2024-09-11T00:23:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.550+0000 7f9333200640 1 -- 172.21.15.40:0/78635481 wait complete. 2024-09-11T00:23:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.551+0000 7f9333200640 1 Processor -- start 2024-09-11T00:23:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.551+0000 7f9333200640 1 -- start start 2024-09-11T00:23:52.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.552+0000 7f9333200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9318003a50 0x7f93340b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:52.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.552+0000 7f9333200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93340b3200 0x7f93341504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:52.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.552+0000 7f9333200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93340b5110 0x7f93340b5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:52.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.552+0000 7f9333200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f93340d02d0 con 0x7f93340b3200 2024-09-11T00:23:52.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.552+0000 7f9333200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93340d4a60 con 0x7f93340b5110 2024-09-11T00:23:52.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.552+0000 7f9333200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f93340d0450 con 0x7f9318003a50 2024-09-11T00:23:52.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.552+0000 7f9331400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93340b3200 0x7f93341504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:52.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.552+0000 7f9331400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93340b3200 0x7f93341504a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42188/0 (socket says 172.21.15.40:42188) 2024-09-11T00:23:52.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.552+0000 7f9331400640 1 -- 172.21.15.40:0/2531753961 learned_addr learned my addr 172.21.15.40:0/2531753961 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:52.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.552+0000 7f9331e00640 1 --2- 172.21.15.40:0/2531753961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9318003a50 0x7f93340b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:52.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.553+0000 7f9332800640 1 --2- 172.21.15.40:0/2531753961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93340b5110 0x7f93340b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:52.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.553+0000 7f9331400640 1 -- 172.21.15.40:0/2531753961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9318003a50 msgr2=0x7f93340b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:52.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.553+0000 7f9331400640 1 --2- 172.21.15.40:0/2531753961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9318003a50 0x7f93340b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:52.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.553+0000 7f9331400640 1 -- 172.21.15.40:0/2531753961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93340b5110 msgr2=0x7f93340b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:52.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.553+0000 7f9331400640 1 --2- 172.21.15.40:0/2531753961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93340b5110 0x7f93340b5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:52.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.553+0000 7f9331400640 1 -- 172.21.15.40:0/2531753961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9334154170 con 0x7f93340b3200 2024-09-11T00:23:52.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.553+0000 7f9331400640 1 --2- 172.21.15.40:0/2531753961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93340b3200 0x7f93341504a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9320004e10 tx=0x7f9320001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:52.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.553+0000 7f932a000640 1 -- 172.21.15.40:0/2531753961 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93200107d0 con 0x7f93340b3200 2024-09-11T00:23:52.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.553+0000 7f932a000640 1 -- 172.21.15.40:0/2531753961 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9320016070 con 0x7f93340b3200 2024-09-11T00:23:52.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.553+0000 7f932a000640 1 -- 172.21.15.40:0/2531753961 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9320010ce0 con 0x7f93340b3200 2024-09-11T00:23:52.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.553+0000 7f9333200640 1 -- 172.21.15.40:0/2531753961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9334154450 con 0x7f93340b3200 2024-09-11T00:23:52.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.554+0000 7f9333200640 1 -- 172.21.15.40:0/2531753961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9334154a10 con 0x7f93340b3200 2024-09-11T00:23:52.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.554+0000 7f9333200640 1 -- 172.21.15.40:0/2531753961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93340ce730 con 0x7f93340b3200 2024-09-11T00:23:52.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.556+0000 7f932a000640 1 -- 172.21.15.40:0/2531753961 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f932001b460 con 0x7f93340b3200 2024-09-11T00:23:52.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.557+0000 7f932a000640 1 --2- 172.21.15.40:0/2531753961 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9314077f70 0x7f931407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:52.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.557+0000 7f932a000640 1 -- 172.21.15.40:0/2531753961 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f932009a370 con 0x7f93340b3200 2024-09-11T00:23:52.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.557+0000 7f9331e00640 1 --2- 172.21.15.40:0/2531753961 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9314077f70 0x7f931407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:52.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.558+0000 7f9331e00640 1 --2- 172.21.15.40:0/2531753961 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9314077f70 0x7f931407a430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9324033000 tx=0x7f9324038040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:52.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.561+0000 7f932a000640 1 -- 172.21.15.40:0/2531753961 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9320062810 con 0x7f93340b3200 2024-09-11T00:23:52.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.756+0000 7f9333200640 1 -- 172.21.15.40:0/2531753961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f933406e350 con 0x7f93340b3200 2024-09-11T00:23:52.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.757+0000 7f932a000640 1 -- 172.21.15.40:0/2531753961 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16641 (secure 0 0 0) 0x7f9320067240 con 0x7f93340b3200 2024-09-11T00:23:52.759 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:23:52.759 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":22,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","created":"2024-09-11T00:23:22.512139+0000","modified":"2024-09-11T00:23:49.924132+0000","last_up_change":"2024-09-11T00:23:36.842446+0000","last_in_change":"2024-09-11T00:23:26.734953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:23:37.800502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:23:46.379819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:23:47.307802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee10e123-8817-4d94-a340-73d00121af37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6801","nonce":973366008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6803","nonce":973366008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6807","nonce":973366008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6805","nonce":973366008}]},"public_addr":"172.21.15.40:6801/973366008","cluster_addr":"172.21.15.40:6803/973366008","heartbeat_back_addr":"172.21.15.40:6807/973366008","heartbeat_front_addr":"172.21.15.40:6805/973366008","state":["exists","up"]},{"osd":1,"uuid":"f90895e9-8660-42b9-8aba-3f9d4d130b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6823","nonce":2542266029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6827","nonce":2542266029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6831","nonce":2542266029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6829","nonce":2542266029}]},"public_addr":"172.21.15.40:6823/2542266029","cluster_addr":"172.21.15.40:6827/2542266029","heartbeat_back_addr":"172.21.15.40:6831/2542266029","heartbeat_front_addr":"172.21.15.40:6829/2542266029","state":["exists","up"]},{"osd":2,"uuid":"a190497a-2aba-4748-8f1d-7e372259d65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6815","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6817","nonce":559505356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6819","nonce":559505356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6826","nonce":559505356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6822","nonce":559505356}]},"public_addr":"172.21.15.40:6817/559505356","cluster_addr":"172.21.15.40:6819/559505356","heartbeat_back_addr":"172.21.15.40:6826/559505356","heartbeat_front_addr":"172.21.15.40:6822/559505356","state":["exists","up"]},{"osd":3,"uuid":"8be32ced-898a-46f2-b850-1517667766b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6809","nonce":503633839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6811","nonce":503633839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6816","nonce":503633839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6813","nonce":503633839}]},"public_addr":"172.21.15.40:6809/503633839","cluster_addr":"172.21.15.40:6811/503633839","heartbeat_back_addr":"172.21.15.40:6816/503633839","heartbeat_front_addr":"172.21.15.40:6813/503633839","state":["exists","up"]},{"osd":4,"uuid":"9867fdfc-6f93-466e-b768-b5a1da7157de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6811","nonce":2418348042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6813","nonce":2418348042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6817","nonce":2418348042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6815","nonce":2418348042}]},"public_addr":"172.21.15.175:6811/2418348042","cluster_addr":"172.21.15.175:6813/2418348042","heartbeat_back_addr":"172.21.15.175:6817/2418348042","heartbeat_front_addr":"172.21.15.175:6815/2418348042","state":["exists","up"]},{"osd":5,"uuid":"e2f6f616-b5db-466e-942f-e2762171a8ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6827","nonce":520822300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6829","nonce":520822300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6833","nonce":520822300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6831","nonce":520822300}]},"public_addr":"172.21.15.175:6827/520822300","cluster_addr":"172.21.15.175:6829/520822300","heartbeat_back_addr":"172.21.15.175:6833/520822300","heartbeat_front_addr":"172.21.15.175:6831/520822300","state":["exists","up"]},{"osd":6,"uuid":"807ac045-bf63-4ff6-9a06-7f7022f9ef32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6819","nonce":1431736593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6821","nonce":1431736593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6825","nonce":1431736593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6823","nonce":1431736593}]},"public_addr":"172.21.15.175:6819/1431736593","cluster_addr":"172.21.15.175:6821/1431736593","heartbeat_back_addr":"172.21.15.175:6825/1431736593","heartbeat_front_addr":"172.21.15.175:6823/1431736593","state":["exists","up"]},{"osd":7,"uuid":"8e0b3293-390f-4b43-b29d-babdc5e88f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6803","nonce":3300317000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6805","nonce":3300317000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6809","nonce":3300317000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6807","nonce":3300317000}]},"public_addr":"172.21.15.175:6803/3300317000","cluster_addr":"172.21.15.175:6805/3300317000","heartbeat_back_addr":"172.21.15.175:6809/3300317000","heartbeat_front_addr":"172.21.15.175:6807/3300317000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:32.967062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.266558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.063509+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.616332+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.431077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.866822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.645225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.016210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:23:52.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.759+0000 7f9333200640 1 -- 172.21.15.40:0/2531753961 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9314077f70 msgr2=0x7f931407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:52.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.759+0000 7f9333200640 1 --2- 172.21.15.40:0/2531753961 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9314077f70 0x7f931407a430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9324033000 tx=0x7f9324038040 comp rx=0 tx=0).stop 2024-09-11T00:23:52.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.760+0000 7f9333200640 1 -- 172.21.15.40:0/2531753961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93340b3200 msgr2=0x7f93341504a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:52.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.760+0000 7f9333200640 1 --2- 172.21.15.40:0/2531753961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93340b3200 0x7f93341504a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9320004e10 tx=0x7f9320001630 comp rx=0 tx=0).stop 2024-09-11T00:23:52.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.760+0000 7f9333200640 1 -- 172.21.15.40:0/2531753961 shutdown_connections 2024-09-11T00:23:52.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.760+0000 7f9333200640 1 --2- 172.21.15.40:0/2531753961 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9314077f70 0x7f931407a430 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:52.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.760+0000 7f9333200640 1 --2- 172.21.15.40:0/2531753961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93340b5110 0x7f93340b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:52.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.760+0000 7f9333200640 1 --2- 172.21.15.40:0/2531753961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93340b3200 0x7f93341504a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:52.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.760+0000 7f9333200640 1 --2- 172.21.15.40:0/2531753961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9318003a50 0x7f93340b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:52.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.760+0000 7f9333200640 1 -- 172.21.15.40:0/2531753961 >> 172.21.15.40:0/2531753961 conn(0x7f93340d3c20 msgr2=0x7f93340b08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:52.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.760+0000 7f9333200640 1 -- 172.21.15.40:0/2531753961 shutdown_connections 2024-09-11T00:23:52.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.760+0000 7f9333200640 1 -- 172.21.15.40:0/2531753961 wait complete. 2024-09-11T00:23:52.777 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T00:23:52.778 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:23:52.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.936+0000 7f4c7ce00640 1 -- 172.21.15.40:0/1999946403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c7815f570 msgr2=0x7f4c780d0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:52.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.936+0000 7f4c7ce00640 1 --2- 172.21.15.40:0/1999946403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c7815f570 0x7f4c780d0660 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009830 tx=0x7f4c6802a4a0 comp rx=0 tx=0).stop 2024-09-11T00:23:52.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.936+0000 7f4c7ce00640 1 -- 172.21.15.40:0/1999946403 shutdown_connections 2024-09-11T00:23:52.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.936+0000 7f4c7ce00640 1 --2- 172.21.15.40:0/1999946403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c7815f570 0x7f4c780d0660 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:52.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.936+0000 7f4c7ce00640 1 -- 172.21.15.40:0/1999946403 >> 172.21.15.40:0/1999946403 conn(0x7f4c780d1d50 msgr2=0x7f4c780d2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:52.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.936+0000 7f4c7ce00640 1 -- 172.21.15.40:0/1999946403 shutdown_connections 2024-09-11T00:23:52.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.936+0000 7f4c7ce00640 1 -- 172.21.15.40:0/1999946403 wait complete. 2024-09-11T00:23:52.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.938+0000 7f4c7ce00640 1 Processor -- start 2024-09-11T00:23:52.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.938+0000 7f4c7ce00640 1 -- start start 2024-09-11T00:23:52.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.939+0000 7f4c7ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c780cdf90 0x7f4c780b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:52.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.939+0000 7f4c7ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c780cf3b0 0x7f4c780b5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:52.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.939+0000 7f4c7ce00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c7815f570 0x7f4c7815abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:52.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.939+0000 7f4c7ce00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4c780cee00 con 0x7f4c780cdf90 2024-09-11T00:23:52.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.939+0000 7f4c7ce00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4c780b0f80 con 0x7f4c780cf3b0 2024-09-11T00:23:52.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.939+0000 7f4c7ce00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4c781f7da0 con 0x7f4c7815f570 2024-09-11T00:23:52.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.939+0000 7f4c75e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c780cdf90 0x7f4c780b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:52.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.939+0000 7f4c75e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c780cdf90 0x7f4c780b2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42204/0 (socket says 172.21.15.40:42204) 2024-09-11T00:23:52.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.939+0000 7f4c75e00640 1 -- 172.21.15.40:0/3603436409 learned_addr learned my addr 172.21.15.40:0/3603436409 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:52.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.939+0000 7f4c75400640 1 --2- 172.21.15.40:0/3603436409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c780cf3b0 0x7f4c780b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:52.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.939+0000 7f4c76800640 1 --2- 172.21.15.40:0/3603436409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c7815f570 0x7f4c7815abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:52.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.939+0000 7f4c75e00640 1 -- 172.21.15.40:0/3603436409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c7815f570 msgr2=0x7f4c7815abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:52.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.939+0000 7f4c75e00640 1 --2- 172.21.15.40:0/3603436409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c7815f570 0x7f4c7815abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:52.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.939+0000 7f4c75e00640 1 -- 172.21.15.40:0/3603436409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c780cf3b0 msgr2=0x7f4c780b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:52.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.939+0000 7f4c75e00640 1 --2- 172.21.15.40:0/3603436409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c780cf3b0 0x7f4c780b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:52.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.939+0000 7f4c75e00640 1 -- 172.21.15.40:0/3603436409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c781f8080 con 0x7f4c780cdf90 2024-09-11T00:23:52.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.940+0000 7f4c75e00640 1 --2- 172.21.15.40:0/3603436409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c780cdf90 0x7f4c780b2d60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4c68000c00 tx=0x7f4c68033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:52.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.940+0000 7f4c6e000640 1 -- 172.21.15.40:0/3603436409 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68031d60 con 0x7f4c780cdf90 2024-09-11T00:23:52.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.940+0000 7f4c6e000640 1 -- 172.21.15.40:0/3603436409 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c68033e10 con 0x7f4c780cdf90 2024-09-11T00:23:52.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.940+0000 7f4c7ce00640 1 -- 172.21.15.40:0/3603436409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c781f8360 con 0x7f4c780cdf90 2024-09-11T00:23:52.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.940+0000 7f4c6e000640 1 -- 172.21.15.40:0/3603436409 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c680332b0 con 0x7f4c780cdf90 2024-09-11T00:23:52.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.940+0000 7f4c7ce00640 1 -- 172.21.15.40:0/3603436409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c780c8820 con 0x7f4c780cdf90 2024-09-11T00:23:52.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.941+0000 7f4c7ce00640 1 -- 172.21.15.40:0/3603436409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c780d0660 con 0x7f4c780cdf90 2024-09-11T00:23:52.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.942+0000 7f4c6e000640 1 -- 172.21.15.40:0/3603436409 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4c6804b030 con 0x7f4c780cdf90 2024-09-11T00:23:52.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.943+0000 7f4c6e000640 1 --2- 172.21.15.40:0/3603436409 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4c58077f70 0x7f4c5807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:52.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.943+0000 7f4c6e000640 1 -- 172.21.15.40:0/3603436409 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4c680bac20 con 0x7f4c780cdf90 2024-09-11T00:23:52.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.944+0000 7f4c75400640 1 --2- 172.21.15.40:0/3603436409 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4c58077f70 0x7f4c5807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:52.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.944+0000 7f4c75400640 1 --2- 172.21.15.40:0/3603436409 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4c58077f70 0x7f4c5807a430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4c780c4b90 tx=0x7f4c64009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:52.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:52.947+0000 7f4c6e000640 1 -- 172.21.15.40:0/3603436409 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4c6803f030 con 0x7f4c780cdf90 2024-09-11T00:23:53.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.138+0000 7f4c7ce00640 1 -- 172.21.15.40:0/3603436409 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4c78070fb0 con 0x7f4c58077f70 2024-09-11T00:23:53.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.143+0000 7f4c6e000640 1 -- 172.21.15.40:0/3603436409 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241621 (secure 0 0 0) 0x7f4c78070fb0 con 0x7f4c58077f70 2024-09-11T00:23:53.148 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:23:53.149 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T00:23:53.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.147+0000 7f4c7ce00640 1 -- 172.21.15.40:0/3603436409 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4c58077f70 msgr2=0x7f4c5807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:53.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.147+0000 7f4c7ce00640 1 --2- 172.21.15.40:0/3603436409 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4c58077f70 0x7f4c5807a430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4c780c4b90 tx=0x7f4c64009040 comp rx=0 tx=0).stop 2024-09-11T00:23:53.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.147+0000 7f4c7ce00640 1 -- 172.21.15.40:0/3603436409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c780cdf90 msgr2=0x7f4c780b2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:53.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.147+0000 7f4c7ce00640 1 --2- 172.21.15.40:0/3603436409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c780cdf90 0x7f4c780b2d60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4c68000c00 tx=0x7f4c68033c20 comp rx=0 tx=0).stop 2024-09-11T00:23:53.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.147+0000 7f4c7ce00640 1 -- 172.21.15.40:0/3603436409 shutdown_connections 2024-09-11T00:23:53.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.147+0000 7f4c7ce00640 1 --2- 172.21.15.40:0/3603436409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c7815f570 0x7f4c7815abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:53.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.147+0000 7f4c7ce00640 1 --2- 172.21.15.40:0/3603436409 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4c58077f70 0x7f4c5807a430 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:53.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.147+0000 7f4c7ce00640 1 --2- 172.21.15.40:0/3603436409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c780cf3b0 0x7f4c780b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:53.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.147+0000 7f4c7ce00640 1 --2- 172.21.15.40:0/3603436409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c780cdf90 0x7f4c780b2d60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:53.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.147+0000 7f4c7ce00640 1 -- 172.21.15.40:0/3603436409 >> 172.21.15.40:0/3603436409 conn(0x7f4c780d1d50 msgr2=0x7f4c780cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:53.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.147+0000 7f4c7ce00640 1 -- 172.21.15.40:0/3603436409 shutdown_connections 2024-09-11T00:23:53.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.147+0000 7f4c7ce00640 1 -- 172.21.15.40:0/3603436409 wait complete. 2024-09-11T00:23:53.164 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-11T00:23:51.775990+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":86,"acting":86,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219048,"kb_used_data":2564,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755672,"statfs":{"total":773094113280,"available":772869808128,"internally_reserved":0,"allocated":2625536,"data_stored":1615477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.878823"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526446+0000","last_change":"2024-09-11T00:23:48.937798+0000","last_active":"2024-09-11T00:23:50.526446+0000","last_peered":"2024-09-11T00:23:50.526446+0000","last_clean":"2024-09-11T00:23:50.526446+0000","last_became_active":"2024-09-11T00:23:48.937479+0000","last_became_peered":"2024-09-11T00:23:48.937479+0000","last_unstale":"2024-09-11T00:23:50.526446+0000","last_undegraded":"2024-09-11T00:23:50.526446+0000","last_fullsized":"2024-09-11T00:23:50.526446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:27.574913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526136+0000","last_change":"2024-09-11T00:23:48.934059+0000","last_active":"2024-09-11T00:23:50.526136+0000","last_peered":"2024-09-11T00:23:50.526136+0000","last_clean":"2024-09-11T00:23:50.526136+0000","last_became_active":"2024-09-11T00:23:48.931545+0000","last_became_peered":"2024-09-11T00:23:48.931545+0000","last_unstale":"2024-09-11T00:23:50.526136+0000","last_undegraded":"2024-09-11T00:23:50.526136+0000","last_fullsized":"2024-09-11T00:23:50.526136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:22.406899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526203+0000","last_change":"2024-09-11T00:23:48.942961+0000","last_active":"2024-09-11T00:23:50.526203+0000","last_peered":"2024-09-11T00:23:50.526203+0000","last_clean":"2024-09-11T00:23:50.526203+0000","last_became_active":"2024-09-11T00:23:48.941533+0000","last_became_peered":"2024-09-11T00:23:48.941533+0000","last_unstale":"2024-09-11T00:23:50.526203+0000","last_undegraded":"2024-09-11T00:23:50.526203+0000","last_fullsized":"2024-09-11T00:23:50.526203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:52.956083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526474+0000","last_change":"2024-09-11T00:23:48.947976+0000","last_active":"2024-09-11T00:23:50.526474+0000","last_peered":"2024-09-11T00:23:50.526474+0000","last_clean":"2024-09-11T00:23:50.526474+0000","last_became_active":"2024-09-11T00:23:48.947725+0000","last_became_peered":"2024-09-11T00:23:48.947725+0000","last_unstale":"2024-09-11T00:23:50.526474+0000","last_undegraded":"2024-09-11T00:23:50.526474+0000","last_fullsized":"2024-09-11T00:23:50.526474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:09:52.162272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.904840+0000","last_change":"2024-09-11T00:23:46.904840+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.904840+0000","last_undegraded":"2024-09-11T00:23:46.904840+0000","last_fullsized":"2024-09-11T00:23:46.904840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526491+0000","last_change":"2024-09-11T00:23:48.934481+0000","last_active":"2024-09-11T00:23:50.526491+0000","last_peered":"2024-09-11T00:23:50.526491+0000","last_clean":"2024-09-11T00:23:50.526491+0000","last_became_active":"2024-09-11T00:23:48.931082+0000","last_became_peered":"2024-09-11T00:23:48.931082+0000","last_unstale":"2024-09-11T00:23:50.526491+0000","last_undegraded":"2024-09-11T00:23:50.526491+0000","last_fullsized":"2024-09-11T00:23:50.526491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:04.133148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.904029+0000","last_change":"2024-09-11T00:23:46.904029+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.904029+0000","last_undegraded":"2024-09-11T00:23:46.904029+0000","last_fullsized":"2024-09-11T00:23:46.904029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.905930+0000","last_change":"2024-09-11T00:23:46.905930+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.905930+0000","last_undegraded":"2024-09-11T00:23:46.905930+0000","last_fullsized":"2024-09-11T00:23:46.905930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.901320+0000","last_change":"2024-09-11T00:23:46.901320+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.901320+0000","last_undegraded":"2024-09-11T00:23:46.901320+0000","last_fullsized":"2024-09-11T00:23:46.901320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.904706+0000","last_change":"2024-09-11T00:23:46.904706+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.904706+0000","last_undegraded":"2024-09-11T00:23:46.904706+0000","last_fullsized":"2024-09-11T00:23:46.904706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.901102+0000","last_change":"2024-09-11T00:23:46.901102+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.901102+0000","last_undegraded":"2024-09-11T00:23:46.901102+0000","last_fullsized":"2024-09-11T00:23:46.901102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526665+0000","last_change":"2024-09-11T00:23:48.925280+0000","last_active":"2024-09-11T00:23:50.526665+0000","last_peered":"2024-09-11T00:23:50.526665+0000","last_clean":"2024-09-11T00:23:50.526665+0000","last_became_active":"2024-09-11T00:23:48.923558+0000","last_became_peered":"2024-09-11T00:23:48.923558+0000","last_unstale":"2024-09-11T00:23:50.526665+0000","last_undegraded":"2024-09-11T00:23:50.526665+0000","last_fullsized":"2024-09-11T00:23:50.526665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:51.437783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.907496+0000","last_change":"2024-09-11T00:23:46.907496+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.907496+0000","last_undegraded":"2024-09-11T00:23:46.907496+0000","last_fullsized":"2024-09-11T00:23:46.907496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.904023+0000","last_change":"2024-09-11T00:23:46.904023+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.904023+0000","last_undegraded":"2024-09-11T00:23:46.904023+0000","last_fullsized":"2024-09-11T00:23:46.904023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526613+0000","last_change":"2024-09-11T00:23:47.931967+0000","last_active":"2024-09-11T00:23:50.526613+0000","last_peered":"2024-09-11T00:23:50.526613+0000","last_clean":"2024-09-11T00:23:50.526613+0000","last_became_active":"2024-09-11T00:23:47.929613+0000","last_became_peered":"2024-09-11T00:23:47.929613+0000","last_unstale":"2024-09-11T00:23:50.526613+0000","last_undegraded":"2024-09-11T00:23:50.526613+0000","last_fullsized":"2024-09-11T00:23:50.526613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:07.537335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526168+0000","last_change":"2024-09-11T00:23:48.942082+0000","last_active":"2024-09-11T00:23:50.526168+0000","last_peered":"2024-09-11T00:23:50.526168+0000","last_clean":"2024-09-11T00:23:50.526168+0000","last_became_active":"2024-09-11T00:23:48.941719+0000","last_became_peered":"2024-09-11T00:23:48.941719+0000","last_unstale":"2024-09-11T00:23:50.526168+0000","last_undegraded":"2024-09-11T00:23:50.526168+0000","last_fullsized":"2024-09-11T00:23:50.526168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:12.862149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.902182+0000","last_change":"2024-09-11T00:23:46.902182+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.902182+0000","last_undegraded":"2024-09-11T00:23:46.902182+0000","last_fullsized":"2024-09-11T00:23:46.902182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.904002+0000","last_change":"2024-09-11T00:23:46.904002+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.904002+0000","last_undegraded":"2024-09-11T00:23:46.904002+0000","last_fullsized":"2024-09-11T00:23:46.904002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.900297+0000","last_change":"2024-09-11T00:23:46.900297+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.900297+0000","last_undegraded":"2024-09-11T00:23:46.900297+0000","last_fullsized":"2024-09-11T00:23:46.900297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.900715+0000","last_change":"2024-09-11T00:23:46.900715+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.900715+0000","last_undegraded":"2024-09-11T00:23:46.900715+0000","last_fullsized":"2024-09-11T00:23:46.900715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.900198+0000","last_change":"2024-09-11T00:23:46.900198+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.900198+0000","last_undegraded":"2024-09-11T00:23:46.900198+0000","last_fullsized":"2024-09-11T00:23:46.900198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.904365+0000","last_change":"2024-09-11T00:23:46.904365+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.904365+0000","last_undegraded":"2024-09-11T00:23:46.904365+0000","last_fullsized":"2024-09-11T00:23:46.904365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.901036+0000","last_change":"2024-09-11T00:23:46.901036+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.901036+0000","last_undegraded":"2024-09-11T00:23:46.901036+0000","last_fullsized":"2024-09-11T00:23:46.901036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":105,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T00:23:46.910738+0000","last_change":"2024-09-11T00:23:38.923873+0000","last_active":"2024-09-11T00:23:46.910738+0000","last_peered":"2024-09-11T00:23:46.910738+0000","last_clean":"2024-09-11T00:23:46.910738+0000","last_became_active":"2024-09-11T00:23:38.920629+0000","last_became_peered":"2024-09-11T00:23:38.920629+0000","last_unstale":"2024-09-11T00:23:46.910738+0000","last_undegraded":"2024-09-11T00:23:46.910738+0000","last_fullsized":"2024-09-11T00:23:46.910738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_clean_scrub_stamp":"2024-09-11T00:23:37.844553+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.533941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.901116+0000","last_change":"2024-09-11T00:23:46.901116+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.901116+0000","last_undegraded":"2024-09-11T00:23:46.901116+0000","last_fullsized":"2024-09-11T00:23:46.901116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.909325+0000","last_change":"2024-09-11T00:23:46.909325+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.909325+0000","last_undegraded":"2024-09-11T00:23:46.909325+0000","last_fullsized":"2024-09-11T00:23:46.909325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526116+0000","last_change":"2024-09-11T00:23:48.933693+0000","last_active":"2024-09-11T00:23:50.526116+0000","last_peered":"2024-09-11T00:23:50.526116+0000","last_clean":"2024-09-11T00:23:50.526116+0000","last_became_active":"2024-09-11T00:23:48.933355+0000","last_became_peered":"2024-09-11T00:23:48.933355+0000","last_unstale":"2024-09-11T00:23:50.526116+0000","last_undegraded":"2024-09-11T00:23:50.526116+0000","last_fullsized":"2024-09-11T00:23:50.526116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:26.797108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.900189+0000","last_change":"2024-09-11T00:23:46.900189+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.900189+0000","last_undegraded":"2024-09-11T00:23:46.900189+0000","last_fullsized":"2024-09-11T00:23:46.900189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.901123+0000","last_change":"2024-09-11T00:23:46.901123+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.901123+0000","last_undegraded":"2024-09-11T00:23:46.901123+0000","last_fullsized":"2024-09-11T00:23:46.901123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.909267+0000","last_change":"2024-09-11T00:23:46.909267+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.909267+0000","last_undegraded":"2024-09-11T00:23:46.909267+0000","last_fullsized":"2024-09-11T00:23:46.909267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.909380+0000","last_change":"2024-09-11T00:23:46.909380+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.909380+0000","last_undegraded":"2024-09-11T00:23:46.909380+0000","last_fullsized":"2024-09-11T00:23:46.909380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.907065+0000","last_change":"2024-09-11T00:23:46.907065+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.907065+0000","last_undegraded":"2024-09-11T00:23:46.907065+0000","last_fullsized":"2024-09-11T00:23:46.907065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.904030+0000","last_change":"2024-09-11T00:23:46.904030+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.904030+0000","last_undegraded":"2024-09-11T00:23:46.904030+0000","last_fullsized":"2024-09-11T00:23:46.904030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526432+0000","last_change":"2024-09-11T00:23:48.948747+0000","last_active":"2024-09-11T00:23:50.526432+0000","last_peered":"2024-09-11T00:23:50.526432+0000","last_clean":"2024-09-11T00:23:50.526432+0000","last_became_active":"2024-09-11T00:23:48.948439+0000","last_became_peered":"2024-09-11T00:23:48.948439+0000","last_unstale":"2024-09-11T00:23:50.526432+0000","last_undegraded":"2024-09-11T00:23:50.526432+0000","last_fullsized":"2024-09-11T00:23:50.526432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:59.951812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.910357+0000","last_change":"2024-09-11T00:23:46.910357+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.910357+0000","last_undegraded":"2024-09-11T00:23:46.910357+0000","last_fullsized":"2024-09-11T00:23:46.910357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.903935+0000","last_change":"2024-09-11T00:23:46.903935+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.903935+0000","last_undegraded":"2024-09-11T00:23:46.903935+0000","last_fullsized":"2024-09-11T00:23:46.903935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.903950+0000","last_change":"2024-09-11T00:23:46.903950+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.903950+0000","last_undegraded":"2024-09-11T00:23:46.903950+0000","last_fullsized":"2024-09-11T00:23:46.903950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.909996+0000","last_change":"2024-09-11T00:23:46.909996+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.909996+0000","last_undegraded":"2024-09-11T00:23:46.909996+0000","last_fullsized":"2024-09-11T00:23:46.909996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.909380+0000","last_change":"2024-09-11T00:23:46.909380+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.909380+0000","last_undegraded":"2024-09-11T00:23:46.909380+0000","last_fullsized":"2024-09-11T00:23:46.909380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.910286+0000","last_change":"2024-09-11T00:23:46.910286+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.910286+0000","last_undegraded":"2024-09-11T00:23:46.910286+0000","last_fullsized":"2024-09-11T00:23:46.910286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526442+0000","last_change":"2024-09-11T00:23:48.925648+0000","last_active":"2024-09-11T00:23:50.526442+0000","last_peered":"2024-09-11T00:23:50.526442+0000","last_clean":"2024-09-11T00:23:50.526442+0000","last_became_active":"2024-09-11T00:23:48.924442+0000","last_became_peered":"2024-09-11T00:23:48.924442+0000","last_unstale":"2024-09-11T00:23:50.526442+0000","last_undegraded":"2024-09-11T00:23:50.526442+0000","last_fullsized":"2024-09-11T00:23:50.526442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:54.299102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.904214+0000","last_change":"2024-09-11T00:23:46.904214+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.904214+0000","last_undegraded":"2024-09-11T00:23:46.904214+0000","last_fullsized":"2024-09-11T00:23:46.904214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526569+0000","last_change":"2024-09-11T00:23:47.940123+0000","last_active":"2024-09-11T00:23:50.526569+0000","last_peered":"2024-09-11T00:23:50.526569+0000","last_clean":"2024-09-11T00:23:50.526569+0000","last_became_active":"2024-09-11T00:23:47.939901+0000","last_became_peered":"2024-09-11T00:23:47.939901+0000","last_unstale":"2024-09-11T00:23:50.526569+0000","last_undegraded":"2024-09-11T00:23:50.526569+0000","last_fullsized":"2024-09-11T00:23:50.526569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:45.637790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":765952,"data_stored":641485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":51117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":51117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":172032,"data_stored":51117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":51117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":172032,"data_stored":51117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":51117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":667290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:23:53.169 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:23:53.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.365+0000 7efc2fe00640 1 -- 172.21.15.40:0/537799051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc3006efa0 msgr2=0x7efc30073830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:53.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.365+0000 7efc2fe00640 1 --2- 172.21.15.40:0/537799051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc3006efa0 0x7efc30073830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efc18005fd0 tx=0x7efc1802a670 comp rx=0 tx=0).stop 2024-09-11T00:23:53.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.365+0000 7efc2fe00640 1 -- 172.21.15.40:0/537799051 shutdown_connections 2024-09-11T00:23:53.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.365+0000 7efc2fe00640 1 --2- 172.21.15.40:0/537799051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc3006efa0 0x7efc30073830 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:53.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.365+0000 7efc2fe00640 1 -- 172.21.15.40:0/537799051 >> 172.21.15.40:0/537799051 conn(0x7efc300cf770 msgr2=0x7efc300cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:53.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.365+0000 7efc2fe00640 1 -- 172.21.15.40:0/537799051 shutdown_connections 2024-09-11T00:23:53.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.365+0000 7efc2fe00640 1 -- 172.21.15.40:0/537799051 wait complete. 2024-09-11T00:23:53.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.366+0000 7efc2fe00640 1 Processor -- start 2024-09-11T00:23:53.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.367+0000 7efc2fe00640 1 -- start start 2024-09-11T00:23:53.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.367+0000 7efc2fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc3006efa0 0x7efc300c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:53.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.367+0000 7efc2fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc300ae640 0x7efc301f8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:53.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.368+0000 7efc2fe00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc3015baa0 0x7efc300ad870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:53.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.368+0000 7efc2fe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efc3015c750 con 0x7efc3006efa0 2024-09-11T00:23:53.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.368+0000 7efc2fe00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efc3015c5d0 con 0x7efc300ae640 2024-09-11T00:23:53.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.368+0000 7efc2fe00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efc3015c8d0 con 0x7efc3015baa0 2024-09-11T00:23:53.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.368+0000 7efc2ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc3006efa0 0x7efc300c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:53.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.368+0000 7efc2ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc3006efa0 0x7efc300c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42224/0 (socket says 172.21.15.40:42224) 2024-09-11T00:23:53.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.368+0000 7efc2ea00640 1 -- 172.21.15.40:0/873145822 learned_addr learned my addr 172.21.15.40:0/873145822 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:53.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.368+0000 7efc26000640 1 --2- 172.21.15.40:0/873145822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc300ae640 0x7efc301f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:53.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.368+0000 7efc2f400640 1 --2- 172.21.15.40:0/873145822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc3015baa0 0x7efc300ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:53.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.368+0000 7efc2ea00640 1 -- 172.21.15.40:0/873145822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc3015baa0 msgr2=0x7efc300ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:53.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.368+0000 7efc2ea00640 1 --2- 172.21.15.40:0/873145822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc3015baa0 0x7efc300ad870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:53.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.368+0000 7efc2ea00640 1 -- 172.21.15.40:0/873145822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc300ae640 msgr2=0x7efc301f8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:53.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.368+0000 7efc2ea00640 1 --2- 172.21.15.40:0/873145822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc300ae640 0x7efc301f8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:53.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.368+0000 7efc2ea00640 1 -- 172.21.15.40:0/873145822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc300cbda0 con 0x7efc3006efa0 2024-09-11T00:23:53.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.368+0000 7efc2ea00640 1 --2- 172.21.15.40:0/873145822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc3006efa0 0x7efc300c32a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efc2000c370 tx=0x7efc2000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:53.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.369+0000 7efc27400640 1 -- 172.21.15.40:0/873145822 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20017070 con 0x7efc3006efa0 2024-09-11T00:23:53.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.369+0000 7efc27400640 1 -- 172.21.15.40:0/873145822 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc200035f0 con 0x7efc3006efa0 2024-09-11T00:23:53.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.369+0000 7efc27400640 1 -- 172.21.15.40:0/873145822 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20003a40 con 0x7efc3006efa0 2024-09-11T00:23:53.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.369+0000 7efc2fe00640 1 -- 172.21.15.40:0/873145822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc300c3cd0 con 0x7efc3006efa0 2024-09-11T00:23:53.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.369+0000 7efc2fe00640 1 -- 172.21.15.40:0/873145822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc300c4290 con 0x7efc3006efa0 2024-09-11T00:23:53.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.370+0000 7efc2fe00640 1 -- 172.21.15.40:0/873145822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc30074010 con 0x7efc3006efa0 2024-09-11T00:23:53.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.371+0000 7efc27400640 1 -- 172.21.15.40:0/873145822 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7efc20003be0 con 0x7efc3006efa0 2024-09-11T00:23:53.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.373+0000 7efc27400640 1 --2- 172.21.15.40:0/873145822 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7efc0c077fa0 0x7efc0c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:53.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.373+0000 7efc27400640 1 -- 172.21.15.40:0/873145822 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7efc200992f0 con 0x7efc3006efa0 2024-09-11T00:23:53.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.373+0000 7efc26000640 1 --2- 172.21.15.40:0/873145822 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7efc0c077fa0 0x7efc0c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:53.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.374+0000 7efc26000640 1 --2- 172.21.15.40:0/873145822 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7efc0c077fa0 0x7efc0c07a460 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efc18033000 tx=0x7efc18004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:53.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.377+0000 7efc27400640 1 -- 172.21.15.40:0/873145822 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7efc20061700 con 0x7efc3006efa0 2024-09-11T00:23:53.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.567+0000 7efc2fe00640 1 -- 172.21.15.40:0/873145822 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc300696c0 con 0x7efc0c077fa0 2024-09-11T00:23:53.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.571+0000 7efc27400640 1 -- 172.21.15.40:0/873145822 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241621 (secure 0 0 0) 0x7efc300696c0 con 0x7efc0c077fa0 2024-09-11T00:23:53.575 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:23:53.576 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T00:23:53.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.575+0000 7efc2fe00640 1 -- 172.21.15.40:0/873145822 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7efc0c077fa0 msgr2=0x7efc0c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:53.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.575+0000 7efc2fe00640 1 --2- 172.21.15.40:0/873145822 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7efc0c077fa0 0x7efc0c07a460 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efc18033000 tx=0x7efc18004730 comp rx=0 tx=0).stop 2024-09-11T00:23:53.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.575+0000 7efc2fe00640 1 -- 172.21.15.40:0/873145822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc3006efa0 msgr2=0x7efc300c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:53.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.575+0000 7efc2fe00640 1 --2- 172.21.15.40:0/873145822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc3006efa0 0x7efc300c32a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efc2000c370 tx=0x7efc2000c830 comp rx=0 tx=0).stop 2024-09-11T00:23:53.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.575+0000 7efc2fe00640 1 -- 172.21.15.40:0/873145822 shutdown_connections 2024-09-11T00:23:53.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.575+0000 7efc2fe00640 1 --2- 172.21.15.40:0/873145822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc3015baa0 0x7efc300ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:53.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.575+0000 7efc2fe00640 1 --2- 172.21.15.40:0/873145822 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7efc0c077fa0 0x7efc0c07a460 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:53.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.575+0000 7efc2fe00640 1 --2- 172.21.15.40:0/873145822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc300ae640 0x7efc301f8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:53.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.575+0000 7efc2fe00640 1 --2- 172.21.15.40:0/873145822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc3006efa0 0x7efc300c32a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:53.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.575+0000 7efc2fe00640 1 -- 172.21.15.40:0/873145822 >> 172.21.15.40:0/873145822 conn(0x7efc300cf770 msgr2=0x7efc3015cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:53.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.575+0000 7efc2fe00640 1 -- 172.21.15.40:0/873145822 shutdown_connections 2024-09-11T00:23:53.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.575+0000 7efc2fe00640 1 -- 172.21.15.40:0/873145822 wait complete. 2024-09-11T00:23:53.592 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-11T00:23:51.775990+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":86,"acting":86,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219048,"kb_used_data":2564,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755672,"statfs":{"total":773094113280,"available":772869808128,"internally_reserved":0,"allocated":2625536,"data_stored":1615477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.878823"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526446+0000","last_change":"2024-09-11T00:23:48.937798+0000","last_active":"2024-09-11T00:23:50.526446+0000","last_peered":"2024-09-11T00:23:50.526446+0000","last_clean":"2024-09-11T00:23:50.526446+0000","last_became_active":"2024-09-11T00:23:48.937479+0000","last_became_peered":"2024-09-11T00:23:48.937479+0000","last_unstale":"2024-09-11T00:23:50.526446+0000","last_undegraded":"2024-09-11T00:23:50.526446+0000","last_fullsized":"2024-09-11T00:23:50.526446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:27.574913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526136+0000","last_change":"2024-09-11T00:23:48.934059+0000","last_active":"2024-09-11T00:23:50.526136+0000","last_peered":"2024-09-11T00:23:50.526136+0000","last_clean":"2024-09-11T00:23:50.526136+0000","last_became_active":"2024-09-11T00:23:48.931545+0000","last_became_peered":"2024-09-11T00:23:48.931545+0000","last_unstale":"2024-09-11T00:23:50.526136+0000","last_undegraded":"2024-09-11T00:23:50.526136+0000","last_fullsized":"2024-09-11T00:23:50.526136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:22.406899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526203+0000","last_change":"2024-09-11T00:23:48.942961+0000","last_active":"2024-09-11T00:23:50.526203+0000","last_peered":"2024-09-11T00:23:50.526203+0000","last_clean":"2024-09-11T00:23:50.526203+0000","last_became_active":"2024-09-11T00:23:48.941533+0000","last_became_peered":"2024-09-11T00:23:48.941533+0000","last_unstale":"2024-09-11T00:23:50.526203+0000","last_undegraded":"2024-09-11T00:23:50.526203+0000","last_fullsized":"2024-09-11T00:23:50.526203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:52.956083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526474+0000","last_change":"2024-09-11T00:23:48.947976+0000","last_active":"2024-09-11T00:23:50.526474+0000","last_peered":"2024-09-11T00:23:50.526474+0000","last_clean":"2024-09-11T00:23:50.526474+0000","last_became_active":"2024-09-11T00:23:48.947725+0000","last_became_peered":"2024-09-11T00:23:48.947725+0000","last_unstale":"2024-09-11T00:23:50.526474+0000","last_undegraded":"2024-09-11T00:23:50.526474+0000","last_fullsized":"2024-09-11T00:23:50.526474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:09:52.162272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.904840+0000","last_change":"2024-09-11T00:23:46.904840+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.904840+0000","last_undegraded":"2024-09-11T00:23:46.904840+0000","last_fullsized":"2024-09-11T00:23:46.904840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526491+0000","last_change":"2024-09-11T00:23:48.934481+0000","last_active":"2024-09-11T00:23:50.526491+0000","last_peered":"2024-09-11T00:23:50.526491+0000","last_clean":"2024-09-11T00:23:50.526491+0000","last_became_active":"2024-09-11T00:23:48.931082+0000","last_became_peered":"2024-09-11T00:23:48.931082+0000","last_unstale":"2024-09-11T00:23:50.526491+0000","last_undegraded":"2024-09-11T00:23:50.526491+0000","last_fullsized":"2024-09-11T00:23:50.526491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:04.133148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.904029+0000","last_change":"2024-09-11T00:23:46.904029+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.904029+0000","last_undegraded":"2024-09-11T00:23:46.904029+0000","last_fullsized":"2024-09-11T00:23:46.904029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.905930+0000","last_change":"2024-09-11T00:23:46.905930+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.905930+0000","last_undegraded":"2024-09-11T00:23:46.905930+0000","last_fullsized":"2024-09-11T00:23:46.905930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.901320+0000","last_change":"2024-09-11T00:23:46.901320+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.901320+0000","last_undegraded":"2024-09-11T00:23:46.901320+0000","last_fullsized":"2024-09-11T00:23:46.901320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.904706+0000","last_change":"2024-09-11T00:23:46.904706+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.904706+0000","last_undegraded":"2024-09-11T00:23:46.904706+0000","last_fullsized":"2024-09-11T00:23:46.904706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.901102+0000","last_change":"2024-09-11T00:23:46.901102+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.901102+0000","last_undegraded":"2024-09-11T00:23:46.901102+0000","last_fullsized":"2024-09-11T00:23:46.901102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526665+0000","last_change":"2024-09-11T00:23:48.925280+0000","last_active":"2024-09-11T00:23:50.526665+0000","last_peered":"2024-09-11T00:23:50.526665+0000","last_clean":"2024-09-11T00:23:50.526665+0000","last_became_active":"2024-09-11T00:23:48.923558+0000","last_became_peered":"2024-09-11T00:23:48.923558+0000","last_unstale":"2024-09-11T00:23:50.526665+0000","last_undegraded":"2024-09-11T00:23:50.526665+0000","last_fullsized":"2024-09-11T00:23:50.526665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:51.437783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.907496+0000","last_change":"2024-09-11T00:23:46.907496+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.907496+0000","last_undegraded":"2024-09-11T00:23:46.907496+0000","last_fullsized":"2024-09-11T00:23:46.907496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.904023+0000","last_change":"2024-09-11T00:23:46.904023+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.904023+0000","last_undegraded":"2024-09-11T00:23:46.904023+0000","last_fullsized":"2024-09-11T00:23:46.904023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526613+0000","last_change":"2024-09-11T00:23:47.931967+0000","last_active":"2024-09-11T00:23:50.526613+0000","last_peered":"2024-09-11T00:23:50.526613+0000","last_clean":"2024-09-11T00:23:50.526613+0000","last_became_active":"2024-09-11T00:23:47.929613+0000","last_became_peered":"2024-09-11T00:23:47.929613+0000","last_unstale":"2024-09-11T00:23:50.526613+0000","last_undegraded":"2024-09-11T00:23:50.526613+0000","last_fullsized":"2024-09-11T00:23:50.526613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:07.537335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526168+0000","last_change":"2024-09-11T00:23:48.942082+0000","last_active":"2024-09-11T00:23:50.526168+0000","last_peered":"2024-09-11T00:23:50.526168+0000","last_clean":"2024-09-11T00:23:50.526168+0000","last_became_active":"2024-09-11T00:23:48.941719+0000","last_became_peered":"2024-09-11T00:23:48.941719+0000","last_unstale":"2024-09-11T00:23:50.526168+0000","last_undegraded":"2024-09-11T00:23:50.526168+0000","last_fullsized":"2024-09-11T00:23:50.526168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:12.862149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.902182+0000","last_change":"2024-09-11T00:23:46.902182+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.902182+0000","last_undegraded":"2024-09-11T00:23:46.902182+0000","last_fullsized":"2024-09-11T00:23:46.902182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.904002+0000","last_change":"2024-09-11T00:23:46.904002+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.904002+0000","last_undegraded":"2024-09-11T00:23:46.904002+0000","last_fullsized":"2024-09-11T00:23:46.904002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.900297+0000","last_change":"2024-09-11T00:23:46.900297+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.900297+0000","last_undegraded":"2024-09-11T00:23:46.900297+0000","last_fullsized":"2024-09-11T00:23:46.900297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.900715+0000","last_change":"2024-09-11T00:23:46.900715+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.900715+0000","last_undegraded":"2024-09-11T00:23:46.900715+0000","last_fullsized":"2024-09-11T00:23:46.900715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.900198+0000","last_change":"2024-09-11T00:23:46.900198+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.900198+0000","last_undegraded":"2024-09-11T00:23:46.900198+0000","last_fullsized":"2024-09-11T00:23:46.900198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.904365+0000","last_change":"2024-09-11T00:23:46.904365+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.904365+0000","last_undegraded":"2024-09-11T00:23:46.904365+0000","last_fullsized":"2024-09-11T00:23:46.904365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.901036+0000","last_change":"2024-09-11T00:23:46.901036+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.901036+0000","last_undegraded":"2024-09-11T00:23:46.901036+0000","last_fullsized":"2024-09-11T00:23:46.901036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":105,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-11T00:23:46.910738+0000","last_change":"2024-09-11T00:23:38.923873+0000","last_active":"2024-09-11T00:23:46.910738+0000","last_peered":"2024-09-11T00:23:46.910738+0000","last_clean":"2024-09-11T00:23:46.910738+0000","last_became_active":"2024-09-11T00:23:38.920629+0000","last_became_peered":"2024-09-11T00:23:38.920629+0000","last_unstale":"2024-09-11T00:23:46.910738+0000","last_undegraded":"2024-09-11T00:23:46.910738+0000","last_fullsized":"2024-09-11T00:23:46.910738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_clean_scrub_stamp":"2024-09-11T00:23:37.844553+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.533941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.901116+0000","last_change":"2024-09-11T00:23:46.901116+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.901116+0000","last_undegraded":"2024-09-11T00:23:46.901116+0000","last_fullsized":"2024-09-11T00:23:46.901116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.909325+0000","last_change":"2024-09-11T00:23:46.909325+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.909325+0000","last_undegraded":"2024-09-11T00:23:46.909325+0000","last_fullsized":"2024-09-11T00:23:46.909325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526116+0000","last_change":"2024-09-11T00:23:48.933693+0000","last_active":"2024-09-11T00:23:50.526116+0000","last_peered":"2024-09-11T00:23:50.526116+0000","last_clean":"2024-09-11T00:23:50.526116+0000","last_became_active":"2024-09-11T00:23:48.933355+0000","last_became_peered":"2024-09-11T00:23:48.933355+0000","last_unstale":"2024-09-11T00:23:50.526116+0000","last_undegraded":"2024-09-11T00:23:50.526116+0000","last_fullsized":"2024-09-11T00:23:50.526116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:26.797108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.900189+0000","last_change":"2024-09-11T00:23:46.900189+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.900189+0000","last_undegraded":"2024-09-11T00:23:46.900189+0000","last_fullsized":"2024-09-11T00:23:46.900189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.901123+0000","last_change":"2024-09-11T00:23:46.901123+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.901123+0000","last_undegraded":"2024-09-11T00:23:46.901123+0000","last_fullsized":"2024-09-11T00:23:46.901123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.909267+0000","last_change":"2024-09-11T00:23:46.909267+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.909267+0000","last_undegraded":"2024-09-11T00:23:46.909267+0000","last_fullsized":"2024-09-11T00:23:46.909267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.909380+0000","last_change":"2024-09-11T00:23:46.909380+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.909380+0000","last_undegraded":"2024-09-11T00:23:46.909380+0000","last_fullsized":"2024-09-11T00:23:46.909380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.907065+0000","last_change":"2024-09-11T00:23:46.907065+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.907065+0000","last_undegraded":"2024-09-11T00:23:46.907065+0000","last_fullsized":"2024-09-11T00:23:46.907065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.904030+0000","last_change":"2024-09-11T00:23:46.904030+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.904030+0000","last_undegraded":"2024-09-11T00:23:46.904030+0000","last_fullsized":"2024-09-11T00:23:46.904030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526432+0000","last_change":"2024-09-11T00:23:48.948747+0000","last_active":"2024-09-11T00:23:50.526432+0000","last_peered":"2024-09-11T00:23:50.526432+0000","last_clean":"2024-09-11T00:23:50.526432+0000","last_became_active":"2024-09-11T00:23:48.948439+0000","last_became_peered":"2024-09-11T00:23:48.948439+0000","last_unstale":"2024-09-11T00:23:50.526432+0000","last_undegraded":"2024-09-11T00:23:50.526432+0000","last_fullsized":"2024-09-11T00:23:50.526432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:59.951812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.910357+0000","last_change":"2024-09-11T00:23:46.910357+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.910357+0000","last_undegraded":"2024-09-11T00:23:46.910357+0000","last_fullsized":"2024-09-11T00:23:46.910357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.903935+0000","last_change":"2024-09-11T00:23:46.903935+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.903935+0000","last_undegraded":"2024-09-11T00:23:46.903935+0000","last_fullsized":"2024-09-11T00:23:46.903935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.903950+0000","last_change":"2024-09-11T00:23:46.903950+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.903950+0000","last_undegraded":"2024-09-11T00:23:46.903950+0000","last_fullsized":"2024-09-11T00:23:46.903950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.909996+0000","last_change":"2024-09-11T00:23:46.909996+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.909996+0000","last_undegraded":"2024-09-11T00:23:46.909996+0000","last_fullsized":"2024-09-11T00:23:46.909996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.909380+0000","last_change":"2024-09-11T00:23:46.909380+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.909380+0000","last_undegraded":"2024-09-11T00:23:46.909380+0000","last_fullsized":"2024-09-11T00:23:46.909380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.910286+0000","last_change":"2024-09-11T00:23:46.910286+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.910286+0000","last_undegraded":"2024-09-11T00:23:46.910286+0000","last_fullsized":"2024-09-11T00:23:46.910286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526442+0000","last_change":"2024-09-11T00:23:48.925648+0000","last_active":"2024-09-11T00:23:50.526442+0000","last_peered":"2024-09-11T00:23:50.526442+0000","last_clean":"2024-09-11T00:23:50.526442+0000","last_became_active":"2024-09-11T00:23:48.924442+0000","last_became_peered":"2024-09-11T00:23:48.924442+0000","last_unstale":"2024-09-11T00:23:50.526442+0000","last_undegraded":"2024-09-11T00:23:50.526442+0000","last_fullsized":"2024-09-11T00:23:50.526442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:54.299102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-11T00:23:46.904214+0000","last_change":"2024-09-11T00:23:46.904214+0000","last_active":"2024-09-11T00:23:46.890584+0000","last_peered":"2024-09-11T00:23:46.890584+0000","last_clean":"2024-09-11T00:23:46.890584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:46.904214+0000","last_undegraded":"2024-09-11T00:23:46.904214+0000","last_fullsized":"2024-09-11T00:23:46.904214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:23:47.897289+0000","last_change":"2024-09-11T00:23:47.897289+0000","last_active":"2024-09-11T00:23:47.897289+0000","last_peered":"2024-09-11T00:23:47.897289+0000","last_clean":"2024-09-11T00:23:47.897289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:23:47.897289+0000","last_undegraded":"2024-09-11T00:23:47.897289+0000","last_fullsized":"2024-09-11T00:23:47.897289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526569+0000","last_change":"2024-09-11T00:23:47.940123+0000","last_active":"2024-09-11T00:23:50.526569+0000","last_peered":"2024-09-11T00:23:50.526569+0000","last_clean":"2024-09-11T00:23:50.526569+0000","last_became_active":"2024-09-11T00:23:47.939901+0000","last_became_peered":"2024-09-11T00:23:47.939901+0000","last_unstale":"2024-09-11T00:23:50.526569+0000","last_undegraded":"2024-09-11T00:23:50.526569+0000","last_fullsized":"2024-09-11T00:23:50.526569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:45.637790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":765952,"data_stored":641485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":51117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":51117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":172032,"data_stored":51117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":51117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":172032,"data_stored":51117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":51117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":667290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:23:53.596 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:23:53.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.792+0000 7f5a1fa00640 1 -- 172.21.15.40:0/1559504074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a180cf3b0 msgr2=0x7f5a180711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:53.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.792+0000 7f5a1fa00640 1 --2- 172.21.15.40:0/1559504074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a180cf3b0 0x7f5a180711d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5a04005fd0 tx=0x7f5a0402a560 comp rx=0 tx=0).stop 2024-09-11T00:23:53.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.792+0000 7f5a1fa00640 1 -- 172.21.15.40:0/1559504074 shutdown_connections 2024-09-11T00:23:53.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.792+0000 7f5a1fa00640 1 --2- 172.21.15.40:0/1559504074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a180cf3b0 0x7f5a180711d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:53.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.792+0000 7f5a1fa00640 1 -- 172.21.15.40:0/1559504074 >> 172.21.15.40:0/1559504074 conn(0x7f5a180d1d50 msgr2=0x7f5a180d2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:53.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.792+0000 7f5a1fa00640 1 -- 172.21.15.40:0/1559504074 shutdown_connections 2024-09-11T00:23:53.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.792+0000 7f5a1fa00640 1 -- 172.21.15.40:0/1559504074 wait complete. 2024-09-11T00:23:53.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.794+0000 7f5a1fa00640 1 Processor -- start 2024-09-11T00:23:53.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.794+0000 7f5a1fa00640 1 -- start start 2024-09-11T00:23:53.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.795+0000 7f5a1fa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a18071710 0x7f5a18153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:53.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.795+0000 7f5a1fa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a180cf3b0 0x7f5a18147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:53.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.795+0000 7f5a1fa00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a1815f570 0x7f5a18148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:53.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.795+0000 7f5a1fa00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5a180cee00 con 0x7f5a18071710 2024-09-11T00:23:53.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.795+0000 7f5a1fa00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5a180ce2c0 con 0x7f5a180cf3b0 2024-09-11T00:23:53.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.795+0000 7f5a1fa00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5a18156770 con 0x7f5a1815f570 2024-09-11T00:23:53.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.795+0000 7f5a1d000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a18071710 0x7f5a18153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:53.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.795+0000 7f5a1d000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a18071710 0x7f5a18153530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42244/0 (socket says 172.21.15.40:42244) 2024-09-11T00:23:53.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.795+0000 7f5a1d000640 1 -- 172.21.15.40:0/69623512 learned_addr learned my addr 172.21.15.40:0/69623512 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:53.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.795+0000 7f5a1d000640 1 -- 172.21.15.40:0/69623512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a1815f570 msgr2=0x7f5a18148260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:53.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.795+0000 7f5a1d000640 1 --2- 172.21.15.40:0/69623512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a1815f570 0x7f5a18148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:53.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.795+0000 7f5a1d000640 1 -- 172.21.15.40:0/69623512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a180cf3b0 msgr2=0x7f5a18147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:53.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.795+0000 7f5a17e00640 1 --2- 172.21.15.40:0/69623512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a180cf3b0 0x7f5a18147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:53.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.795+0000 7f5a1d000640 1 --2- 172.21.15.40:0/69623512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a180cf3b0 0x7f5a18147d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:53.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.796+0000 7f5a1d000640 1 -- 172.21.15.40:0/69623512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a18156a50 con 0x7f5a18071710 2024-09-11T00:23:53.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.796+0000 7f5a17e00640 1 --2- 172.21.15.40:0/69623512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a180cf3b0 0x7f5a18147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:53.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.796+0000 7f5a1d000640 1 --2- 172.21.15.40:0/69623512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a18071710 0x7f5a18153530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800c430 tx=0x7f5a0800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:53.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.796+0000 7f5a14c00640 1 -- 172.21.15.40:0/69623512 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a08017070 con 0x7f5a18071710 2024-09-11T00:23:53.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.796+0000 7f5a14c00640 1 -- 172.21.15.40:0/69623512 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a080053c0 con 0x7f5a18071710 2024-09-11T00:23:53.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.796+0000 7f5a14c00640 1 -- 172.21.15.40:0/69623512 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a08003850 con 0x7f5a18071710 2024-09-11T00:23:53.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.796+0000 7f5a1fa00640 1 -- 172.21.15.40:0/69623512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a18148b50 con 0x7f5a18071710 2024-09-11T00:23:53.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.796+0000 7f5a1fa00640 1 -- 172.21.15.40:0/69623512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a181556f0 con 0x7f5a18071710 2024-09-11T00:23:53.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.797+0000 7f5a1fa00640 1 -- 172.21.15.40:0/69623512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a18148970 con 0x7f5a18071710 2024-09-11T00:23:53.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.798+0000 7f5a14c00640 1 -- 172.21.15.40:0/69623512 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5a080039f0 con 0x7f5a18071710 2024-09-11T00:23:53.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.799+0000 7f5a14c00640 1 --2- 172.21.15.40:0/69623512 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f59f8077f70 0x7f59f807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:53.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.799+0000 7f5a14c00640 1 -- 172.21.15.40:0/69623512 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5a080994e0 con 0x7f5a18071710 2024-09-11T00:23:53.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.800+0000 7f5a17e00640 1 --2- 172.21.15.40:0/69623512 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f59f8077f70 0x7f59f807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:53.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.800+0000 7f5a17e00640 1 --2- 172.21.15.40:0/69623512 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f59f8077f70 0x7f59f807a430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5a04033000 tx=0x7f5a04004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:53.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.803+0000 7f5a14c00640 1 -- 172.21.15.40:0/69623512 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5a18148970 con 0x7f5a18071710 2024-09-11T00:23:53.891 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-11T00:23:53.889+0000 7f908b000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T00:23:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:53.994+0000 7f5a1fa00640 1 -- 172.21.15.40:0/69623512 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5a18156c20 con 0x7f59f8077f70 2024-09-11T00:23:54.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.000+0000 7f5a14c00640 1 -- 172.21.15.40:0/69623512 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251937 (secure 0 0 0) 0x7f5a18156c20 con 0x7f59f8077f70 2024-09-11T00:23:54.004 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:23:54.005 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T00:23:54.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.004+0000 7f5a1fa00640 1 -- 172.21.15.40:0/69623512 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f59f8077f70 msgr2=0x7f59f807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:54.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.004+0000 7f5a1fa00640 1 --2- 172.21.15.40:0/69623512 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f59f8077f70 0x7f59f807a430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5a04033000 tx=0x7f5a04004730 comp rx=0 tx=0).stop 2024-09-11T00:23:54.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.004+0000 7f5a1fa00640 1 -- 172.21.15.40:0/69623512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a18071710 msgr2=0x7f5a18153530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:54.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.004+0000 7f5a1fa00640 1 --2- 172.21.15.40:0/69623512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a18071710 0x7f5a18153530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800c430 tx=0x7f5a0800c8f0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.004+0000 7f5a1fa00640 1 -- 172.21.15.40:0/69623512 shutdown_connections 2024-09-11T00:23:54.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.004+0000 7f5a1fa00640 1 --2- 172.21.15.40:0/69623512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a1815f570 0x7f5a18148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.004+0000 7f5a1fa00640 1 --2- 172.21.15.40:0/69623512 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f59f8077f70 0x7f59f807a430 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.004+0000 7f5a1fa00640 1 --2- 172.21.15.40:0/69623512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a180cf3b0 0x7f5a18147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.004+0000 7f5a1fa00640 1 --2- 172.21.15.40:0/69623512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a18071710 0x7f5a18153530 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.004+0000 7f5a1fa00640 1 -- 172.21.15.40:0/69623512 >> 172.21.15.40:0/69623512 conn(0x7f5a180d1d50 msgr2=0x7f5a180d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.004+0000 7f5a1fa00640 1 -- 172.21.15.40:0/69623512 shutdown_connections 2024-09-11T00:23:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.005+0000 7f5a1fa00640 1 -- 172.21.15.40:0/69623512 wait complete. 2024-09-11T00:23:54.021 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-11T00:23:53.776519+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219184,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755536,"statfs":{"total":773094113280,"available":772869668864,"internally_reserved":0,"allocated":3022848,"data_stored":1795828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001796"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.872004+0000","last_change":"2024-09-11T00:23:48.948893+0000","last_active":"2024-09-11T00:23:50.872004+0000","last_peered":"2024-09-11T00:23:50.872004+0000","last_clean":"2024-09-11T00:23:50.872004+0000","last_became_active":"2024-09-11T00:23:48.948539+0000","last_became_peered":"2024-09-11T00:23:48.948539+0000","last_unstale":"2024-09-11T00:23:50.872004+0000","last_undegraded":"2024-09-11T00:23:50.872004+0000","last_fullsized":"2024-09-11T00:23:50.872004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:16.991662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934001+0000","last_change":"2024-09-11T00:23:48.937342+0000","last_active":"2024-09-11T00:23:49.934001+0000","last_peered":"2024-09-11T00:23:49.934001+0000","last_clean":"2024-09-11T00:23:49.934001+0000","last_became_active":"2024-09-11T00:23:48.936595+0000","last_became_peered":"2024-09-11T00:23:48.936595+0000","last_unstale":"2024-09-11T00:23:49.934001+0000","last_undegraded":"2024-09-11T00:23:49.934001+0000","last_fullsized":"2024-09-11T00:23:49.934001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:32.096363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526446+0000","last_change":"2024-09-11T00:23:48.937798+0000","last_active":"2024-09-11T00:23:50.526446+0000","last_peered":"2024-09-11T00:23:50.526446+0000","last_clean":"2024-09-11T00:23:50.526446+0000","last_became_active":"2024-09-11T00:23:48.937479+0000","last_became_peered":"2024-09-11T00:23:48.937479+0000","last_unstale":"2024-09-11T00:23:50.526446+0000","last_undegraded":"2024-09-11T00:23:50.526446+0000","last_fullsized":"2024-09-11T00:23:50.526446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:27.574913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935177+0000","last_change":"2024-09-11T00:23:48.931523+0000","last_active":"2024-09-11T00:23:49.935177+0000","last_peered":"2024-09-11T00:23:49.935177+0000","last_clean":"2024-09-11T00:23:49.935177+0000","last_became_active":"2024-09-11T00:23:48.930038+0000","last_became_peered":"2024-09-11T00:23:48.930038+0000","last_unstale":"2024-09-11T00:23:49.935177+0000","last_undegraded":"2024-09-11T00:23:49.935177+0000","last_fullsized":"2024-09-11T00:23:49.935177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:37.999694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871474+0000","last_change":"2024-09-11T00:23:48.936786+0000","last_active":"2024-09-11T00:23:50.871474+0000","last_peered":"2024-09-11T00:23:50.871474+0000","last_clean":"2024-09-11T00:23:50.871474+0000","last_became_active":"2024-09-11T00:23:48.936512+0000","last_became_peered":"2024-09-11T00:23:48.936512+0000","last_unstale":"2024-09-11T00:23:50.871474+0000","last_undegraded":"2024-09-11T00:23:50.871474+0000","last_fullsized":"2024-09-11T00:23:50.871474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:20.441191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934971+0000","last_change":"2024-09-11T00:23:48.935843+0000","last_active":"2024-09-11T00:23:49.934971+0000","last_peered":"2024-09-11T00:23:49.934971+0000","last_clean":"2024-09-11T00:23:49.934971+0000","last_became_active":"2024-09-11T00:23:48.935591+0000","last_became_peered":"2024-09-11T00:23:48.935591+0000","last_unstale":"2024-09-11T00:23:49.934971+0000","last_undegraded":"2024-09-11T00:23:49.934971+0000","last_fullsized":"2024-09-11T00:23:49.934971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:25.619010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870938+0000","last_change":"2024-09-11T00:23:48.939799+0000","last_active":"2024-09-11T00:23:50.870938+0000","last_peered":"2024-09-11T00:23:50.870938+0000","last_clean":"2024-09-11T00:23:50.870938+0000","last_became_active":"2024-09-11T00:23:48.939495+0000","last_became_peered":"2024-09-11T00:23:48.939495+0000","last_unstale":"2024-09-11T00:23:50.870938+0000","last_undegraded":"2024-09-11T00:23:50.870938+0000","last_fullsized":"2024-09-11T00:23:50.870938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:13.522317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869563+0000","last_change":"2024-09-11T00:23:48.933813+0000","last_active":"2024-09-11T00:23:50.869563+0000","last_peered":"2024-09-11T00:23:50.869563+0000","last_clean":"2024-09-11T00:23:50.869563+0000","last_became_active":"2024-09-11T00:23:48.932681+0000","last_became_peered":"2024-09-11T00:23:48.932681+0000","last_unstale":"2024-09-11T00:23:50.869563+0000","last_undegraded":"2024-09-11T00:23:50.869563+0000","last_fullsized":"2024-09-11T00:23:50.869563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:49.141326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.872030+0000","last_change":"2024-09-11T00:23:48.943035+0000","last_active":"2024-09-11T00:23:50.872030+0000","last_peered":"2024-09-11T00:23:50.872030+0000","last_clean":"2024-09-11T00:23:50.872030+0000","last_became_active":"2024-09-11T00:23:48.942299+0000","last_became_peered":"2024-09-11T00:23:48.942299+0000","last_unstale":"2024-09-11T00:23:50.872030+0000","last_undegraded":"2024-09-11T00:23:50.872030+0000","last_fullsized":"2024-09-11T00:23:50.872030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:04.169658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870722+0000","last_change":"2024-09-11T00:23:48.923914+0000","last_active":"2024-09-11T00:23:50.870722+0000","last_peered":"2024-09-11T00:23:50.870722+0000","last_clean":"2024-09-11T00:23:50.870722+0000","last_became_active":"2024-09-11T00:23:48.923637+0000","last_became_peered":"2024-09-11T00:23:48.923637+0000","last_unstale":"2024-09-11T00:23:50.870722+0000","last_undegraded":"2024-09-11T00:23:50.870722+0000","last_fullsized":"2024-09-11T00:23:50.870722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:08:27.071042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870678+0000","last_change":"2024-09-11T00:23:48.924320+0000","last_active":"2024-09-11T00:23:50.870678+0000","last_peered":"2024-09-11T00:23:50.870678+0000","last_clean":"2024-09-11T00:23:50.870678+0000","last_became_active":"2024-09-11T00:23:48.923963+0000","last_became_peered":"2024-09-11T00:23:48.923963+0000","last_unstale":"2024-09-11T00:23:50.870678+0000","last_undegraded":"2024-09-11T00:23:50.870678+0000","last_fullsized":"2024-09-11T00:23:50.870678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:57.017486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936400+0000","last_change":"2024-09-11T00:23:48.926315+0000","last_active":"2024-09-11T00:23:49.936400+0000","last_peered":"2024-09-11T00:23:49.936400+0000","last_clean":"2024-09-11T00:23:49.936400+0000","last_became_active":"2024-09-11T00:23:48.926023+0000","last_became_peered":"2024-09-11T00:23:48.926023+0000","last_unstale":"2024-09-11T00:23:49.936400+0000","last_undegraded":"2024-09-11T00:23:49.936400+0000","last_fullsized":"2024-09-11T00:23:49.936400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:53:00.946208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869742+0000","last_change":"2024-09-11T00:23:48.940397+0000","last_active":"2024-09-11T00:23:50.869742+0000","last_peered":"2024-09-11T00:23:50.869742+0000","last_clean":"2024-09-11T00:23:50.869742+0000","last_became_active":"2024-09-11T00:23:48.940131+0000","last_became_peered":"2024-09-11T00:23:48.940131+0000","last_unstale":"2024-09-11T00:23:50.869742+0000","last_undegraded":"2024-09-11T00:23:50.869742+0000","last_fullsized":"2024-09-11T00:23:50.869742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:08:27.071042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526136+0000","last_change":"2024-09-11T00:23:48.934059+0000","last_active":"2024-09-11T00:23:50.526136+0000","last_peered":"2024-09-11T00:23:50.526136+0000","last_clean":"2024-09-11T00:23:50.526136+0000","last_became_active":"2024-09-11T00:23:48.931545+0000","last_became_peered":"2024-09-11T00:23:48.931545+0000","last_unstale":"2024-09-11T00:23:50.526136+0000","last_undegraded":"2024-09-11T00:23:50.526136+0000","last_fullsized":"2024-09-11T00:23:50.526136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:22.406899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933205+0000","last_change":"2024-09-11T00:23:48.917392+0000","last_active":"2024-09-11T00:23:49.933205+0000","last_peered":"2024-09-11T00:23:49.933205+0000","last_clean":"2024-09-11T00:23:49.933205+0000","last_became_active":"2024-09-11T00:23:48.917076+0000","last_became_peered":"2024-09-11T00:23:48.917076+0000","last_unstale":"2024-09-11T00:23:49.933205+0000","last_undegraded":"2024-09-11T00:23:49.933205+0000","last_fullsized":"2024-09-11T00:23:49.933205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:33.143595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934240+0000","last_change":"2024-09-11T00:23:48.926949+0000","last_active":"2024-09-11T00:23:49.934240+0000","last_peered":"2024-09-11T00:23:49.934240+0000","last_clean":"2024-09-11T00:23:49.934240+0000","last_became_active":"2024-09-11T00:23:48.926624+0000","last_became_peered":"2024-09-11T00:23:48.926624+0000","last_unstale":"2024-09-11T00:23:49.934240+0000","last_undegraded":"2024-09-11T00:23:49.934240+0000","last_fullsized":"2024-09-11T00:23:49.934240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:40.283499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.937130+0000","last_change":"2024-09-11T00:23:48.927831+0000","last_active":"2024-09-11T00:23:49.937130+0000","last_peered":"2024-09-11T00:23:49.937130+0000","last_clean":"2024-09-11T00:23:49.937130+0000","last_became_active":"2024-09-11T00:23:48.927396+0000","last_became_peered":"2024-09-11T00:23:48.927396+0000","last_unstale":"2024-09-11T00:23:49.937130+0000","last_undegraded":"2024-09-11T00:23:49.937130+0000","last_fullsized":"2024-09-11T00:23:49.937130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:43.076990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713863+0000","last_change":"2024-09-11T00:23:48.925368+0000","last_active":"2024-09-11T00:23:50.713863+0000","last_peered":"2024-09-11T00:23:50.713863+0000","last_clean":"2024-09-11T00:23:50.713863+0000","last_became_active":"2024-09-11T00:23:48.925051+0000","last_became_peered":"2024-09-11T00:23:48.925051+0000","last_unstale":"2024-09-11T00:23:50.713863+0000","last_undegraded":"2024-09-11T00:23:50.713863+0000","last_fullsized":"2024-09-11T00:23:50.713863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:03.081754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871196+0000","last_change":"2024-09-11T00:23:48.945468+0000","last_active":"2024-09-11T00:23:50.871196+0000","last_peered":"2024-09-11T00:23:50.871196+0000","last_clean":"2024-09-11T00:23:50.871196+0000","last_became_active":"2024-09-11T00:23:48.944945+0000","last_became_peered":"2024-09-11T00:23:48.944945+0000","last_unstale":"2024-09-11T00:23:50.871196+0000","last_undegraded":"2024-09-11T00:23:50.871196+0000","last_fullsized":"2024-09-11T00:23:50.871196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:06.656916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870452+0000","last_change":"2024-09-11T00:23:48.921544+0000","last_active":"2024-09-11T00:23:50.870452+0000","last_peered":"2024-09-11T00:23:50.870452+0000","last_clean":"2024-09-11T00:23:50.870452+0000","last_became_active":"2024-09-11T00:23:48.921253+0000","last_became_peered":"2024-09-11T00:23:48.921253+0000","last_unstale":"2024-09-11T00:23:50.870452+0000","last_undegraded":"2024-09-11T00:23:50.870452+0000","last_fullsized":"2024-09-11T00:23:50.870452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:10.533107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526203+0000","last_change":"2024-09-11T00:23:48.942961+0000","last_active":"2024-09-11T00:23:50.526203+0000","last_peered":"2024-09-11T00:23:50.526203+0000","last_clean":"2024-09-11T00:23:50.526203+0000","last_became_active":"2024-09-11T00:23:48.941533+0000","last_became_peered":"2024-09-11T00:23:48.941533+0000","last_unstale":"2024-09-11T00:23:50.526203+0000","last_undegraded":"2024-09-11T00:23:50.526203+0000","last_fullsized":"2024-09-11T00:23:50.526203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:52.956083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935633+0000","last_change":"2024-09-11T00:23:48.935142+0000","last_active":"2024-09-11T00:23:49.935633+0000","last_peered":"2024-09-11T00:23:49.935633+0000","last_clean":"2024-09-11T00:23:49.935633+0000","last_became_active":"2024-09-11T00:23:48.933148+0000","last_became_peered":"2024-09-11T00:23:48.933148+0000","last_unstale":"2024-09-11T00:23:49.935633+0000","last_undegraded":"2024-09-11T00:23:49.935633+0000","last_fullsized":"2024-09-11T00:23:49.935633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:18:47.960332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869723+0000","last_change":"2024-09-11T00:23:48.929778+0000","last_active":"2024-09-11T00:23:50.869723+0000","last_peered":"2024-09-11T00:23:50.869723+0000","last_clean":"2024-09-11T00:23:50.869723+0000","last_became_active":"2024-09-11T00:23:48.928138+0000","last_became_peered":"2024-09-11T00:23:48.928138+0000","last_unstale":"2024-09-11T00:23:50.869723+0000","last_undegraded":"2024-09-11T00:23:50.869723+0000","last_fullsized":"2024-09-11T00:23:50.869723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:23.709720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934308+0000","last_change":"2024-09-11T00:23:48.947725+0000","last_active":"2024-09-11T00:23:49.934308+0000","last_peered":"2024-09-11T00:23:49.934308+0000","last_clean":"2024-09-11T00:23:49.934308+0000","last_became_active":"2024-09-11T00:23:48.947361+0000","last_became_peered":"2024-09-11T00:23:48.947361+0000","last_unstale":"2024-09-11T00:23:49.934308+0000","last_undegraded":"2024-09-11T00:23:49.934308+0000","last_fullsized":"2024-09-11T00:23:49.934308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:31.087205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870205+0000","last_change":"2024-09-11T00:23:48.944855+0000","last_active":"2024-09-11T00:23:50.870205+0000","last_peered":"2024-09-11T00:23:50.870205+0000","last_clean":"2024-09-11T00:23:50.870205+0000","last_became_active":"2024-09-11T00:23:48.944551+0000","last_became_peered":"2024-09-11T00:23:48.944551+0000","last_unstale":"2024-09-11T00:23:50.870205+0000","last_undegraded":"2024-09-11T00:23:50.870205+0000","last_fullsized":"2024-09-11T00:23:50.870205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:53.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870796+0000","last_change":"2024-09-11T00:23:48.937626+0000","last_active":"2024-09-11T00:23:50.870796+0000","last_peered":"2024-09-11T00:23:50.870796+0000","last_clean":"2024-09-11T00:23:50.870796+0000","last_became_active":"2024-09-11T00:23:48.937263+0000","last_became_peered":"2024-09-11T00:23:48.937263+0000","last_unstale":"2024-09-11T00:23:50.870796+0000","last_undegraded":"2024-09-11T00:23:50.870796+0000","last_fullsized":"2024-09-11T00:23:50.870796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:50.142533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933798+0000","last_change":"2024-09-11T00:23:48.928952+0000","last_active":"2024-09-11T00:23:49.933798+0000","last_peered":"2024-09-11T00:23:49.933798+0000","last_clean":"2024-09-11T00:23:49.933798+0000","last_became_active":"2024-09-11T00:23:48.928683+0000","last_became_peered":"2024-09-11T00:23:48.928683+0000","last_unstale":"2024-09-11T00:23:49.933798+0000","last_undegraded":"2024-09-11T00:23:49.933798+0000","last_fullsized":"2024-09-11T00:23:49.933798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:50.142533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870161+0000","last_change":"2024-09-11T00:23:48.929575+0000","last_active":"2024-09-11T00:23:50.870161+0000","last_peered":"2024-09-11T00:23:50.870161+0000","last_clean":"2024-09-11T00:23:50.870161+0000","last_became_active":"2024-09-11T00:23:48.928625+0000","last_became_peered":"2024-09-11T00:23:48.928625+0000","last_unstale":"2024-09-11T00:23:50.870161+0000","last_undegraded":"2024-09-11T00:23:50.870161+0000","last_fullsized":"2024-09-11T00:23:50.870161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:13.522317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526474+0000","last_change":"2024-09-11T00:23:48.947976+0000","last_active":"2024-09-11T00:23:50.526474+0000","last_peered":"2024-09-11T00:23:50.526474+0000","last_clean":"2024-09-11T00:23:50.526474+0000","last_became_active":"2024-09-11T00:23:48.947725+0000","last_became_peered":"2024-09-11T00:23:48.947725+0000","last_unstale":"2024-09-11T00:23:50.526474+0000","last_undegraded":"2024-09-11T00:23:50.526474+0000","last_fullsized":"2024-09-11T00:23:50.526474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:09:52.162272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935202+0000","last_change":"2024-09-11T00:23:48.930538+0000","last_active":"2024-09-11T00:23:49.935202+0000","last_peered":"2024-09-11T00:23:49.935202+0000","last_clean":"2024-09-11T00:23:49.935202+0000","last_became_active":"2024-09-11T00:23:48.930224+0000","last_became_peered":"2024-09-11T00:23:48.930224+0000","last_unstale":"2024-09-11T00:23:49.935202+0000","last_undegraded":"2024-09-11T00:23:49.935202+0000","last_fullsized":"2024-09-11T00:23:49.935202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:18.427715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713776+0000","last_change":"2024-09-11T00:23:48.927566+0000","last_active":"2024-09-11T00:23:50.713776+0000","last_peered":"2024-09-11T00:23:50.713776+0000","last_clean":"2024-09-11T00:23:50.713776+0000","last_became_active":"2024-09-11T00:23:48.927306+0000","last_became_peered":"2024-09-11T00:23:48.927306+0000","last_unstale":"2024-09-11T00:23:50.713776+0000","last_undegraded":"2024-09-11T00:23:50.713776+0000","last_fullsized":"2024-09-11T00:23:50.713776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:35.800616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870322+0000","last_change":"2024-09-11T00:23:48.926632+0000","last_active":"2024-09-11T00:23:50.870322+0000","last_peered":"2024-09-11T00:23:50.870322+0000","last_clean":"2024-09-11T00:23:50.870322+0000","last_became_active":"2024-09-11T00:23:48.926014+0000","last_became_peered":"2024-09-11T00:23:48.926014+0000","last_unstale":"2024-09-11T00:23:50.870322+0000","last_undegraded":"2024-09-11T00:23:50.870322+0000","last_fullsized":"2024-09-11T00:23:50.870322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:49.141326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936248+0000","last_change":"2024-09-11T00:23:48.925940+0000","last_active":"2024-09-11T00:23:49.936248+0000","last_peered":"2024-09-11T00:23:49.936248+0000","last_clean":"2024-09-11T00:23:49.936248+0000","last_became_active":"2024-09-11T00:23:48.925589+0000","last_became_peered":"2024-09-11T00:23:48.925589+0000","last_unstale":"2024-09-11T00:23:49.936248+0000","last_undegraded":"2024-09-11T00:23:49.936248+0000","last_fullsized":"2024-09-11T00:23:49.936248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:41.419916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869814+0000","last_change":"2024-09-11T00:23:47.934229+0000","last_active":"2024-09-11T00:23:50.869814+0000","last_peered":"2024-09-11T00:23:50.869814+0000","last_clean":"2024-09-11T00:23:50.869814+0000","last_became_active":"2024-09-11T00:23:47.933880+0000","last_became_peered":"2024-09-11T00:23:47.933880+0000","last_unstale":"2024-09-11T00:23:50.869814+0000","last_undegraded":"2024-09-11T00:23:50.869814+0000","last_fullsized":"2024-09-11T00:23:50.869814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:30.892853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526491+0000","last_change":"2024-09-11T00:23:48.934481+0000","last_active":"2024-09-11T00:23:50.526491+0000","last_peered":"2024-09-11T00:23:50.526491+0000","last_clean":"2024-09-11T00:23:50.526491+0000","last_became_active":"2024-09-11T00:23:48.931082+0000","last_became_peered":"2024-09-11T00:23:48.931082+0000","last_unstale":"2024-09-11T00:23:50.526491+0000","last_undegraded":"2024-09-11T00:23:50.526491+0000","last_fullsized":"2024-09-11T00:23:50.526491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:04.133148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870136+0000","last_change":"2024-09-11T00:23:47.933078+0000","last_active":"2024-09-11T00:23:50.870136+0000","last_peered":"2024-09-11T00:23:50.870136+0000","last_clean":"2024-09-11T00:23:50.870136+0000","last_became_active":"2024-09-11T00:23:47.932815+0000","last_became_peered":"2024-09-11T00:23:47.932815+0000","last_unstale":"2024-09-11T00:23:50.870136+0000","last_undegraded":"2024-09-11T00:23:50.870136+0000","last_fullsized":"2024-09-11T00:23:50.870136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:00.103061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869652+0000","last_change":"2024-09-11T00:23:47.927116+0000","last_active":"2024-09-11T00:23:50.869652+0000","last_peered":"2024-09-11T00:23:50.869652+0000","last_clean":"2024-09-11T00:23:50.869652+0000","last_became_active":"2024-09-11T00:23:47.926760+0000","last_became_peered":"2024-09-11T00:23:47.926760+0000","last_unstale":"2024-09-11T00:23:50.869652+0000","last_undegraded":"2024-09-11T00:23:50.869652+0000","last_fullsized":"2024-09-11T00:23:50.869652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:14:45.347474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869585+0000","last_change":"2024-09-11T00:23:48.947208+0000","last_active":"2024-09-11T00:23:50.869585+0000","last_peered":"2024-09-11T00:23:50.869585+0000","last_clean":"2024-09-11T00:23:50.869585+0000","last_became_active":"2024-09-11T00:23:48.946963+0000","last_became_peered":"2024-09-11T00:23:48.946963+0000","last_unstale":"2024-09-11T00:23:50.869585+0000","last_undegraded":"2024-09-11T00:23:50.869585+0000","last_fullsized":"2024-09-11T00:23:50.869585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:10.533107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934435+0000","last_change":"2024-09-11T00:23:47.924168+0000","last_active":"2024-09-11T00:23:49.934435+0000","last_peered":"2024-09-11T00:23:49.934435+0000","last_clean":"2024-09-11T00:23:49.934435+0000","last_became_active":"2024-09-11T00:23:47.923810+0000","last_became_peered":"2024-09-11T00:23:47.923810+0000","last_unstale":"2024-09-11T00:23:49.934435+0000","last_undegraded":"2024-09-11T00:23:49.934435+0000","last_fullsized":"2024-09-11T00:23:49.934435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:09.057962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933208+0000","last_change":"2024-09-11T00:23:48.932214+0000","last_active":"2024-09-11T00:23:49.933208+0000","last_peered":"2024-09-11T00:23:49.933208+0000","last_clean":"2024-09-11T00:23:49.933208+0000","last_became_active":"2024-09-11T00:23:48.931946+0000","last_became_peered":"2024-09-11T00:23:48.931946+0000","last_unstale":"2024-09-11T00:23:49.933208+0000","last_undegraded":"2024-09-11T00:23:49.933208+0000","last_fullsized":"2024-09-11T00:23:49.933208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:10.533107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871004+0000","last_change":"2024-09-11T00:23:47.929315+0000","last_active":"2024-09-11T00:23:50.871004+0000","last_peered":"2024-09-11T00:23:50.871004+0000","last_clean":"2024-09-11T00:23:50.871004+0000","last_became_active":"2024-09-11T00:23:47.928873+0000","last_became_peered":"2024-09-11T00:23:47.928873+0000","last_unstale":"2024-09-11T00:23:50.871004+0000","last_undegraded":"2024-09-11T00:23:50.871004+0000","last_fullsized":"2024-09-11T00:23:50.871004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:27.835276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935414+0000","last_change":"2024-09-11T00:23:48.933958+0000","last_active":"2024-09-11T00:23:49.935414+0000","last_peered":"2024-09-11T00:23:49.935414+0000","last_clean":"2024-09-11T00:23:49.935414+0000","last_became_active":"2024-09-11T00:23:48.933311+0000","last_became_peered":"2024-09-11T00:23:48.933311+0000","last_unstale":"2024-09-11T00:23:49.935414+0000","last_undegraded":"2024-09-11T00:23:49.935414+0000","last_fullsized":"2024-09-11T00:23:49.935414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:48.420430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936215+0000","last_change":"2024-09-11T00:23:47.936415+0000","last_active":"2024-09-11T00:23:49.936215+0000","last_peered":"2024-09-11T00:23:49.936215+0000","last_clean":"2024-09-11T00:23:49.936215+0000","last_became_active":"2024-09-11T00:23:47.935508+0000","last_became_peered":"2024-09-11T00:23:47.935508+0000","last_unstale":"2024-09-11T00:23:49.936215+0000","last_undegraded":"2024-09-11T00:23:49.936215+0000","last_fullsized":"2024-09-11T00:23:49.936215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:14:04.971648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526665+0000","last_change":"2024-09-11T00:23:48.925280+0000","last_active":"2024-09-11T00:23:50.526665+0000","last_peered":"2024-09-11T00:23:50.526665+0000","last_clean":"2024-09-11T00:23:50.526665+0000","last_became_active":"2024-09-11T00:23:48.923558+0000","last_became_peered":"2024-09-11T00:23:48.923558+0000","last_unstale":"2024-09-11T00:23:50.526665+0000","last_undegraded":"2024-09-11T00:23:50.526665+0000","last_fullsized":"2024-09-11T00:23:50.526665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:51.437783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933648+0000","last_change":"2024-09-11T00:23:47.917495+0000","last_active":"2024-09-11T00:23:49.933648+0000","last_peered":"2024-09-11T00:23:49.933648+0000","last_clean":"2024-09-11T00:23:49.933648+0000","last_became_active":"2024-09-11T00:23:47.917190+0000","last_became_peered":"2024-09-11T00:23:47.917190+0000","last_unstale":"2024-09-11T00:23:49.933648+0000","last_undegraded":"2024-09-11T00:23:49.933648+0000","last_fullsized":"2024-09-11T00:23:49.933648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:40.413211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936314+0000","last_change":"2024-09-11T00:23:48.931464+0000","last_active":"2024-09-11T00:23:49.936314+0000","last_peered":"2024-09-11T00:23:49.936314+0000","last_clean":"2024-09-11T00:23:49.936314+0000","last_became_active":"2024-09-11T00:23:48.929780+0000","last_became_peered":"2024-09-11T00:23:48.929780+0000","last_unstale":"2024-09-11T00:23:49.936314+0000","last_undegraded":"2024-09-11T00:23:49.936314+0000","last_fullsized":"2024-09-11T00:23:49.936314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:06.878857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870468+0000","last_change":"2024-09-11T00:23:47.929964+0000","last_active":"2024-09-11T00:23:50.870468+0000","last_peered":"2024-09-11T00:23:50.870468+0000","last_clean":"2024-09-11T00:23:50.870468+0000","last_became_active":"2024-09-11T00:23:47.929635+0000","last_became_peered":"2024-09-11T00:23:47.929635+0000","last_unstale":"2024-09-11T00:23:50.870468+0000","last_undegraded":"2024-09-11T00:23:50.870468+0000","last_fullsized":"2024-09-11T00:23:50.870468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:05.769710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870963+0000","last_change":"2024-09-11T00:23:48.946941+0000","last_active":"2024-09-11T00:23:50.870963+0000","last_peered":"2024-09-11T00:23:50.870963+0000","last_clean":"2024-09-11T00:23:50.870963+0000","last_became_active":"2024-09-11T00:23:48.946690+0000","last_became_peered":"2024-09-11T00:23:48.946690+0000","last_unstale":"2024-09-11T00:23:50.870963+0000","last_undegraded":"2024-09-11T00:23:50.870963+0000","last_fullsized":"2024-09-11T00:23:50.870963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:18.427715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526613+0000","last_change":"2024-09-11T00:23:47.931967+0000","last_active":"2024-09-11T00:23:50.526613+0000","last_peered":"2024-09-11T00:23:50.526613+0000","last_clean":"2024-09-11T00:23:50.526613+0000","last_became_active":"2024-09-11T00:23:47.929613+0000","last_became_peered":"2024-09-11T00:23:47.929613+0000","last_unstale":"2024-09-11T00:23:50.526613+0000","last_undegraded":"2024-09-11T00:23:50.526613+0000","last_fullsized":"2024-09-11T00:23:50.526613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:07.537335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526168+0000","last_change":"2024-09-11T00:23:48.942082+0000","last_active":"2024-09-11T00:23:50.526168+0000","last_peered":"2024-09-11T00:23:50.526168+0000","last_clean":"2024-09-11T00:23:50.526168+0000","last_became_active":"2024-09-11T00:23:48.941719+0000","last_became_peered":"2024-09-11T00:23:48.941719+0000","last_unstale":"2024-09-11T00:23:50.526168+0000","last_undegraded":"2024-09-11T00:23:50.526168+0000","last_fullsized":"2024-09-11T00:23:50.526168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:12.862149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935272+0000","last_change":"2024-09-11T00:23:47.923106+0000","last_active":"2024-09-11T00:23:49.935272+0000","last_peered":"2024-09-11T00:23:49.935272+0000","last_clean":"2024-09-11T00:23:49.935272+0000","last_became_active":"2024-09-11T00:23:47.922184+0000","last_became_peered":"2024-09-11T00:23:47.922184+0000","last_unstale":"2024-09-11T00:23:49.935272+0000","last_undegraded":"2024-09-11T00:23:49.935272+0000","last_fullsized":"2024-09-11T00:23:49.935272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:25.625230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871459+0000","last_change":"2024-09-11T00:23:48.944533+0000","last_active":"2024-09-11T00:23:50.871459+0000","last_peered":"2024-09-11T00:23:50.871459+0000","last_clean":"2024-09-11T00:23:50.871459+0000","last_became_active":"2024-09-11T00:23:48.943682+0000","last_became_peered":"2024-09-11T00:23:48.943682+0000","last_unstale":"2024-09-11T00:23:50.871459+0000","last_undegraded":"2024-09-11T00:23:50.871459+0000","last_fullsized":"2024-09-11T00:23:50.871459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:30.501339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870124+0000","last_change":"2024-09-11T00:23:47.927380+0000","last_active":"2024-09-11T00:23:50.870124+0000","last_peered":"2024-09-11T00:23:50.870124+0000","last_clean":"2024-09-11T00:23:50.870124+0000","last_became_active":"2024-09-11T00:23:47.926325+0000","last_became_peered":"2024-09-11T00:23:47.926325+0000","last_unstale":"2024-09-11T00:23:50.870124+0000","last_undegraded":"2024-09-11T00:23:50.870124+0000","last_fullsized":"2024-09-11T00:23:50.870124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:17.848252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871625+0000","last_change":"2024-09-11T00:23:48.926985+0000","last_active":"2024-09-11T00:23:50.871625+0000","last_peered":"2024-09-11T00:23:50.871625+0000","last_clean":"2024-09-11T00:23:50.871625+0000","last_became_active":"2024-09-11T00:23:48.926337+0000","last_became_peered":"2024-09-11T00:23:48.926337+0000","last_unstale":"2024-09-11T00:23:50.871625+0000","last_undegraded":"2024-09-11T00:23:50.871625+0000","last_fullsized":"2024-09-11T00:23:50.871625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:32.096363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713565+0000","last_change":"2024-09-11T00:23:47.923036+0000","last_active":"2024-09-11T00:23:50.713565+0000","last_peered":"2024-09-11T00:23:50.713565+0000","last_clean":"2024-09-11T00:23:50.713565+0000","last_became_active":"2024-09-11T00:23:47.921195+0000","last_became_peered":"2024-09-11T00:23:47.921195+0000","last_unstale":"2024-09-11T00:23:50.713565+0000","last_undegraded":"2024-09-11T00:23:50.713565+0000","last_fullsized":"2024-09-11T00:23:50.713565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:14:45.347474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871089+0000","last_change":"2024-09-11T00:23:48.943396+0000","last_active":"2024-09-11T00:23:50.871089+0000","last_peered":"2024-09-11T00:23:50.871089+0000","last_clean":"2024-09-11T00:23:50.871089+0000","last_became_active":"2024-09-11T00:23:48.943075+0000","last_became_peered":"2024-09-11T00:23:48.943075+0000","last_unstale":"2024-09-11T00:23:50.871089+0000","last_undegraded":"2024-09-11T00:23:50.871089+0000","last_fullsized":"2024-09-11T00:23:50.871089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:52.627600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936327+0000","last_change":"2024-09-11T00:23:47.927064+0000","last_active":"2024-09-11T00:23:49.936327+0000","last_peered":"2024-09-11T00:23:49.936327+0000","last_clean":"2024-09-11T00:23:49.936327+0000","last_became_active":"2024-09-11T00:23:47.926712+0000","last_became_peered":"2024-09-11T00:23:47.926712+0000","last_unstale":"2024-09-11T00:23:49.936327+0000","last_undegraded":"2024-09-11T00:23:49.936327+0000","last_fullsized":"2024-09-11T00:23:49.936327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:04.442035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871836+0000","last_change":"2024-09-11T00:23:48.944697+0000","last_active":"2024-09-11T00:23:50.871836+0000","last_peered":"2024-09-11T00:23:50.871836+0000","last_clean":"2024-09-11T00:23:50.871836+0000","last_became_active":"2024-09-11T00:23:48.944401+0000","last_became_peered":"2024-09-11T00:23:48.944401+0000","last_unstale":"2024-09-11T00:23:50.871836+0000","last_undegraded":"2024-09-11T00:23:50.871836+0000","last_fullsized":"2024-09-11T00:23:50.871836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:37.819167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713804+0000","last_change":"2024-09-11T00:23:47.925285+0000","last_active":"2024-09-11T00:23:50.713804+0000","last_peered":"2024-09-11T00:23:50.713804+0000","last_clean":"2024-09-11T00:23:50.713804+0000","last_became_active":"2024-09-11T00:23:47.923814+0000","last_became_peered":"2024-09-11T00:23:47.923814+0000","last_unstale":"2024-09-11T00:23:50.713804+0000","last_undegraded":"2024-09-11T00:23:50.713804+0000","last_fullsized":"2024-09-11T00:23:50.713804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:05.769710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.872231+0000","last_change":"2024-09-11T00:23:48.943572+0000","last_active":"2024-09-11T00:23:50.872231+0000","last_peered":"2024-09-11T00:23:50.872231+0000","last_clean":"2024-09-11T00:23:50.872231+0000","last_became_active":"2024-09-11T00:23:48.943332+0000","last_became_peered":"2024-09-11T00:23:48.943332+0000","last_unstale":"2024-09-11T00:23:50.872231+0000","last_undegraded":"2024-09-11T00:23:50.872231+0000","last_fullsized":"2024-09-11T00:23:50.872231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:27.017230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933857+0000","last_change":"2024-09-11T00:23:47.916785+0000","last_active":"2024-09-11T00:23:49.933857+0000","last_peered":"2024-09-11T00:23:49.933857+0000","last_clean":"2024-09-11T00:23:49.933857+0000","last_became_active":"2024-09-11T00:23:47.916497+0000","last_became_peered":"2024-09-11T00:23:47.916497+0000","last_unstale":"2024-09-11T00:23:49.933857+0000","last_undegraded":"2024-09-11T00:23:49.933857+0000","last_fullsized":"2024-09-11T00:23:49.933857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:05.872152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935575+0000","last_change":"2024-09-11T00:23:48.930287+0000","last_active":"2024-09-11T00:23:49.935575+0000","last_peered":"2024-09-11T00:23:49.935575+0000","last_clean":"2024-09-11T00:23:49.935575+0000","last_became_active":"2024-09-11T00:23:48.929725+0000","last_became_peered":"2024-09-11T00:23:48.929725+0000","last_unstale":"2024-09-11T00:23:49.935575+0000","last_undegraded":"2024-09-11T00:23:49.935575+0000","last_fullsized":"2024-09-11T00:23:49.935575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:27.758680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713703+0000","last_change":"2024-09-11T00:23:47.921536+0000","last_active":"2024-09-11T00:23:50.713703+0000","last_peered":"2024-09-11T00:23:50.713703+0000","last_clean":"2024-09-11T00:23:50.713703+0000","last_became_active":"2024-09-11T00:23:47.921189+0000","last_became_peered":"2024-09-11T00:23:47.921189+0000","last_unstale":"2024-09-11T00:23:50.713703+0000","last_undegraded":"2024-09-11T00:23:50.713703+0000","last_fullsized":"2024-09-11T00:23:50.713703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:00.103061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870954+0000","last_change":"2024-09-11T00:23:48.938303+0000","last_active":"2024-09-11T00:23:50.870954+0000","last_peered":"2024-09-11T00:23:50.870954+0000","last_clean":"2024-09-11T00:23:50.870954+0000","last_became_active":"2024-09-11T00:23:48.938020+0000","last_became_peered":"2024-09-11T00:23:48.938020+0000","last_unstale":"2024-09-11T00:23:50.870954+0000","last_undegraded":"2024-09-11T00:23:50.870954+0000","last_fullsized":"2024-09-11T00:23:50.870954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:27:37.871843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870713+0000","last_change":"2024-09-11T00:23:38.923873+0000","last_active":"2024-09-11T00:23:50.870713+0000","last_peered":"2024-09-11T00:23:50.870713+0000","last_clean":"2024-09-11T00:23:50.870713+0000","last_became_active":"2024-09-11T00:23:38.920629+0000","last_became_peered":"2024-09-11T00:23:38.920629+0000","last_unstale":"2024-09-11T00:23:50.870713+0000","last_undegraded":"2024-09-11T00:23:50.870713+0000","last_fullsized":"2024-09-11T00:23:50.870713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_clean_scrub_stamp":"2024-09-11T00:23:37.844553+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.533941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934753+0000","last_change":"2024-09-11T00:23:47.922903+0000","last_active":"2024-09-11T00:23:49.934753+0000","last_peered":"2024-09-11T00:23:49.934753+0000","last_clean":"2024-09-11T00:23:49.934753+0000","last_became_active":"2024-09-11T00:23:47.921860+0000","last_became_peered":"2024-09-11T00:23:47.921860+0000","last_unstale":"2024-09-11T00:23:49.934753+0000","last_undegraded":"2024-09-11T00:23:49.934753+0000","last_fullsized":"2024-09-11T00:23:49.934753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:36.398079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869697+0000","last_change":"2024-09-11T00:23:48.943469+0000","last_active":"2024-09-11T00:23:50.869697+0000","last_peered":"2024-09-11T00:23:50.869697+0000","last_clean":"2024-09-11T00:23:50.869697+0000","last_became_active":"2024-09-11T00:23:48.939041+0000","last_became_peered":"2024-09-11T00:23:48.939041+0000","last_unstale":"2024-09-11T00:23:50.869697+0000","last_undegraded":"2024-09-11T00:23:50.869697+0000","last_fullsized":"2024-09-11T00:23:50.869697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:57.017486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870591+0000","last_change":"2024-09-11T00:23:47.938200+0000","last_active":"2024-09-11T00:23:50.870591+0000","last_peered":"2024-09-11T00:23:50.870591+0000","last_clean":"2024-09-11T00:23:50.870591+0000","last_became_active":"2024-09-11T00:23:47.937671+0000","last_became_peered":"2024-09-11T00:23:47.937671+0000","last_unstale":"2024-09-11T00:23:50.870591+0000","last_undegraded":"2024-09-11T00:23:50.870591+0000","last_fullsized":"2024-09-11T00:23:50.870591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:21.182195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526116+0000","last_change":"2024-09-11T00:23:48.933693+0000","last_active":"2024-09-11T00:23:50.526116+0000","last_peered":"2024-09-11T00:23:50.526116+0000","last_clean":"2024-09-11T00:23:50.526116+0000","last_became_active":"2024-09-11T00:23:48.933355+0000","last_became_peered":"2024-09-11T00:23:48.933355+0000","last_unstale":"2024-09-11T00:23:50.526116+0000","last_undegraded":"2024-09-11T00:23:50.526116+0000","last_fullsized":"2024-09-11T00:23:50.526116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:26.797108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713671+0000","last_change":"2024-09-11T00:23:47.929198+0000","last_active":"2024-09-11T00:23:50.713671+0000","last_peered":"2024-09-11T00:23:50.713671+0000","last_clean":"2024-09-11T00:23:50.713671+0000","last_became_active":"2024-09-11T00:23:47.928882+0000","last_became_peered":"2024-09-11T00:23:47.928882+0000","last_unstale":"2024-09-11T00:23:50.713671+0000","last_undegraded":"2024-09-11T00:23:50.713671+0000","last_fullsized":"2024-09-11T00:23:50.713671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:17.848252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933279+0000","last_change":"2024-09-11T00:23:48.932829+0000","last_active":"2024-09-11T00:23:49.933279+0000","last_peered":"2024-09-11T00:23:49.933279+0000","last_clean":"2024-09-11T00:23:49.933279+0000","last_became_active":"2024-09-11T00:23:48.932546+0000","last_became_peered":"2024-09-11T00:23:48.932546+0000","last_unstale":"2024-09-11T00:23:49.933279+0000","last_undegraded":"2024-09-11T00:23:49.933279+0000","last_fullsized":"2024-09-11T00:23:49.933279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:23.709720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935373+0000","last_change":"2024-09-11T00:23:47.917787+0000","last_active":"2024-09-11T00:23:49.935373+0000","last_peered":"2024-09-11T00:23:49.935373+0000","last_clean":"2024-09-11T00:23:49.935373+0000","last_became_active":"2024-09-11T00:23:47.916390+0000","last_became_peered":"2024-09-11T00:23:47.916390+0000","last_unstale":"2024-09-11T00:23:49.935373+0000","last_undegraded":"2024-09-11T00:23:49.935373+0000","last_fullsized":"2024-09-11T00:23:49.935373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:21.182195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935541+0000","last_change":"2024-09-11T00:23:48.936767+0000","last_active":"2024-09-11T00:23:49.935541+0000","last_peered":"2024-09-11T00:23:49.935541+0000","last_clean":"2024-09-11T00:23:49.935541+0000","last_became_active":"2024-09-11T00:23:48.936263+0000","last_became_peered":"2024-09-11T00:23:48.936263+0000","last_unstale":"2024-09-11T00:23:49.935541+0000","last_undegraded":"2024-09-11T00:23:49.935541+0000","last_fullsized":"2024-09-11T00:23:49.935541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:28.841981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933635+0000","last_change":"2024-09-11T00:23:47.930283+0000","last_active":"2024-09-11T00:23:49.933635+0000","last_peered":"2024-09-11T00:23:49.933635+0000","last_clean":"2024-09-11T00:23:49.933635+0000","last_became_active":"2024-09-11T00:23:47.930008+0000","last_became_peered":"2024-09-11T00:23:47.930008+0000","last_unstale":"2024-09-11T00:23:49.933635+0000","last_undegraded":"2024-09-11T00:23:49.933635+0000","last_fullsized":"2024-09-11T00:23:49.933635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:27.835276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935676+0000","last_change":"2024-09-11T00:23:48.929269+0000","last_active":"2024-09-11T00:23:49.935676+0000","last_peered":"2024-09-11T00:23:49.935676+0000","last_clean":"2024-09-11T00:23:49.935676+0000","last_became_active":"2024-09-11T00:23:48.928947+0000","last_became_peered":"2024-09-11T00:23:48.928947+0000","last_unstale":"2024-09-11T00:23:49.935676+0000","last_undegraded":"2024-09-11T00:23:49.935676+0000","last_fullsized":"2024-09-11T00:23:49.935676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:31.745356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871434+0000","last_change":"2024-09-11T00:23:47.940851+0000","last_active":"2024-09-11T00:23:50.871434+0000","last_peered":"2024-09-11T00:23:50.871434+0000","last_clean":"2024-09-11T00:23:50.871434+0000","last_became_active":"2024-09-11T00:23:47.940667+0000","last_became_peered":"2024-09-11T00:23:47.940667+0000","last_unstale":"2024-09-11T00:23:50.871434+0000","last_undegraded":"2024-09-11T00:23:50.871434+0000","last_fullsized":"2024-09-11T00:23:50.871434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:06.334712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933539+0000","last_change":"2024-09-11T00:23:48.928214+0000","last_active":"2024-09-11T00:23:49.933539+0000","last_peered":"2024-09-11T00:23:49.933539+0000","last_clean":"2024-09-11T00:23:49.933539+0000","last_became_active":"2024-09-11T00:23:48.927947+0000","last_became_peered":"2024-09-11T00:23:48.927947+0000","last_unstale":"2024-09-11T00:23:49.933539+0000","last_undegraded":"2024-09-11T00:23:49.933539+0000","last_fullsized":"2024-09-11T00:23:49.933539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:08:27.071042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934052+0000","last_change":"2024-09-11T00:23:47.935782+0000","last_active":"2024-09-11T00:23:49.934052+0000","last_peered":"2024-09-11T00:23:49.934052+0000","last_clean":"2024-09-11T00:23:49.934052+0000","last_became_active":"2024-09-11T00:23:47.935518+0000","last_became_peered":"2024-09-11T00:23:47.935518+0000","last_unstale":"2024-09-11T00:23:49.934052+0000","last_undegraded":"2024-09-11T00:23:49.934052+0000","last_fullsized":"2024-09-11T00:23:49.934052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:59.939503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870137+0000","last_change":"2024-09-11T00:23:48.942240+0000","last_active":"2024-09-11T00:23:50.870137+0000","last_peered":"2024-09-11T00:23:50.870137+0000","last_clean":"2024-09-11T00:23:50.870137+0000","last_became_active":"2024-09-11T00:23:48.941950+0000","last_became_peered":"2024-09-11T00:23:48.941950+0000","last_unstale":"2024-09-11T00:23:50.870137+0000","last_undegraded":"2024-09-11T00:23:50.870137+0000","last_fullsized":"2024-09-11T00:23:50.870137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:05.378796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871100+0000","last_change":"2024-09-11T00:23:47.940231+0000","last_active":"2024-09-11T00:23:50.871100+0000","last_peered":"2024-09-11T00:23:50.871100+0000","last_clean":"2024-09-11T00:23:50.871100+0000","last_became_active":"2024-09-11T00:23:47.939887+0000","last_became_peered":"2024-09-11T00:23:47.939887+0000","last_unstale":"2024-09-11T00:23:50.871100+0000","last_undegraded":"2024-09-11T00:23:50.871100+0000","last_fullsized":"2024-09-11T00:23:50.871100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:40.413211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526432+0000","last_change":"2024-09-11T00:23:48.948747+0000","last_active":"2024-09-11T00:23:50.526432+0000","last_peered":"2024-09-11T00:23:50.526432+0000","last_clean":"2024-09-11T00:23:50.526432+0000","last_became_active":"2024-09-11T00:23:48.948439+0000","last_became_peered":"2024-09-11T00:23:48.948439+0000","last_unstale":"2024-09-11T00:23:50.526432+0000","last_undegraded":"2024-09-11T00:23:50.526432+0000","last_fullsized":"2024-09-11T00:23:50.526432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:59.951812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870404+0000","last_change":"2024-09-11T00:23:47.938518+0000","last_active":"2024-09-11T00:23:50.870404+0000","last_peered":"2024-09-11T00:23:50.870404+0000","last_clean":"2024-09-11T00:23:50.870404+0000","last_became_active":"2024-09-11T00:23:47.937928+0000","last_became_peered":"2024-09-11T00:23:47.937928+0000","last_unstale":"2024-09-11T00:23:50.870404+0000","last_undegraded":"2024-09-11T00:23:50.870404+0000","last_fullsized":"2024-09-11T00:23:50.870404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:25.625230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934570+0000","last_change":"2024-09-11T00:23:48.929011+0000","last_active":"2024-09-11T00:23:49.934570+0000","last_peered":"2024-09-11T00:23:49.934570+0000","last_clean":"2024-09-11T00:23:49.934570+0000","last_became_active":"2024-09-11T00:23:48.927838+0000","last_became_peered":"2024-09-11T00:23:48.927838+0000","last_unstale":"2024-09-11T00:23:49.934570+0000","last_undegraded":"2024-09-11T00:23:49.934570+0000","last_fullsized":"2024-09-11T00:23:49.934570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:01.109766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933263+0000","last_change":"2024-09-11T00:23:47.930702+0000","last_active":"2024-09-11T00:23:49.933263+0000","last_peered":"2024-09-11T00:23:49.933263+0000","last_clean":"2024-09-11T00:23:49.933263+0000","last_became_active":"2024-09-11T00:23:47.930044+0000","last_became_peered":"2024-09-11T00:23:47.930044+0000","last_unstale":"2024-09-11T00:23:49.933263+0000","last_undegraded":"2024-09-11T00:23:49.933263+0000","last_fullsized":"2024-09-11T00:23:49.933263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:05.769710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869927+0000","last_change":"2024-09-11T00:23:48.932964+0000","last_active":"2024-09-11T00:23:50.869927+0000","last_peered":"2024-09-11T00:23:50.869927+0000","last_clean":"2024-09-11T00:23:50.869927+0000","last_became_active":"2024-09-11T00:23:48.932262+0000","last_became_peered":"2024-09-11T00:23:48.932262+0000","last_unstale":"2024-09-11T00:23:50.869927+0000","last_undegraded":"2024-09-11T00:23:50.869927+0000","last_fullsized":"2024-09-11T00:23:50.869927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:50.142533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933446+0000","last_change":"2024-09-11T00:23:47.924671+0000","last_active":"2024-09-11T00:23:49.933446+0000","last_peered":"2024-09-11T00:23:49.933446+0000","last_clean":"2024-09-11T00:23:49.933446+0000","last_became_active":"2024-09-11T00:23:47.924383+0000","last_became_peered":"2024-09-11T00:23:47.924383+0000","last_unstale":"2024-09-11T00:23:49.933446+0000","last_undegraded":"2024-09-11T00:23:49.933446+0000","last_fullsized":"2024-09-11T00:23:49.933446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:00.103061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869954+0000","last_change":"2024-09-11T00:23:48.949725+0000","last_active":"2024-09-11T00:23:50.869954+0000","last_peered":"2024-09-11T00:23:50.869954+0000","last_clean":"2024-09-11T00:23:50.869954+0000","last_became_active":"2024-09-11T00:23:48.949445+0000","last_became_peered":"2024-09-11T00:23:48.949445+0000","last_unstale":"2024-09-11T00:23:50.869954+0000","last_undegraded":"2024-09-11T00:23:50.869954+0000","last_fullsized":"2024-09-11T00:23:50.869954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:32.096363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871560+0000","last_change":"2024-09-11T00:23:47.940381+0000","last_active":"2024-09-11T00:23:50.871560+0000","last_peered":"2024-09-11T00:23:50.871560+0000","last_clean":"2024-09-11T00:23:50.871560+0000","last_became_active":"2024-09-11T00:23:47.940030+0000","last_became_peered":"2024-09-11T00:23:47.940030+0000","last_unstale":"2024-09-11T00:23:50.871560+0000","last_undegraded":"2024-09-11T00:23:50.871560+0000","last_fullsized":"2024-09-11T00:23:50.871560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:49.214733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870694+0000","last_change":"2024-09-11T00:23:48.934776+0000","last_active":"2024-09-11T00:23:50.870694+0000","last_peered":"2024-09-11T00:23:50.870694+0000","last_clean":"2024-09-11T00:23:50.870694+0000","last_became_active":"2024-09-11T00:23:48.925601+0000","last_became_peered":"2024-09-11T00:23:48.925601+0000","last_unstale":"2024-09-11T00:23:50.870694+0000","last_undegraded":"2024-09-11T00:23:50.870694+0000","last_fullsized":"2024-09-11T00:23:50.870694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:23.709720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935472+0000","last_change":"2024-09-11T00:23:48.921538+0000","last_active":"2024-09-11T00:23:49.935472+0000","last_peered":"2024-09-11T00:23:49.935472+0000","last_clean":"2024-09-11T00:23:49.935472+0000","last_became_active":"2024-09-11T00:23:48.921162+0000","last_became_peered":"2024-09-11T00:23:48.921162+0000","last_unstale":"2024-09-11T00:23:49.935472+0000","last_undegraded":"2024-09-11T00:23:49.935472+0000","last_fullsized":"2024-09-11T00:23:49.935472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:14:08.841886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871337+0000","last_change":"2024-09-11T00:23:47.938661+0000","last_active":"2024-09-11T00:23:50.871337+0000","last_peered":"2024-09-11T00:23:50.871337+0000","last_clean":"2024-09-11T00:23:50.871337+0000","last_became_active":"2024-09-11T00:23:47.937858+0000","last_became_peered":"2024-09-11T00:23:47.937858+0000","last_unstale":"2024-09-11T00:23:50.871337+0000","last_undegraded":"2024-09-11T00:23:50.871337+0000","last_fullsized":"2024-09-11T00:23:50.871337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:34.793911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935205+0000","last_change":"2024-09-11T00:23:48.916507+0000","last_active":"2024-09-11T00:23:49.935205+0000","last_peered":"2024-09-11T00:23:49.935205+0000","last_clean":"2024-09-11T00:23:49.935205+0000","last_became_active":"2024-09-11T00:23:48.916168+0000","last_became_peered":"2024-09-11T00:23:48.916168+0000","last_unstale":"2024-09-11T00:23:49.935205+0000","last_undegraded":"2024-09-11T00:23:49.935205+0000","last_fullsized":"2024-09-11T00:23:49.935205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:53.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871007+0000","last_change":"2024-09-11T00:23:47.941406+0000","last_active":"2024-09-11T00:23:50.871007+0000","last_peered":"2024-09-11T00:23:50.871007+0000","last_clean":"2024-09-11T00:23:50.871007+0000","last_became_active":"2024-09-11T00:23:47.940051+0000","last_became_peered":"2024-09-11T00:23:47.940051+0000","last_unstale":"2024-09-11T00:23:50.871007+0000","last_undegraded":"2024-09-11T00:23:50.871007+0000","last_fullsized":"2024-09-11T00:23:50.871007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:02.075049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526442+0000","last_change":"2024-09-11T00:23:48.925648+0000","last_active":"2024-09-11T00:23:50.526442+0000","last_peered":"2024-09-11T00:23:50.526442+0000","last_clean":"2024-09-11T00:23:50.526442+0000","last_became_active":"2024-09-11T00:23:48.924442+0000","last_became_peered":"2024-09-11T00:23:48.924442+0000","last_unstale":"2024-09-11T00:23:50.526442+0000","last_undegraded":"2024-09-11T00:23:50.526442+0000","last_fullsized":"2024-09-11T00:23:50.526442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:54.299102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870045+0000","last_change":"2024-09-11T00:23:47.932359+0000","last_active":"2024-09-11T00:23:50.870045+0000","last_peered":"2024-09-11T00:23:50.870045+0000","last_clean":"2024-09-11T00:23:50.870045+0000","last_became_active":"2024-09-11T00:23:47.932075+0000","last_became_peered":"2024-09-11T00:23:47.932075+0000","last_unstale":"2024-09-11T00:23:50.870045+0000","last_undegraded":"2024-09-11T00:23:50.870045+0000","last_fullsized":"2024-09-11T00:23:50.870045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:17.848252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870089+0000","last_change":"2024-09-11T00:23:48.939724+0000","last_active":"2024-09-11T00:23:50.870089+0000","last_peered":"2024-09-11T00:23:50.870089+0000","last_clean":"2024-09-11T00:23:50.870089+0000","last_became_active":"2024-09-11T00:23:48.939505+0000","last_became_peered":"2024-09-11T00:23:48.939505+0000","last_unstale":"2024-09-11T00:23:50.870089+0000","last_undegraded":"2024-09-11T00:23:50.870089+0000","last_fullsized":"2024-09-11T00:23:50.870089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:19.018125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526569+0000","last_change":"2024-09-11T00:23:47.940123+0000","last_active":"2024-09-11T00:23:50.526569+0000","last_peered":"2024-09-11T00:23:50.526569+0000","last_clean":"2024-09-11T00:23:50.526569+0000","last_became_active":"2024-09-11T00:23:47.939901+0000","last_became_peered":"2024-09-11T00:23:47.939901+0000","last_unstale":"2024-09-11T00:23:50.526569+0000","last_undegraded":"2024-09-11T00:23:50.526569+0000","last_fullsized":"2024-09-11T00:23:50.526569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:45.637790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":667234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":76410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":667290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:23:54.025 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T00:23:54.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.220+0000 7f4a94a00640 1 -- 172.21.15.40:0/1205329164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a74004800 msgr2=0x7f4a74004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:54.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.220+0000 7f4a94a00640 1 --2- 172.21.15.40:0/1205329164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a74004800 0x7f4a74004c80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4a7800c2e0 tx=0x7f4a74005830 comp rx=0 tx=0).stop 2024-09-11T00:23:54.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.220+0000 7f4a94a00640 1 -- 172.21.15.40:0/1205329164 shutdown_connections 2024-09-11T00:23:54.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.220+0000 7f4a94a00640 1 --2- 172.21.15.40:0/1205329164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a74004800 0x7f4a74004c80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.220+0000 7f4a94a00640 1 -- 172.21.15.40:0/1205329164 >> 172.21.15.40:0/1205329164 conn(0x7f4a900cf770 msgr2=0x7f4a900cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:54.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.221+0000 7f4a94a00640 1 -- 172.21.15.40:0/1205329164 shutdown_connections 2024-09-11T00:23:54.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.221+0000 7f4a94a00640 1 -- 172.21.15.40:0/1205329164 wait complete. 2024-09-11T00:23:54.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.222+0000 7f4a94a00640 1 Processor -- start 2024-09-11T00:23:54.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.222+0000 7f4a94a00640 1 -- start start 2024-09-11T00:23:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.223+0000 7f4a94a00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a74004800 0x7f4a901512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.223+0000 7f4a94a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a90151800 0x7f4a900c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.223+0000 7f4a94a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a900c92a0 0x7f4a901f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.223+0000 7f4a94a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4a900ae7c0 con 0x7f4a900c92a0 2024-09-11T00:23:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.223+0000 7f4a94a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4a900ae640 con 0x7f4a90151800 2024-09-11T00:23:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.223+0000 7f4a94a00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4a900ae940 con 0x7f4a74004800 2024-09-11T00:23:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.223+0000 7f4a8fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a900c92a0 0x7f4a901f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.223+0000 7f4a8fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a900c92a0 0x7f4a901f5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42258/0 (socket says 172.21.15.40:42258) 2024-09-11T00:23:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.223+0000 7f4a8fe00640 1 -- 172.21.15.40:0/2203431601 learned_addr learned my addr 172.21.15.40:0/2203431601 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:54.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.224+0000 7f4a86a00640 1 --2- 172.21.15.40:0/2203431601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a90151800 0x7f4a900c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:54.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.224+0000 7f4a8f400640 1 --2- 172.21.15.40:0/2203431601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a74004800 0x7f4a901512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:54.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.224+0000 7f4a8fe00640 1 -- 172.21.15.40:0/2203431601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a74004800 msgr2=0x7f4a901512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:54.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.224+0000 7f4a8fe00640 1 --2- 172.21.15.40:0/2203431601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a74004800 0x7f4a901512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.224+0000 7f4a8fe00640 1 -- 172.21.15.40:0/2203431601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a90151800 msgr2=0x7f4a900c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:54.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.224+0000 7f4a8fe00640 1 --2- 172.21.15.40:0/2203431601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a90151800 0x7f4a900c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.224+0000 7f4a8fe00640 1 -- 172.21.15.40:0/2203431601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a900b3060 con 0x7f4a900c92a0 2024-09-11T00:23:54.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.224+0000 7f4a8fe00640 1 --2- 172.21.15.40:0/2203431601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a900c92a0 0x7f4a901f5ef0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4a900cf210 tx=0x7f4a8800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:54.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.224+0000 7f4a87e00640 1 -- 172.21.15.40:0/2203431601 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8800b9d0 con 0x7f4a900c92a0 2024-09-11T00:23:54.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.224+0000 7f4a87e00640 1 -- 172.21.15.40:0/2203431601 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a8800bc60 con 0x7f4a900c92a0 2024-09-11T00:23:54.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.224+0000 7f4a87e00640 1 -- 172.21.15.40:0/2203431601 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a880116a0 con 0x7f4a900c92a0 2024-09-11T00:23:54.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.224+0000 7f4a94a00640 1 -- 172.21.15.40:0/2203431601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a900b3340 con 0x7f4a900c92a0 2024-09-11T00:23:54.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.225+0000 7f4a94a00640 1 -- 172.21.15.40:0/2203431601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a901f6430 con 0x7f4a900c92a0 2024-09-11T00:23:54.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.225+0000 7f4a94a00640 1 -- 172.21.15.40:0/2203431601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a90073a60 con 0x7f4a900c92a0 2024-09-11T00:23:54.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.227+0000 7f4a87e00640 1 -- 172.21.15.40:0/2203431601 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4a88011840 con 0x7f4a900c92a0 2024-09-11T00:23:54.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.228+0000 7f4a87e00640 1 --2- 172.21.15.40:0/2203431601 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4a6c077f70 0x7f4a6c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:54.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.228+0000 7f4a87e00640 1 -- 172.21.15.40:0/2203431601 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4a8809a6e0 con 0x7f4a900c92a0 2024-09-11T00:23:54.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.228+0000 7f4a8f400640 1 --2- 172.21.15.40:0/2203431601 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4a6c077f70 0x7f4a6c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:54.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.229+0000 7f4a8f400640 1 --2- 172.21.15.40:0/2203431601 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4a6c077f70 0x7f4a6c07a430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a900668e0 tx=0x7f4a80006ef0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:54.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.232+0000 7f4a87e00640 1 -- 172.21.15.40:0/2203431601 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4a880631d0 con 0x7f4a900c92a0 2024-09-11T00:23:54.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.499+0000 7f4a94a00640 1 -- 172.21.15.40:0/2203431601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f4a900c9b20 con 0x7f4a900c92a0 2024-09-11T00:23:54.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.500+0000 7f4a87e00640 1 -- 172.21.15.40:0/2203431601 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1053 (secure 0 0 0) 0x7f4a88062ad0 con 0x7f4a900c92a0 2024-09-11T00:23:54.501 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:23:54.502 INFO:teuthology.orchestra.run.smithi040.stdout:{"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":31,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1726014216,"num_in_osds":8,"osd_in_since":1726014206,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":224444416,"bytes_avail":772869668864,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":8,"btime":"2024-09-11T00:23:51:938503+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4356}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-11T00:23:22.513542+0000","services":{}},"progress_events":{}} 2024-09-11T00:23:54.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.502+0000 7f4a94a00640 1 -- 172.21.15.40:0/2203431601 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4a6c077f70 msgr2=0x7f4a6c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:54.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.502+0000 7f4a94a00640 1 --2- 172.21.15.40:0/2203431601 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4a6c077f70 0x7f4a6c07a430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a900668e0 tx=0x7f4a80006ef0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.502+0000 7f4a94a00640 1 -- 172.21.15.40:0/2203431601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a900c92a0 msgr2=0x7f4a901f5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:54.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.502+0000 7f4a94a00640 1 --2- 172.21.15.40:0/2203431601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a900c92a0 0x7f4a901f5ef0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4a900cf210 tx=0x7f4a8800fab0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.503+0000 7f4a94a00640 1 -- 172.21.15.40:0/2203431601 shutdown_connections 2024-09-11T00:23:54.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.503+0000 7f4a94a00640 1 --2- 172.21.15.40:0/2203431601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a900c92a0 0x7f4a901f5ef0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.503+0000 7f4a94a00640 1 --2- 172.21.15.40:0/2203431601 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4a6c077f70 0x7f4a6c07a430 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.503+0000 7f4a94a00640 1 --2- 172.21.15.40:0/2203431601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a90151800 0x7f4a900c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.503+0000 7f4a94a00640 1 --2- 172.21.15.40:0/2203431601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a74004800 0x7f4a901512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.503+0000 7f4a94a00640 1 -- 172.21.15.40:0/2203431601 >> 172.21.15.40:0/2203431601 conn(0x7f4a900cf770 msgr2=0x7f4a900b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:54.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.503+0000 7f4a94a00640 1 -- 172.21.15.40:0/2203431601 shutdown_connections 2024-09-11T00:23:54.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.503+0000 7f4a94a00640 1 -- 172.21.15.40:0/2203431601 wait complete. 2024-09-11T00:23:54.520 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T00:23:54.520 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:23:54.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.679+0000 7fd009200640 1 -- 172.21.15.40:0/2772101170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0040d09e0 msgr2=0x7fd0040d4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:54.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.679+0000 7fd009200640 1 --2- 172.21.15.40:0/2772101170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0040d09e0 0x7fd0040d4740 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcfec009830 tx=0x7fcfec02a530 comp rx=0 tx=0).stop 2024-09-11T00:23:54.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.680+0000 7fd009200640 1 -- 172.21.15.40:0/2772101170 shutdown_connections 2024-09-11T00:23:54.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.680+0000 7fd009200640 1 --2- 172.21.15.40:0/2772101170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0040d09e0 0x7fd0040d4740 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.680+0000 7fd009200640 1 -- 172.21.15.40:0/2772101170 >> 172.21.15.40:0/2772101170 conn(0x7fd0040d3c20 msgr2=0x7fd0040d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:54.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.680+0000 7fd009200640 1 -- 172.21.15.40:0/2772101170 shutdown_connections 2024-09-11T00:23:54.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.680+0000 7fd009200640 1 -- 172.21.15.40:0/2772101170 wait complete. 2024-09-11T00:23:54.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.681+0000 7fd009200640 1 Processor -- start 2024-09-11T00:23:54.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.681+0000 7fd009200640 1 -- start start 2024-09-11T00:23:54.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.682+0000 7fd009200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0040b2d20 0x7fd0040c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:54.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.682+0000 7fd009200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0040d09e0 0x7fd0040c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:54.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.682+0000 7fd009200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd00415dd10 0x7fd00414e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:54.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.682+0000 7fd009200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd00406daa0 con 0x7fd0040b2d20 2024-09-11T00:23:54.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.682+0000 7fd009200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd00406d920 con 0x7fd00415dd10 2024-09-11T00:23:54.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.682+0000 7fd009200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd00406dc20 con 0x7fd0040d09e0 2024-09-11T00:23:54.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.682+0000 7fd003400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0040b2d20 0x7fd0040c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:54.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.683+0000 7fd003400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0040b2d20 0x7fd0040c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42270/0 (socket says 172.21.15.40:42270) 2024-09-11T00:23:54.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.683+0000 7fd003400640 1 -- 172.21.15.40:0/4092683303 learned_addr learned my addr 172.21.15.40:0/4092683303 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:54.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.683+0000 7fcffbe00640 1 --2- 172.21.15.40:0/4092683303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0040d09e0 0x7fd0040c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:54.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.683+0000 7fd003e00640 1 --2- 172.21.15.40:0/4092683303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd00415dd10 0x7fd00414e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:54.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.683+0000 7fd003400640 1 -- 172.21.15.40:0/4092683303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0040d09e0 msgr2=0x7fd0040c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:54.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.683+0000 7fd003400640 1 --2- 172.21.15.40:0/4092683303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0040d09e0 0x7fd0040c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.683+0000 7fd003400640 1 -- 172.21.15.40:0/4092683303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd00415dd10 msgr2=0x7fd00414e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:54.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.683+0000 7fd003400640 1 --2- 172.21.15.40:0/4092683303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd00415dd10 0x7fd00414e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.683+0000 7fd003400640 1 -- 172.21.15.40:0/4092683303 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0040c98a0 con 0x7fd0040b2d20 2024-09-11T00:23:54.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.683+0000 7fcffbe00640 1 --2- 172.21.15.40:0/4092683303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0040d09e0 0x7fd0040c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:54.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.683+0000 7fd003e00640 1 --2- 172.21.15.40:0/4092683303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd00415dd10 0x7fd00414e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:54.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.683+0000 7fd003400640 1 --2- 172.21.15.40:0/4092683303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0040b2d20 0x7fd0040c91a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcff400c370 tx=0x7fcff400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:54.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.683+0000 7fcffb400640 1 -- 172.21.15.40:0/4092683303 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff4011790 con 0x7fd0040b2d20 2024-09-11T00:23:54.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.683+0000 7fcffb400640 1 -- 172.21.15.40:0/4092683303 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcff4017070 con 0x7fd0040b2d20 2024-09-11T00:23:54.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.683+0000 7fcffb400640 1 -- 172.21.15.40:0/4092683303 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff4011cc0 con 0x7fd0040b2d20 2024-09-11T00:23:54.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.683+0000 7fd009200640 1 -- 172.21.15.40:0/4092683303 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0040c9b80 con 0x7fd0040b2d20 2024-09-11T00:23:54.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.684+0000 7fd009200640 1 -- 172.21.15.40:0/4092683303 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd00414ecc0 con 0x7fd0040b2d20 2024-09-11T00:23:54.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.685+0000 7fd009200640 1 -- 172.21.15.40:0/4092683303 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0040ca0a0 con 0x7fd0040b2d20 2024-09-11T00:23:54.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.686+0000 7fcffb400640 1 -- 172.21.15.40:0/4092683303 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcff401c460 con 0x7fd0040b2d20 2024-09-11T00:23:54.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.687+0000 7fcffb400640 1 --2- 172.21.15.40:0/4092683303 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fcfe0077f70 0x7fcfe007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:54.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.687+0000 7fcffb400640 1 -- 172.21.15.40:0/4092683303 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcff4099b10 con 0x7fd0040b2d20 2024-09-11T00:23:54.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.688+0000 7fcffbe00640 1 --2- 172.21.15.40:0/4092683303 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fcfe0077f70 0x7fcfe007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:54.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.688+0000 7fcffbe00640 1 --2- 172.21.15.40:0/4092683303 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fcfe0077f70 0x7fcfe007a430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcfec034000 tx=0x7fcfec004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:54.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.692+0000 7fcffb400640 1 -- 172.21.15.40:0/4092683303 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcff4062570 con 0x7fd0040b2d20 2024-09-11T00:23:54.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.881+0000 7fd009200640 1 -- 172.21.15.40:0/4092683303 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd0040b31d0 con 0x7fcfe0077f70 2024-09-11T00:23:54.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.887+0000 7fcffb400640 1 -- 172.21.15.40:0/4092683303 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251937 (secure 0 0 0) 0x7fd0040b31d0 con 0x7fcfe0077f70 2024-09-11T00:23:54.891 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:23:54.893 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T00:23:54.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.891+0000 7fd009200640 1 -- 172.21.15.40:0/4092683303 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fcfe0077f70 msgr2=0x7fcfe007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:54.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.891+0000 7fd009200640 1 --2- 172.21.15.40:0/4092683303 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fcfe0077f70 0x7fcfe007a430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcfec034000 tx=0x7fcfec004730 comp rx=0 tx=0).stop 2024-09-11T00:23:54.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.891+0000 7fd009200640 1 -- 172.21.15.40:0/4092683303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0040b2d20 msgr2=0x7fd0040c91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:54.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.891+0000 7fd009200640 1 --2- 172.21.15.40:0/4092683303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0040b2d20 0x7fd0040c91a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcff400c370 tx=0x7fcff400c830 comp rx=0 tx=0).stop 2024-09-11T00:23:54.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.891+0000 7fd009200640 1 -- 172.21.15.40:0/4092683303 shutdown_connections 2024-09-11T00:23:54.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.891+0000 7fd009200640 1 --2- 172.21.15.40:0/4092683303 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fcfe0077f70 0x7fcfe007a430 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.891+0000 7fd009200640 1 --2- 172.21.15.40:0/4092683303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd00415dd10 0x7fd00414e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.891+0000 7fd009200640 1 --2- 172.21.15.40:0/4092683303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0040d09e0 0x7fd0040c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.891+0000 7fd009200640 1 --2- 172.21.15.40:0/4092683303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0040b2d20 0x7fd0040c91a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:54.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.891+0000 7fd009200640 1 -- 172.21.15.40:0/4092683303 >> 172.21.15.40:0/4092683303 conn(0x7fd0040d3c20 msgr2=0x7fd0040b7520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:54.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.891+0000 7fd009200640 1 -- 172.21.15.40:0/4092683303 shutdown_connections 2024-09-11T00:23:54.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:54.891+0000 7fd009200640 1 -- 172.21.15.40:0/4092683303 wait complete. 2024-09-11T00:23:54.908 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-11T00:23:53.776519+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219184,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755536,"statfs":{"total":773094113280,"available":772869668864,"internally_reserved":0,"allocated":3022848,"data_stored":1795828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001796"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.872004+0000","last_change":"2024-09-11T00:23:48.948893+0000","last_active":"2024-09-11T00:23:50.872004+0000","last_peered":"2024-09-11T00:23:50.872004+0000","last_clean":"2024-09-11T00:23:50.872004+0000","last_became_active":"2024-09-11T00:23:48.948539+0000","last_became_peered":"2024-09-11T00:23:48.948539+0000","last_unstale":"2024-09-11T00:23:50.872004+0000","last_undegraded":"2024-09-11T00:23:50.872004+0000","last_fullsized":"2024-09-11T00:23:50.872004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:16.991662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934001+0000","last_change":"2024-09-11T00:23:48.937342+0000","last_active":"2024-09-11T00:23:49.934001+0000","last_peered":"2024-09-11T00:23:49.934001+0000","last_clean":"2024-09-11T00:23:49.934001+0000","last_became_active":"2024-09-11T00:23:48.936595+0000","last_became_peered":"2024-09-11T00:23:48.936595+0000","last_unstale":"2024-09-11T00:23:49.934001+0000","last_undegraded":"2024-09-11T00:23:49.934001+0000","last_fullsized":"2024-09-11T00:23:49.934001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:32.096363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526446+0000","last_change":"2024-09-11T00:23:48.937798+0000","last_active":"2024-09-11T00:23:50.526446+0000","last_peered":"2024-09-11T00:23:50.526446+0000","last_clean":"2024-09-11T00:23:50.526446+0000","last_became_active":"2024-09-11T00:23:48.937479+0000","last_became_peered":"2024-09-11T00:23:48.937479+0000","last_unstale":"2024-09-11T00:23:50.526446+0000","last_undegraded":"2024-09-11T00:23:50.526446+0000","last_fullsized":"2024-09-11T00:23:50.526446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:27.574913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935177+0000","last_change":"2024-09-11T00:23:48.931523+0000","last_active":"2024-09-11T00:23:49.935177+0000","last_peered":"2024-09-11T00:23:49.935177+0000","last_clean":"2024-09-11T00:23:49.935177+0000","last_became_active":"2024-09-11T00:23:48.930038+0000","last_became_peered":"2024-09-11T00:23:48.930038+0000","last_unstale":"2024-09-11T00:23:49.935177+0000","last_undegraded":"2024-09-11T00:23:49.935177+0000","last_fullsized":"2024-09-11T00:23:49.935177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:37.999694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871474+0000","last_change":"2024-09-11T00:23:48.936786+0000","last_active":"2024-09-11T00:23:50.871474+0000","last_peered":"2024-09-11T00:23:50.871474+0000","last_clean":"2024-09-11T00:23:50.871474+0000","last_became_active":"2024-09-11T00:23:48.936512+0000","last_became_peered":"2024-09-11T00:23:48.936512+0000","last_unstale":"2024-09-11T00:23:50.871474+0000","last_undegraded":"2024-09-11T00:23:50.871474+0000","last_fullsized":"2024-09-11T00:23:50.871474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:20.441191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934971+0000","last_change":"2024-09-11T00:23:48.935843+0000","last_active":"2024-09-11T00:23:49.934971+0000","last_peered":"2024-09-11T00:23:49.934971+0000","last_clean":"2024-09-11T00:23:49.934971+0000","last_became_active":"2024-09-11T00:23:48.935591+0000","last_became_peered":"2024-09-11T00:23:48.935591+0000","last_unstale":"2024-09-11T00:23:49.934971+0000","last_undegraded":"2024-09-11T00:23:49.934971+0000","last_fullsized":"2024-09-11T00:23:49.934971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:25.619010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870938+0000","last_change":"2024-09-11T00:23:48.939799+0000","last_active":"2024-09-11T00:23:50.870938+0000","last_peered":"2024-09-11T00:23:50.870938+0000","last_clean":"2024-09-11T00:23:50.870938+0000","last_became_active":"2024-09-11T00:23:48.939495+0000","last_became_peered":"2024-09-11T00:23:48.939495+0000","last_unstale":"2024-09-11T00:23:50.870938+0000","last_undegraded":"2024-09-11T00:23:50.870938+0000","last_fullsized":"2024-09-11T00:23:50.870938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:13.522317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869563+0000","last_change":"2024-09-11T00:23:48.933813+0000","last_active":"2024-09-11T00:23:50.869563+0000","last_peered":"2024-09-11T00:23:50.869563+0000","last_clean":"2024-09-11T00:23:50.869563+0000","last_became_active":"2024-09-11T00:23:48.932681+0000","last_became_peered":"2024-09-11T00:23:48.932681+0000","last_unstale":"2024-09-11T00:23:50.869563+0000","last_undegraded":"2024-09-11T00:23:50.869563+0000","last_fullsized":"2024-09-11T00:23:50.869563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:49.141326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.872030+0000","last_change":"2024-09-11T00:23:48.943035+0000","last_active":"2024-09-11T00:23:50.872030+0000","last_peered":"2024-09-11T00:23:50.872030+0000","last_clean":"2024-09-11T00:23:50.872030+0000","last_became_active":"2024-09-11T00:23:48.942299+0000","last_became_peered":"2024-09-11T00:23:48.942299+0000","last_unstale":"2024-09-11T00:23:50.872030+0000","last_undegraded":"2024-09-11T00:23:50.872030+0000","last_fullsized":"2024-09-11T00:23:50.872030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:04.169658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870722+0000","last_change":"2024-09-11T00:23:48.923914+0000","last_active":"2024-09-11T00:23:50.870722+0000","last_peered":"2024-09-11T00:23:50.870722+0000","last_clean":"2024-09-11T00:23:50.870722+0000","last_became_active":"2024-09-11T00:23:48.923637+0000","last_became_peered":"2024-09-11T00:23:48.923637+0000","last_unstale":"2024-09-11T00:23:50.870722+0000","last_undegraded":"2024-09-11T00:23:50.870722+0000","last_fullsized":"2024-09-11T00:23:50.870722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:08:27.071042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870678+0000","last_change":"2024-09-11T00:23:48.924320+0000","last_active":"2024-09-11T00:23:50.870678+0000","last_peered":"2024-09-11T00:23:50.870678+0000","last_clean":"2024-09-11T00:23:50.870678+0000","last_became_active":"2024-09-11T00:23:48.923963+0000","last_became_peered":"2024-09-11T00:23:48.923963+0000","last_unstale":"2024-09-11T00:23:50.870678+0000","last_undegraded":"2024-09-11T00:23:50.870678+0000","last_fullsized":"2024-09-11T00:23:50.870678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:57.017486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936400+0000","last_change":"2024-09-11T00:23:48.926315+0000","last_active":"2024-09-11T00:23:49.936400+0000","last_peered":"2024-09-11T00:23:49.936400+0000","last_clean":"2024-09-11T00:23:49.936400+0000","last_became_active":"2024-09-11T00:23:48.926023+0000","last_became_peered":"2024-09-11T00:23:48.926023+0000","last_unstale":"2024-09-11T00:23:49.936400+0000","last_undegraded":"2024-09-11T00:23:49.936400+0000","last_fullsized":"2024-09-11T00:23:49.936400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:53:00.946208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869742+0000","last_change":"2024-09-11T00:23:48.940397+0000","last_active":"2024-09-11T00:23:50.869742+0000","last_peered":"2024-09-11T00:23:50.869742+0000","last_clean":"2024-09-11T00:23:50.869742+0000","last_became_active":"2024-09-11T00:23:48.940131+0000","last_became_peered":"2024-09-11T00:23:48.940131+0000","last_unstale":"2024-09-11T00:23:50.869742+0000","last_undegraded":"2024-09-11T00:23:50.869742+0000","last_fullsized":"2024-09-11T00:23:50.869742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:08:27.071042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526136+0000","last_change":"2024-09-11T00:23:48.934059+0000","last_active":"2024-09-11T00:23:50.526136+0000","last_peered":"2024-09-11T00:23:50.526136+0000","last_clean":"2024-09-11T00:23:50.526136+0000","last_became_active":"2024-09-11T00:23:48.931545+0000","last_became_peered":"2024-09-11T00:23:48.931545+0000","last_unstale":"2024-09-11T00:23:50.526136+0000","last_undegraded":"2024-09-11T00:23:50.526136+0000","last_fullsized":"2024-09-11T00:23:50.526136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:22.406899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933205+0000","last_change":"2024-09-11T00:23:48.917392+0000","last_active":"2024-09-11T00:23:49.933205+0000","last_peered":"2024-09-11T00:23:49.933205+0000","last_clean":"2024-09-11T00:23:49.933205+0000","last_became_active":"2024-09-11T00:23:48.917076+0000","last_became_peered":"2024-09-11T00:23:48.917076+0000","last_unstale":"2024-09-11T00:23:49.933205+0000","last_undegraded":"2024-09-11T00:23:49.933205+0000","last_fullsized":"2024-09-11T00:23:49.933205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:33.143595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934240+0000","last_change":"2024-09-11T00:23:48.926949+0000","last_active":"2024-09-11T00:23:49.934240+0000","last_peered":"2024-09-11T00:23:49.934240+0000","last_clean":"2024-09-11T00:23:49.934240+0000","last_became_active":"2024-09-11T00:23:48.926624+0000","last_became_peered":"2024-09-11T00:23:48.926624+0000","last_unstale":"2024-09-11T00:23:49.934240+0000","last_undegraded":"2024-09-11T00:23:49.934240+0000","last_fullsized":"2024-09-11T00:23:49.934240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:40.283499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.937130+0000","last_change":"2024-09-11T00:23:48.927831+0000","last_active":"2024-09-11T00:23:49.937130+0000","last_peered":"2024-09-11T00:23:49.937130+0000","last_clean":"2024-09-11T00:23:49.937130+0000","last_became_active":"2024-09-11T00:23:48.927396+0000","last_became_peered":"2024-09-11T00:23:48.927396+0000","last_unstale":"2024-09-11T00:23:49.937130+0000","last_undegraded":"2024-09-11T00:23:49.937130+0000","last_fullsized":"2024-09-11T00:23:49.937130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:43.076990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713863+0000","last_change":"2024-09-11T00:23:48.925368+0000","last_active":"2024-09-11T00:23:50.713863+0000","last_peered":"2024-09-11T00:23:50.713863+0000","last_clean":"2024-09-11T00:23:50.713863+0000","last_became_active":"2024-09-11T00:23:48.925051+0000","last_became_peered":"2024-09-11T00:23:48.925051+0000","last_unstale":"2024-09-11T00:23:50.713863+0000","last_undegraded":"2024-09-11T00:23:50.713863+0000","last_fullsized":"2024-09-11T00:23:50.713863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:03.081754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871196+0000","last_change":"2024-09-11T00:23:48.945468+0000","last_active":"2024-09-11T00:23:50.871196+0000","last_peered":"2024-09-11T00:23:50.871196+0000","last_clean":"2024-09-11T00:23:50.871196+0000","last_became_active":"2024-09-11T00:23:48.944945+0000","last_became_peered":"2024-09-11T00:23:48.944945+0000","last_unstale":"2024-09-11T00:23:50.871196+0000","last_undegraded":"2024-09-11T00:23:50.871196+0000","last_fullsized":"2024-09-11T00:23:50.871196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:06.656916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870452+0000","last_change":"2024-09-11T00:23:48.921544+0000","last_active":"2024-09-11T00:23:50.870452+0000","last_peered":"2024-09-11T00:23:50.870452+0000","last_clean":"2024-09-11T00:23:50.870452+0000","last_became_active":"2024-09-11T00:23:48.921253+0000","last_became_peered":"2024-09-11T00:23:48.921253+0000","last_unstale":"2024-09-11T00:23:50.870452+0000","last_undegraded":"2024-09-11T00:23:50.870452+0000","last_fullsized":"2024-09-11T00:23:50.870452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:10.533107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526203+0000","last_change":"2024-09-11T00:23:48.942961+0000","last_active":"2024-09-11T00:23:50.526203+0000","last_peered":"2024-09-11T00:23:50.526203+0000","last_clean":"2024-09-11T00:23:50.526203+0000","last_became_active":"2024-09-11T00:23:48.941533+0000","last_became_peered":"2024-09-11T00:23:48.941533+0000","last_unstale":"2024-09-11T00:23:50.526203+0000","last_undegraded":"2024-09-11T00:23:50.526203+0000","last_fullsized":"2024-09-11T00:23:50.526203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:52.956083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935633+0000","last_change":"2024-09-11T00:23:48.935142+0000","last_active":"2024-09-11T00:23:49.935633+0000","last_peered":"2024-09-11T00:23:49.935633+0000","last_clean":"2024-09-11T00:23:49.935633+0000","last_became_active":"2024-09-11T00:23:48.933148+0000","last_became_peered":"2024-09-11T00:23:48.933148+0000","last_unstale":"2024-09-11T00:23:49.935633+0000","last_undegraded":"2024-09-11T00:23:49.935633+0000","last_fullsized":"2024-09-11T00:23:49.935633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:18:47.960332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869723+0000","last_change":"2024-09-11T00:23:48.929778+0000","last_active":"2024-09-11T00:23:50.869723+0000","last_peered":"2024-09-11T00:23:50.869723+0000","last_clean":"2024-09-11T00:23:50.869723+0000","last_became_active":"2024-09-11T00:23:48.928138+0000","last_became_peered":"2024-09-11T00:23:48.928138+0000","last_unstale":"2024-09-11T00:23:50.869723+0000","last_undegraded":"2024-09-11T00:23:50.869723+0000","last_fullsized":"2024-09-11T00:23:50.869723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:23.709720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934308+0000","last_change":"2024-09-11T00:23:48.947725+0000","last_active":"2024-09-11T00:23:49.934308+0000","last_peered":"2024-09-11T00:23:49.934308+0000","last_clean":"2024-09-11T00:23:49.934308+0000","last_became_active":"2024-09-11T00:23:48.947361+0000","last_became_peered":"2024-09-11T00:23:48.947361+0000","last_unstale":"2024-09-11T00:23:49.934308+0000","last_undegraded":"2024-09-11T00:23:49.934308+0000","last_fullsized":"2024-09-11T00:23:49.934308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:31.087205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870205+0000","last_change":"2024-09-11T00:23:48.944855+0000","last_active":"2024-09-11T00:23:50.870205+0000","last_peered":"2024-09-11T00:23:50.870205+0000","last_clean":"2024-09-11T00:23:50.870205+0000","last_became_active":"2024-09-11T00:23:48.944551+0000","last_became_peered":"2024-09-11T00:23:48.944551+0000","last_unstale":"2024-09-11T00:23:50.870205+0000","last_undegraded":"2024-09-11T00:23:50.870205+0000","last_fullsized":"2024-09-11T00:23:50.870205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:53.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870796+0000","last_change":"2024-09-11T00:23:48.937626+0000","last_active":"2024-09-11T00:23:50.870796+0000","last_peered":"2024-09-11T00:23:50.870796+0000","last_clean":"2024-09-11T00:23:50.870796+0000","last_became_active":"2024-09-11T00:23:48.937263+0000","last_became_peered":"2024-09-11T00:23:48.937263+0000","last_unstale":"2024-09-11T00:23:50.870796+0000","last_undegraded":"2024-09-11T00:23:50.870796+0000","last_fullsized":"2024-09-11T00:23:50.870796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:50.142533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933798+0000","last_change":"2024-09-11T00:23:48.928952+0000","last_active":"2024-09-11T00:23:49.933798+0000","last_peered":"2024-09-11T00:23:49.933798+0000","last_clean":"2024-09-11T00:23:49.933798+0000","last_became_active":"2024-09-11T00:23:48.928683+0000","last_became_peered":"2024-09-11T00:23:48.928683+0000","last_unstale":"2024-09-11T00:23:49.933798+0000","last_undegraded":"2024-09-11T00:23:49.933798+0000","last_fullsized":"2024-09-11T00:23:49.933798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:50.142533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870161+0000","last_change":"2024-09-11T00:23:48.929575+0000","last_active":"2024-09-11T00:23:50.870161+0000","last_peered":"2024-09-11T00:23:50.870161+0000","last_clean":"2024-09-11T00:23:50.870161+0000","last_became_active":"2024-09-11T00:23:48.928625+0000","last_became_peered":"2024-09-11T00:23:48.928625+0000","last_unstale":"2024-09-11T00:23:50.870161+0000","last_undegraded":"2024-09-11T00:23:50.870161+0000","last_fullsized":"2024-09-11T00:23:50.870161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:13.522317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526474+0000","last_change":"2024-09-11T00:23:48.947976+0000","last_active":"2024-09-11T00:23:50.526474+0000","last_peered":"2024-09-11T00:23:50.526474+0000","last_clean":"2024-09-11T00:23:50.526474+0000","last_became_active":"2024-09-11T00:23:48.947725+0000","last_became_peered":"2024-09-11T00:23:48.947725+0000","last_unstale":"2024-09-11T00:23:50.526474+0000","last_undegraded":"2024-09-11T00:23:50.526474+0000","last_fullsized":"2024-09-11T00:23:50.526474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:09:52.162272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935202+0000","last_change":"2024-09-11T00:23:48.930538+0000","last_active":"2024-09-11T00:23:49.935202+0000","last_peered":"2024-09-11T00:23:49.935202+0000","last_clean":"2024-09-11T00:23:49.935202+0000","last_became_active":"2024-09-11T00:23:48.930224+0000","last_became_peered":"2024-09-11T00:23:48.930224+0000","last_unstale":"2024-09-11T00:23:49.935202+0000","last_undegraded":"2024-09-11T00:23:49.935202+0000","last_fullsized":"2024-09-11T00:23:49.935202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:18.427715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713776+0000","last_change":"2024-09-11T00:23:48.927566+0000","last_active":"2024-09-11T00:23:50.713776+0000","last_peered":"2024-09-11T00:23:50.713776+0000","last_clean":"2024-09-11T00:23:50.713776+0000","last_became_active":"2024-09-11T00:23:48.927306+0000","last_became_peered":"2024-09-11T00:23:48.927306+0000","last_unstale":"2024-09-11T00:23:50.713776+0000","last_undegraded":"2024-09-11T00:23:50.713776+0000","last_fullsized":"2024-09-11T00:23:50.713776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:35.800616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870322+0000","last_change":"2024-09-11T00:23:48.926632+0000","last_active":"2024-09-11T00:23:50.870322+0000","last_peered":"2024-09-11T00:23:50.870322+0000","last_clean":"2024-09-11T00:23:50.870322+0000","last_became_active":"2024-09-11T00:23:48.926014+0000","last_became_peered":"2024-09-11T00:23:48.926014+0000","last_unstale":"2024-09-11T00:23:50.870322+0000","last_undegraded":"2024-09-11T00:23:50.870322+0000","last_fullsized":"2024-09-11T00:23:50.870322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:49.141326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936248+0000","last_change":"2024-09-11T00:23:48.925940+0000","last_active":"2024-09-11T00:23:49.936248+0000","last_peered":"2024-09-11T00:23:49.936248+0000","last_clean":"2024-09-11T00:23:49.936248+0000","last_became_active":"2024-09-11T00:23:48.925589+0000","last_became_peered":"2024-09-11T00:23:48.925589+0000","last_unstale":"2024-09-11T00:23:49.936248+0000","last_undegraded":"2024-09-11T00:23:49.936248+0000","last_fullsized":"2024-09-11T00:23:49.936248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:41.419916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869814+0000","last_change":"2024-09-11T00:23:47.934229+0000","last_active":"2024-09-11T00:23:50.869814+0000","last_peered":"2024-09-11T00:23:50.869814+0000","last_clean":"2024-09-11T00:23:50.869814+0000","last_became_active":"2024-09-11T00:23:47.933880+0000","last_became_peered":"2024-09-11T00:23:47.933880+0000","last_unstale":"2024-09-11T00:23:50.869814+0000","last_undegraded":"2024-09-11T00:23:50.869814+0000","last_fullsized":"2024-09-11T00:23:50.869814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:30.892853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526491+0000","last_change":"2024-09-11T00:23:48.934481+0000","last_active":"2024-09-11T00:23:50.526491+0000","last_peered":"2024-09-11T00:23:50.526491+0000","last_clean":"2024-09-11T00:23:50.526491+0000","last_became_active":"2024-09-11T00:23:48.931082+0000","last_became_peered":"2024-09-11T00:23:48.931082+0000","last_unstale":"2024-09-11T00:23:50.526491+0000","last_undegraded":"2024-09-11T00:23:50.526491+0000","last_fullsized":"2024-09-11T00:23:50.526491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:04.133148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870136+0000","last_change":"2024-09-11T00:23:47.933078+0000","last_active":"2024-09-11T00:23:50.870136+0000","last_peered":"2024-09-11T00:23:50.870136+0000","last_clean":"2024-09-11T00:23:50.870136+0000","last_became_active":"2024-09-11T00:23:47.932815+0000","last_became_peered":"2024-09-11T00:23:47.932815+0000","last_unstale":"2024-09-11T00:23:50.870136+0000","last_undegraded":"2024-09-11T00:23:50.870136+0000","last_fullsized":"2024-09-11T00:23:50.870136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:00.103061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869652+0000","last_change":"2024-09-11T00:23:47.927116+0000","last_active":"2024-09-11T00:23:50.869652+0000","last_peered":"2024-09-11T00:23:50.869652+0000","last_clean":"2024-09-11T00:23:50.869652+0000","last_became_active":"2024-09-11T00:23:47.926760+0000","last_became_peered":"2024-09-11T00:23:47.926760+0000","last_unstale":"2024-09-11T00:23:50.869652+0000","last_undegraded":"2024-09-11T00:23:50.869652+0000","last_fullsized":"2024-09-11T00:23:50.869652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:14:45.347474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869585+0000","last_change":"2024-09-11T00:23:48.947208+0000","last_active":"2024-09-11T00:23:50.869585+0000","last_peered":"2024-09-11T00:23:50.869585+0000","last_clean":"2024-09-11T00:23:50.869585+0000","last_became_active":"2024-09-11T00:23:48.946963+0000","last_became_peered":"2024-09-11T00:23:48.946963+0000","last_unstale":"2024-09-11T00:23:50.869585+0000","last_undegraded":"2024-09-11T00:23:50.869585+0000","last_fullsized":"2024-09-11T00:23:50.869585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:10.533107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934435+0000","last_change":"2024-09-11T00:23:47.924168+0000","last_active":"2024-09-11T00:23:49.934435+0000","last_peered":"2024-09-11T00:23:49.934435+0000","last_clean":"2024-09-11T00:23:49.934435+0000","last_became_active":"2024-09-11T00:23:47.923810+0000","last_became_peered":"2024-09-11T00:23:47.923810+0000","last_unstale":"2024-09-11T00:23:49.934435+0000","last_undegraded":"2024-09-11T00:23:49.934435+0000","last_fullsized":"2024-09-11T00:23:49.934435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:09.057962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933208+0000","last_change":"2024-09-11T00:23:48.932214+0000","last_active":"2024-09-11T00:23:49.933208+0000","last_peered":"2024-09-11T00:23:49.933208+0000","last_clean":"2024-09-11T00:23:49.933208+0000","last_became_active":"2024-09-11T00:23:48.931946+0000","last_became_peered":"2024-09-11T00:23:48.931946+0000","last_unstale":"2024-09-11T00:23:49.933208+0000","last_undegraded":"2024-09-11T00:23:49.933208+0000","last_fullsized":"2024-09-11T00:23:49.933208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:10.533107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871004+0000","last_change":"2024-09-11T00:23:47.929315+0000","last_active":"2024-09-11T00:23:50.871004+0000","last_peered":"2024-09-11T00:23:50.871004+0000","last_clean":"2024-09-11T00:23:50.871004+0000","last_became_active":"2024-09-11T00:23:47.928873+0000","last_became_peered":"2024-09-11T00:23:47.928873+0000","last_unstale":"2024-09-11T00:23:50.871004+0000","last_undegraded":"2024-09-11T00:23:50.871004+0000","last_fullsized":"2024-09-11T00:23:50.871004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:27.835276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935414+0000","last_change":"2024-09-11T00:23:48.933958+0000","last_active":"2024-09-11T00:23:49.935414+0000","last_peered":"2024-09-11T00:23:49.935414+0000","last_clean":"2024-09-11T00:23:49.935414+0000","last_became_active":"2024-09-11T00:23:48.933311+0000","last_became_peered":"2024-09-11T00:23:48.933311+0000","last_unstale":"2024-09-11T00:23:49.935414+0000","last_undegraded":"2024-09-11T00:23:49.935414+0000","last_fullsized":"2024-09-11T00:23:49.935414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:48.420430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936215+0000","last_change":"2024-09-11T00:23:47.936415+0000","last_active":"2024-09-11T00:23:49.936215+0000","last_peered":"2024-09-11T00:23:49.936215+0000","last_clean":"2024-09-11T00:23:49.936215+0000","last_became_active":"2024-09-11T00:23:47.935508+0000","last_became_peered":"2024-09-11T00:23:47.935508+0000","last_unstale":"2024-09-11T00:23:49.936215+0000","last_undegraded":"2024-09-11T00:23:49.936215+0000","last_fullsized":"2024-09-11T00:23:49.936215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:14:04.971648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526665+0000","last_change":"2024-09-11T00:23:48.925280+0000","last_active":"2024-09-11T00:23:50.526665+0000","last_peered":"2024-09-11T00:23:50.526665+0000","last_clean":"2024-09-11T00:23:50.526665+0000","last_became_active":"2024-09-11T00:23:48.923558+0000","last_became_peered":"2024-09-11T00:23:48.923558+0000","last_unstale":"2024-09-11T00:23:50.526665+0000","last_undegraded":"2024-09-11T00:23:50.526665+0000","last_fullsized":"2024-09-11T00:23:50.526665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:51.437783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933648+0000","last_change":"2024-09-11T00:23:47.917495+0000","last_active":"2024-09-11T00:23:49.933648+0000","last_peered":"2024-09-11T00:23:49.933648+0000","last_clean":"2024-09-11T00:23:49.933648+0000","last_became_active":"2024-09-11T00:23:47.917190+0000","last_became_peered":"2024-09-11T00:23:47.917190+0000","last_unstale":"2024-09-11T00:23:49.933648+0000","last_undegraded":"2024-09-11T00:23:49.933648+0000","last_fullsized":"2024-09-11T00:23:49.933648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:40.413211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936314+0000","last_change":"2024-09-11T00:23:48.931464+0000","last_active":"2024-09-11T00:23:49.936314+0000","last_peered":"2024-09-11T00:23:49.936314+0000","last_clean":"2024-09-11T00:23:49.936314+0000","last_became_active":"2024-09-11T00:23:48.929780+0000","last_became_peered":"2024-09-11T00:23:48.929780+0000","last_unstale":"2024-09-11T00:23:49.936314+0000","last_undegraded":"2024-09-11T00:23:49.936314+0000","last_fullsized":"2024-09-11T00:23:49.936314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:06.878857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870468+0000","last_change":"2024-09-11T00:23:47.929964+0000","last_active":"2024-09-11T00:23:50.870468+0000","last_peered":"2024-09-11T00:23:50.870468+0000","last_clean":"2024-09-11T00:23:50.870468+0000","last_became_active":"2024-09-11T00:23:47.929635+0000","last_became_peered":"2024-09-11T00:23:47.929635+0000","last_unstale":"2024-09-11T00:23:50.870468+0000","last_undegraded":"2024-09-11T00:23:50.870468+0000","last_fullsized":"2024-09-11T00:23:50.870468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:05.769710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870963+0000","last_change":"2024-09-11T00:23:48.946941+0000","last_active":"2024-09-11T00:23:50.870963+0000","last_peered":"2024-09-11T00:23:50.870963+0000","last_clean":"2024-09-11T00:23:50.870963+0000","last_became_active":"2024-09-11T00:23:48.946690+0000","last_became_peered":"2024-09-11T00:23:48.946690+0000","last_unstale":"2024-09-11T00:23:50.870963+0000","last_undegraded":"2024-09-11T00:23:50.870963+0000","last_fullsized":"2024-09-11T00:23:50.870963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:18.427715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526613+0000","last_change":"2024-09-11T00:23:47.931967+0000","last_active":"2024-09-11T00:23:50.526613+0000","last_peered":"2024-09-11T00:23:50.526613+0000","last_clean":"2024-09-11T00:23:50.526613+0000","last_became_active":"2024-09-11T00:23:47.929613+0000","last_became_peered":"2024-09-11T00:23:47.929613+0000","last_unstale":"2024-09-11T00:23:50.526613+0000","last_undegraded":"2024-09-11T00:23:50.526613+0000","last_fullsized":"2024-09-11T00:23:50.526613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:07.537335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526168+0000","last_change":"2024-09-11T00:23:48.942082+0000","last_active":"2024-09-11T00:23:50.526168+0000","last_peered":"2024-09-11T00:23:50.526168+0000","last_clean":"2024-09-11T00:23:50.526168+0000","last_became_active":"2024-09-11T00:23:48.941719+0000","last_became_peered":"2024-09-11T00:23:48.941719+0000","last_unstale":"2024-09-11T00:23:50.526168+0000","last_undegraded":"2024-09-11T00:23:50.526168+0000","last_fullsized":"2024-09-11T00:23:50.526168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:12.862149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935272+0000","last_change":"2024-09-11T00:23:47.923106+0000","last_active":"2024-09-11T00:23:49.935272+0000","last_peered":"2024-09-11T00:23:49.935272+0000","last_clean":"2024-09-11T00:23:49.935272+0000","last_became_active":"2024-09-11T00:23:47.922184+0000","last_became_peered":"2024-09-11T00:23:47.922184+0000","last_unstale":"2024-09-11T00:23:49.935272+0000","last_undegraded":"2024-09-11T00:23:49.935272+0000","last_fullsized":"2024-09-11T00:23:49.935272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:25.625230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871459+0000","last_change":"2024-09-11T00:23:48.944533+0000","last_active":"2024-09-11T00:23:50.871459+0000","last_peered":"2024-09-11T00:23:50.871459+0000","last_clean":"2024-09-11T00:23:50.871459+0000","last_became_active":"2024-09-11T00:23:48.943682+0000","last_became_peered":"2024-09-11T00:23:48.943682+0000","last_unstale":"2024-09-11T00:23:50.871459+0000","last_undegraded":"2024-09-11T00:23:50.871459+0000","last_fullsized":"2024-09-11T00:23:50.871459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:30.501339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870124+0000","last_change":"2024-09-11T00:23:47.927380+0000","last_active":"2024-09-11T00:23:50.870124+0000","last_peered":"2024-09-11T00:23:50.870124+0000","last_clean":"2024-09-11T00:23:50.870124+0000","last_became_active":"2024-09-11T00:23:47.926325+0000","last_became_peered":"2024-09-11T00:23:47.926325+0000","last_unstale":"2024-09-11T00:23:50.870124+0000","last_undegraded":"2024-09-11T00:23:50.870124+0000","last_fullsized":"2024-09-11T00:23:50.870124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:17.848252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871625+0000","last_change":"2024-09-11T00:23:48.926985+0000","last_active":"2024-09-11T00:23:50.871625+0000","last_peered":"2024-09-11T00:23:50.871625+0000","last_clean":"2024-09-11T00:23:50.871625+0000","last_became_active":"2024-09-11T00:23:48.926337+0000","last_became_peered":"2024-09-11T00:23:48.926337+0000","last_unstale":"2024-09-11T00:23:50.871625+0000","last_undegraded":"2024-09-11T00:23:50.871625+0000","last_fullsized":"2024-09-11T00:23:50.871625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:32.096363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713565+0000","last_change":"2024-09-11T00:23:47.923036+0000","last_active":"2024-09-11T00:23:50.713565+0000","last_peered":"2024-09-11T00:23:50.713565+0000","last_clean":"2024-09-11T00:23:50.713565+0000","last_became_active":"2024-09-11T00:23:47.921195+0000","last_became_peered":"2024-09-11T00:23:47.921195+0000","last_unstale":"2024-09-11T00:23:50.713565+0000","last_undegraded":"2024-09-11T00:23:50.713565+0000","last_fullsized":"2024-09-11T00:23:50.713565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:14:45.347474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871089+0000","last_change":"2024-09-11T00:23:48.943396+0000","last_active":"2024-09-11T00:23:50.871089+0000","last_peered":"2024-09-11T00:23:50.871089+0000","last_clean":"2024-09-11T00:23:50.871089+0000","last_became_active":"2024-09-11T00:23:48.943075+0000","last_became_peered":"2024-09-11T00:23:48.943075+0000","last_unstale":"2024-09-11T00:23:50.871089+0000","last_undegraded":"2024-09-11T00:23:50.871089+0000","last_fullsized":"2024-09-11T00:23:50.871089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:52.627600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936327+0000","last_change":"2024-09-11T00:23:47.927064+0000","last_active":"2024-09-11T00:23:49.936327+0000","last_peered":"2024-09-11T00:23:49.936327+0000","last_clean":"2024-09-11T00:23:49.936327+0000","last_became_active":"2024-09-11T00:23:47.926712+0000","last_became_peered":"2024-09-11T00:23:47.926712+0000","last_unstale":"2024-09-11T00:23:49.936327+0000","last_undegraded":"2024-09-11T00:23:49.936327+0000","last_fullsized":"2024-09-11T00:23:49.936327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:04.442035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871836+0000","last_change":"2024-09-11T00:23:48.944697+0000","last_active":"2024-09-11T00:23:50.871836+0000","last_peered":"2024-09-11T00:23:50.871836+0000","last_clean":"2024-09-11T00:23:50.871836+0000","last_became_active":"2024-09-11T00:23:48.944401+0000","last_became_peered":"2024-09-11T00:23:48.944401+0000","last_unstale":"2024-09-11T00:23:50.871836+0000","last_undegraded":"2024-09-11T00:23:50.871836+0000","last_fullsized":"2024-09-11T00:23:50.871836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:37.819167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713804+0000","last_change":"2024-09-11T00:23:47.925285+0000","last_active":"2024-09-11T00:23:50.713804+0000","last_peered":"2024-09-11T00:23:50.713804+0000","last_clean":"2024-09-11T00:23:50.713804+0000","last_became_active":"2024-09-11T00:23:47.923814+0000","last_became_peered":"2024-09-11T00:23:47.923814+0000","last_unstale":"2024-09-11T00:23:50.713804+0000","last_undegraded":"2024-09-11T00:23:50.713804+0000","last_fullsized":"2024-09-11T00:23:50.713804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:05.769710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.872231+0000","last_change":"2024-09-11T00:23:48.943572+0000","last_active":"2024-09-11T00:23:50.872231+0000","last_peered":"2024-09-11T00:23:50.872231+0000","last_clean":"2024-09-11T00:23:50.872231+0000","last_became_active":"2024-09-11T00:23:48.943332+0000","last_became_peered":"2024-09-11T00:23:48.943332+0000","last_unstale":"2024-09-11T00:23:50.872231+0000","last_undegraded":"2024-09-11T00:23:50.872231+0000","last_fullsized":"2024-09-11T00:23:50.872231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:27.017230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933857+0000","last_change":"2024-09-11T00:23:47.916785+0000","last_active":"2024-09-11T00:23:49.933857+0000","last_peered":"2024-09-11T00:23:49.933857+0000","last_clean":"2024-09-11T00:23:49.933857+0000","last_became_active":"2024-09-11T00:23:47.916497+0000","last_became_peered":"2024-09-11T00:23:47.916497+0000","last_unstale":"2024-09-11T00:23:49.933857+0000","last_undegraded":"2024-09-11T00:23:49.933857+0000","last_fullsized":"2024-09-11T00:23:49.933857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:05.872152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935575+0000","last_change":"2024-09-11T00:23:48.930287+0000","last_active":"2024-09-11T00:23:49.935575+0000","last_peered":"2024-09-11T00:23:49.935575+0000","last_clean":"2024-09-11T00:23:49.935575+0000","last_became_active":"2024-09-11T00:23:48.929725+0000","last_became_peered":"2024-09-11T00:23:48.929725+0000","last_unstale":"2024-09-11T00:23:49.935575+0000","last_undegraded":"2024-09-11T00:23:49.935575+0000","last_fullsized":"2024-09-11T00:23:49.935575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:27.758680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713703+0000","last_change":"2024-09-11T00:23:47.921536+0000","last_active":"2024-09-11T00:23:50.713703+0000","last_peered":"2024-09-11T00:23:50.713703+0000","last_clean":"2024-09-11T00:23:50.713703+0000","last_became_active":"2024-09-11T00:23:47.921189+0000","last_became_peered":"2024-09-11T00:23:47.921189+0000","last_unstale":"2024-09-11T00:23:50.713703+0000","last_undegraded":"2024-09-11T00:23:50.713703+0000","last_fullsized":"2024-09-11T00:23:50.713703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:00.103061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870954+0000","last_change":"2024-09-11T00:23:48.938303+0000","last_active":"2024-09-11T00:23:50.870954+0000","last_peered":"2024-09-11T00:23:50.870954+0000","last_clean":"2024-09-11T00:23:50.870954+0000","last_became_active":"2024-09-11T00:23:48.938020+0000","last_became_peered":"2024-09-11T00:23:48.938020+0000","last_unstale":"2024-09-11T00:23:50.870954+0000","last_undegraded":"2024-09-11T00:23:50.870954+0000","last_fullsized":"2024-09-11T00:23:50.870954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:27:37.871843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870713+0000","last_change":"2024-09-11T00:23:38.923873+0000","last_active":"2024-09-11T00:23:50.870713+0000","last_peered":"2024-09-11T00:23:50.870713+0000","last_clean":"2024-09-11T00:23:50.870713+0000","last_became_active":"2024-09-11T00:23:38.920629+0000","last_became_peered":"2024-09-11T00:23:38.920629+0000","last_unstale":"2024-09-11T00:23:50.870713+0000","last_undegraded":"2024-09-11T00:23:50.870713+0000","last_fullsized":"2024-09-11T00:23:50.870713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_clean_scrub_stamp":"2024-09-11T00:23:37.844553+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.533941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934753+0000","last_change":"2024-09-11T00:23:47.922903+0000","last_active":"2024-09-11T00:23:49.934753+0000","last_peered":"2024-09-11T00:23:49.934753+0000","last_clean":"2024-09-11T00:23:49.934753+0000","last_became_active":"2024-09-11T00:23:47.921860+0000","last_became_peered":"2024-09-11T00:23:47.921860+0000","last_unstale":"2024-09-11T00:23:49.934753+0000","last_undegraded":"2024-09-11T00:23:49.934753+0000","last_fullsized":"2024-09-11T00:23:49.934753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:36.398079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869697+0000","last_change":"2024-09-11T00:23:48.943469+0000","last_active":"2024-09-11T00:23:50.869697+0000","last_peered":"2024-09-11T00:23:50.869697+0000","last_clean":"2024-09-11T00:23:50.869697+0000","last_became_active":"2024-09-11T00:23:48.939041+0000","last_became_peered":"2024-09-11T00:23:48.939041+0000","last_unstale":"2024-09-11T00:23:50.869697+0000","last_undegraded":"2024-09-11T00:23:50.869697+0000","last_fullsized":"2024-09-11T00:23:50.869697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:57.017486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870591+0000","last_change":"2024-09-11T00:23:47.938200+0000","last_active":"2024-09-11T00:23:50.870591+0000","last_peered":"2024-09-11T00:23:50.870591+0000","last_clean":"2024-09-11T00:23:50.870591+0000","last_became_active":"2024-09-11T00:23:47.937671+0000","last_became_peered":"2024-09-11T00:23:47.937671+0000","last_unstale":"2024-09-11T00:23:50.870591+0000","last_undegraded":"2024-09-11T00:23:50.870591+0000","last_fullsized":"2024-09-11T00:23:50.870591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:21.182195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526116+0000","last_change":"2024-09-11T00:23:48.933693+0000","last_active":"2024-09-11T00:23:50.526116+0000","last_peered":"2024-09-11T00:23:50.526116+0000","last_clean":"2024-09-11T00:23:50.526116+0000","last_became_active":"2024-09-11T00:23:48.933355+0000","last_became_peered":"2024-09-11T00:23:48.933355+0000","last_unstale":"2024-09-11T00:23:50.526116+0000","last_undegraded":"2024-09-11T00:23:50.526116+0000","last_fullsized":"2024-09-11T00:23:50.526116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:26.797108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713671+0000","last_change":"2024-09-11T00:23:47.929198+0000","last_active":"2024-09-11T00:23:50.713671+0000","last_peered":"2024-09-11T00:23:50.713671+0000","last_clean":"2024-09-11T00:23:50.713671+0000","last_became_active":"2024-09-11T00:23:47.928882+0000","last_became_peered":"2024-09-11T00:23:47.928882+0000","last_unstale":"2024-09-11T00:23:50.713671+0000","last_undegraded":"2024-09-11T00:23:50.713671+0000","last_fullsized":"2024-09-11T00:23:50.713671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:17.848252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933279+0000","last_change":"2024-09-11T00:23:48.932829+0000","last_active":"2024-09-11T00:23:49.933279+0000","last_peered":"2024-09-11T00:23:49.933279+0000","last_clean":"2024-09-11T00:23:49.933279+0000","last_became_active":"2024-09-11T00:23:48.932546+0000","last_became_peered":"2024-09-11T00:23:48.932546+0000","last_unstale":"2024-09-11T00:23:49.933279+0000","last_undegraded":"2024-09-11T00:23:49.933279+0000","last_fullsized":"2024-09-11T00:23:49.933279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:23.709720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935373+0000","last_change":"2024-09-11T00:23:47.917787+0000","last_active":"2024-09-11T00:23:49.935373+0000","last_peered":"2024-09-11T00:23:49.935373+0000","last_clean":"2024-09-11T00:23:49.935373+0000","last_became_active":"2024-09-11T00:23:47.916390+0000","last_became_peered":"2024-09-11T00:23:47.916390+0000","last_unstale":"2024-09-11T00:23:49.935373+0000","last_undegraded":"2024-09-11T00:23:49.935373+0000","last_fullsized":"2024-09-11T00:23:49.935373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:21.182195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935541+0000","last_change":"2024-09-11T00:23:48.936767+0000","last_active":"2024-09-11T00:23:49.935541+0000","last_peered":"2024-09-11T00:23:49.935541+0000","last_clean":"2024-09-11T00:23:49.935541+0000","last_became_active":"2024-09-11T00:23:48.936263+0000","last_became_peered":"2024-09-11T00:23:48.936263+0000","last_unstale":"2024-09-11T00:23:49.935541+0000","last_undegraded":"2024-09-11T00:23:49.935541+0000","last_fullsized":"2024-09-11T00:23:49.935541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:28.841981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933635+0000","last_change":"2024-09-11T00:23:47.930283+0000","last_active":"2024-09-11T00:23:49.933635+0000","last_peered":"2024-09-11T00:23:49.933635+0000","last_clean":"2024-09-11T00:23:49.933635+0000","last_became_active":"2024-09-11T00:23:47.930008+0000","last_became_peered":"2024-09-11T00:23:47.930008+0000","last_unstale":"2024-09-11T00:23:49.933635+0000","last_undegraded":"2024-09-11T00:23:49.933635+0000","last_fullsized":"2024-09-11T00:23:49.933635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:27.835276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935676+0000","last_change":"2024-09-11T00:23:48.929269+0000","last_active":"2024-09-11T00:23:49.935676+0000","last_peered":"2024-09-11T00:23:49.935676+0000","last_clean":"2024-09-11T00:23:49.935676+0000","last_became_active":"2024-09-11T00:23:48.928947+0000","last_became_peered":"2024-09-11T00:23:48.928947+0000","last_unstale":"2024-09-11T00:23:49.935676+0000","last_undegraded":"2024-09-11T00:23:49.935676+0000","last_fullsized":"2024-09-11T00:23:49.935676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:31.745356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871434+0000","last_change":"2024-09-11T00:23:47.940851+0000","last_active":"2024-09-11T00:23:50.871434+0000","last_peered":"2024-09-11T00:23:50.871434+0000","last_clean":"2024-09-11T00:23:50.871434+0000","last_became_active":"2024-09-11T00:23:47.940667+0000","last_became_peered":"2024-09-11T00:23:47.940667+0000","last_unstale":"2024-09-11T00:23:50.871434+0000","last_undegraded":"2024-09-11T00:23:50.871434+0000","last_fullsized":"2024-09-11T00:23:50.871434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:06.334712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933539+0000","last_change":"2024-09-11T00:23:48.928214+0000","last_active":"2024-09-11T00:23:49.933539+0000","last_peered":"2024-09-11T00:23:49.933539+0000","last_clean":"2024-09-11T00:23:49.933539+0000","last_became_active":"2024-09-11T00:23:48.927947+0000","last_became_peered":"2024-09-11T00:23:48.927947+0000","last_unstale":"2024-09-11T00:23:49.933539+0000","last_undegraded":"2024-09-11T00:23:49.933539+0000","last_fullsized":"2024-09-11T00:23:49.933539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:08:27.071042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934052+0000","last_change":"2024-09-11T00:23:47.935782+0000","last_active":"2024-09-11T00:23:49.934052+0000","last_peered":"2024-09-11T00:23:49.934052+0000","last_clean":"2024-09-11T00:23:49.934052+0000","last_became_active":"2024-09-11T00:23:47.935518+0000","last_became_peered":"2024-09-11T00:23:47.935518+0000","last_unstale":"2024-09-11T00:23:49.934052+0000","last_undegraded":"2024-09-11T00:23:49.934052+0000","last_fullsized":"2024-09-11T00:23:49.934052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:59.939503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870137+0000","last_change":"2024-09-11T00:23:48.942240+0000","last_active":"2024-09-11T00:23:50.870137+0000","last_peered":"2024-09-11T00:23:50.870137+0000","last_clean":"2024-09-11T00:23:50.870137+0000","last_became_active":"2024-09-11T00:23:48.941950+0000","last_became_peered":"2024-09-11T00:23:48.941950+0000","last_unstale":"2024-09-11T00:23:50.870137+0000","last_undegraded":"2024-09-11T00:23:50.870137+0000","last_fullsized":"2024-09-11T00:23:50.870137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:05.378796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871100+0000","last_change":"2024-09-11T00:23:47.940231+0000","last_active":"2024-09-11T00:23:50.871100+0000","last_peered":"2024-09-11T00:23:50.871100+0000","last_clean":"2024-09-11T00:23:50.871100+0000","last_became_active":"2024-09-11T00:23:47.939887+0000","last_became_peered":"2024-09-11T00:23:47.939887+0000","last_unstale":"2024-09-11T00:23:50.871100+0000","last_undegraded":"2024-09-11T00:23:50.871100+0000","last_fullsized":"2024-09-11T00:23:50.871100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:40.413211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526432+0000","last_change":"2024-09-11T00:23:48.948747+0000","last_active":"2024-09-11T00:23:50.526432+0000","last_peered":"2024-09-11T00:23:50.526432+0000","last_clean":"2024-09-11T00:23:50.526432+0000","last_became_active":"2024-09-11T00:23:48.948439+0000","last_became_peered":"2024-09-11T00:23:48.948439+0000","last_unstale":"2024-09-11T00:23:50.526432+0000","last_undegraded":"2024-09-11T00:23:50.526432+0000","last_fullsized":"2024-09-11T00:23:50.526432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:59.951812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870404+0000","last_change":"2024-09-11T00:23:47.938518+0000","last_active":"2024-09-11T00:23:50.870404+0000","last_peered":"2024-09-11T00:23:50.870404+0000","last_clean":"2024-09-11T00:23:50.870404+0000","last_became_active":"2024-09-11T00:23:47.937928+0000","last_became_peered":"2024-09-11T00:23:47.937928+0000","last_unstale":"2024-09-11T00:23:50.870404+0000","last_undegraded":"2024-09-11T00:23:50.870404+0000","last_fullsized":"2024-09-11T00:23:50.870404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:25.625230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934570+0000","last_change":"2024-09-11T00:23:48.929011+0000","last_active":"2024-09-11T00:23:49.934570+0000","last_peered":"2024-09-11T00:23:49.934570+0000","last_clean":"2024-09-11T00:23:49.934570+0000","last_became_active":"2024-09-11T00:23:48.927838+0000","last_became_peered":"2024-09-11T00:23:48.927838+0000","last_unstale":"2024-09-11T00:23:49.934570+0000","last_undegraded":"2024-09-11T00:23:49.934570+0000","last_fullsized":"2024-09-11T00:23:49.934570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:01.109766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933263+0000","last_change":"2024-09-11T00:23:47.930702+0000","last_active":"2024-09-11T00:23:49.933263+0000","last_peered":"2024-09-11T00:23:49.933263+0000","last_clean":"2024-09-11T00:23:49.933263+0000","last_became_active":"2024-09-11T00:23:47.930044+0000","last_became_peered":"2024-09-11T00:23:47.930044+0000","last_unstale":"2024-09-11T00:23:49.933263+0000","last_undegraded":"2024-09-11T00:23:49.933263+0000","last_fullsized":"2024-09-11T00:23:49.933263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:05.769710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869927+0000","last_change":"2024-09-11T00:23:48.932964+0000","last_active":"2024-09-11T00:23:50.869927+0000","last_peered":"2024-09-11T00:23:50.869927+0000","last_clean":"2024-09-11T00:23:50.869927+0000","last_became_active":"2024-09-11T00:23:48.932262+0000","last_became_peered":"2024-09-11T00:23:48.932262+0000","last_unstale":"2024-09-11T00:23:50.869927+0000","last_undegraded":"2024-09-11T00:23:50.869927+0000","last_fullsized":"2024-09-11T00:23:50.869927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:50.142533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933446+0000","last_change":"2024-09-11T00:23:47.924671+0000","last_active":"2024-09-11T00:23:49.933446+0000","last_peered":"2024-09-11T00:23:49.933446+0000","last_clean":"2024-09-11T00:23:49.933446+0000","last_became_active":"2024-09-11T00:23:47.924383+0000","last_became_peered":"2024-09-11T00:23:47.924383+0000","last_unstale":"2024-09-11T00:23:49.933446+0000","last_undegraded":"2024-09-11T00:23:49.933446+0000","last_fullsized":"2024-09-11T00:23:49.933446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:00.103061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869954+0000","last_change":"2024-09-11T00:23:48.949725+0000","last_active":"2024-09-11T00:23:50.869954+0000","last_peered":"2024-09-11T00:23:50.869954+0000","last_clean":"2024-09-11T00:23:50.869954+0000","last_became_active":"2024-09-11T00:23:48.949445+0000","last_became_peered":"2024-09-11T00:23:48.949445+0000","last_unstale":"2024-09-11T00:23:50.869954+0000","last_undegraded":"2024-09-11T00:23:50.869954+0000","last_fullsized":"2024-09-11T00:23:50.869954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:32.096363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871560+0000","last_change":"2024-09-11T00:23:47.940381+0000","last_active":"2024-09-11T00:23:50.871560+0000","last_peered":"2024-09-11T00:23:50.871560+0000","last_clean":"2024-09-11T00:23:50.871560+0000","last_became_active":"2024-09-11T00:23:47.940030+0000","last_became_peered":"2024-09-11T00:23:47.940030+0000","last_unstale":"2024-09-11T00:23:50.871560+0000","last_undegraded":"2024-09-11T00:23:50.871560+0000","last_fullsized":"2024-09-11T00:23:50.871560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:49.214733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870694+0000","last_change":"2024-09-11T00:23:48.934776+0000","last_active":"2024-09-11T00:23:50.870694+0000","last_peered":"2024-09-11T00:23:50.870694+0000","last_clean":"2024-09-11T00:23:50.870694+0000","last_became_active":"2024-09-11T00:23:48.925601+0000","last_became_peered":"2024-09-11T00:23:48.925601+0000","last_unstale":"2024-09-11T00:23:50.870694+0000","last_undegraded":"2024-09-11T00:23:50.870694+0000","last_fullsized":"2024-09-11T00:23:50.870694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:23.709720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935472+0000","last_change":"2024-09-11T00:23:48.921538+0000","last_active":"2024-09-11T00:23:49.935472+0000","last_peered":"2024-09-11T00:23:49.935472+0000","last_clean":"2024-09-11T00:23:49.935472+0000","last_became_active":"2024-09-11T00:23:48.921162+0000","last_became_peered":"2024-09-11T00:23:48.921162+0000","last_unstale":"2024-09-11T00:23:49.935472+0000","last_undegraded":"2024-09-11T00:23:49.935472+0000","last_fullsized":"2024-09-11T00:23:49.935472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:14:08.841886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871337+0000","last_change":"2024-09-11T00:23:47.938661+0000","last_active":"2024-09-11T00:23:50.871337+0000","last_peered":"2024-09-11T00:23:50.871337+0000","last_clean":"2024-09-11T00:23:50.871337+0000","last_became_active":"2024-09-11T00:23:47.937858+0000","last_became_peered":"2024-09-11T00:23:47.937858+0000","last_unstale":"2024-09-11T00:23:50.871337+0000","last_undegraded":"2024-09-11T00:23:50.871337+0000","last_fullsized":"2024-09-11T00:23:50.871337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:34.793911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935205+0000","last_change":"2024-09-11T00:23:48.916507+0000","last_active":"2024-09-11T00:23:49.935205+0000","last_peered":"2024-09-11T00:23:49.935205+0000","last_clean":"2024-09-11T00:23:49.935205+0000","last_became_active":"2024-09-11T00:23:48.916168+0000","last_became_peered":"2024-09-11T00:23:48.916168+0000","last_unstale":"2024-09-11T00:23:49.935205+0000","last_undegraded":"2024-09-11T00:23:49.935205+0000","last_fullsized":"2024-09-11T00:23:49.935205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:53.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871007+0000","last_change":"2024-09-11T00:23:47.941406+0000","last_active":"2024-09-11T00:23:50.871007+0000","last_peered":"2024-09-11T00:23:50.871007+0000","last_clean":"2024-09-11T00:23:50.871007+0000","last_became_active":"2024-09-11T00:23:47.940051+0000","last_became_peered":"2024-09-11T00:23:47.940051+0000","last_unstale":"2024-09-11T00:23:50.871007+0000","last_undegraded":"2024-09-11T00:23:50.871007+0000","last_fullsized":"2024-09-11T00:23:50.871007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:02.075049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526442+0000","last_change":"2024-09-11T00:23:48.925648+0000","last_active":"2024-09-11T00:23:50.526442+0000","last_peered":"2024-09-11T00:23:50.526442+0000","last_clean":"2024-09-11T00:23:50.526442+0000","last_became_active":"2024-09-11T00:23:48.924442+0000","last_became_peered":"2024-09-11T00:23:48.924442+0000","last_unstale":"2024-09-11T00:23:50.526442+0000","last_undegraded":"2024-09-11T00:23:50.526442+0000","last_fullsized":"2024-09-11T00:23:50.526442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:54.299102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870045+0000","last_change":"2024-09-11T00:23:47.932359+0000","last_active":"2024-09-11T00:23:50.870045+0000","last_peered":"2024-09-11T00:23:50.870045+0000","last_clean":"2024-09-11T00:23:50.870045+0000","last_became_active":"2024-09-11T00:23:47.932075+0000","last_became_peered":"2024-09-11T00:23:47.932075+0000","last_unstale":"2024-09-11T00:23:50.870045+0000","last_undegraded":"2024-09-11T00:23:50.870045+0000","last_fullsized":"2024-09-11T00:23:50.870045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:17.848252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870089+0000","last_change":"2024-09-11T00:23:48.939724+0000","last_active":"2024-09-11T00:23:50.870089+0000","last_peered":"2024-09-11T00:23:50.870089+0000","last_clean":"2024-09-11T00:23:50.870089+0000","last_became_active":"2024-09-11T00:23:48.939505+0000","last_became_peered":"2024-09-11T00:23:48.939505+0000","last_unstale":"2024-09-11T00:23:50.870089+0000","last_undegraded":"2024-09-11T00:23:50.870089+0000","last_fullsized":"2024-09-11T00:23:50.870089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:19.018125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526569+0000","last_change":"2024-09-11T00:23:47.940123+0000","last_active":"2024-09-11T00:23:50.526569+0000","last_peered":"2024-09-11T00:23:50.526569+0000","last_clean":"2024-09-11T00:23:50.526569+0000","last_became_active":"2024-09-11T00:23:47.939901+0000","last_became_peered":"2024-09-11T00:23:47.939901+0000","last_unstale":"2024-09-11T00:23:50.526569+0000","last_undegraded":"2024-09-11T00:23:50.526569+0000","last_fullsized":"2024-09-11T00:23:50.526569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:45.637790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":667234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":76410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":667290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:23:57.912 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:23:58.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.083+0000 7f1a0f200640 1 -- 172.21.15.40:0/377123103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19f4003c10 msgr2=0x7f19f4004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:58.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.083+0000 7f1a0f200640 1 --2- 172.21.15.40:0/377123103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19f4003c10 0x7f19f4004010 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1a00001830 tx=0x7f19f4005830 comp rx=0 tx=0).stop 2024-09-11T00:23:58.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.083+0000 7f1a0e800640 1 -- 172.21.15.40:0/377123103 reap_dead start 2024-09-11T00:23:58.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.083+0000 7f1a0f200640 1 -- 172.21.15.40:0/377123103 shutdown_connections 2024-09-11T00:23:58.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.083+0000 7f1a0f200640 1 -- 172.21.15.40:0/377123103 >> 172.21.15.40:0/377123103 conn(0x7f1a100cf770 msgr2=0x7f1a100cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:58.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.084+0000 7f1a0f200640 1 -- 172.21.15.40:0/377123103 shutdown_connections 2024-09-11T00:23:58.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.084+0000 7f1a0f200640 1 -- 172.21.15.40:0/377123103 wait complete. 2024-09-11T00:23:58.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.085+0000 7f1a0f200640 1 Processor -- start 2024-09-11T00:23:58.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.085+0000 7f1a0f200640 1 -- start start 2024-09-11T00:23:58.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.086+0000 7f1a0f200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19f4003c10 0x7f1a10151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:58.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.086+0000 7f1a0f200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a100c46f0 0x7f1a100c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:58.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.086+0000 7f1a0f200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a100af1f0 0x7f1a100af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.086+0000 7f1a0f200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1a100ceca0 con 0x7f19f4003c10 2024-09-11T00:23:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.086+0000 7f1a0f200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1a100ceb20 con 0x7f1a100af1f0 2024-09-11T00:23:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.086+0000 7f1a0f200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1a100cee20 con 0x7f1a100c46f0 2024-09-11T00:23:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.086+0000 7f1a0de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19f4003c10 0x7f1a10151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.086+0000 7f1a0de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19f4003c10 0x7f1a10151bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39368/0 (socket says 172.21.15.40:39368) 2024-09-11T00:23:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.086+0000 7f1a0de00640 1 -- 172.21.15.40:0/3135902624 learned_addr learned my addr 172.21.15.40:0/3135902624 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.087+0000 7f1a0e800640 1 --2- 172.21.15.40:0/3135902624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a100af1f0 0x7f1a100af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.087+0000 7f1a05400640 1 --2- 172.21.15.40:0/3135902624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a100c46f0 0x7f1a100c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.087+0000 7f1a0de00640 1 -- 172.21.15.40:0/3135902624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a100c46f0 msgr2=0x7f1a100c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.087+0000 7f1a0de00640 1 --2- 172.21.15.40:0/3135902624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a100c46f0 0x7f1a100c4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.087+0000 7f1a0de00640 1 -- 172.21.15.40:0/3135902624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a100af1f0 msgr2=0x7f1a100af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.087+0000 7f1a0de00640 1 --2- 172.21.15.40:0/3135902624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a100af1f0 0x7f1a100af670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.087+0000 7f1a0de00640 1 -- 172.21.15.40:0/3135902624 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a100b5030 con 0x7f19f4003c10 2024-09-11T00:23:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.087+0000 7f1a0de00640 1 --2- 172.21.15.40:0/3135902624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19f4003c10 0x7f1a10151bc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1a0002aa50 tx=0x7f1a000069d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:58.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.087+0000 7f1a06a00640 1 -- 172.21.15.40:0/3135902624 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a000037f0 con 0x7f19f4003c10 2024-09-11T00:23:58.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.087+0000 7f1a06a00640 1 -- 172.21.15.40:0/3135902624 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a00003a80 con 0x7f19f4003c10 2024-09-11T00:23:58.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.088+0000 7f1a06a00640 1 -- 172.21.15.40:0/3135902624 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a00033480 con 0x7f19f4003c10 2024-09-11T00:23:58.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.088+0000 7f1a0f200640 1 -- 172.21.15.40:0/3135902624 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a101f8260 con 0x7f19f4003c10 2024-09-11T00:23:58.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.088+0000 7f1a0f200640 1 -- 172.21.15.40:0/3135902624 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a101f8820 con 0x7f19f4003c10 2024-09-11T00:23:58.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.089+0000 7f1a0f200640 1 -- 172.21.15.40:0/3135902624 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a1006fa60 con 0x7f19f4003c10 2024-09-11T00:23:58.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.090+0000 7f1a06a00640 1 -- 172.21.15.40:0/3135902624 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1a00033620 con 0x7f19f4003c10 2024-09-11T00:23:58.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.091+0000 7f1a06a00640 1 --2- 172.21.15.40:0/3135902624 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f19ec077fa0 0x7f19ec07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:58.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.091+0000 7f1a06a00640 1 -- 172.21.15.40:0/3135902624 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1a000b9c90 con 0x7f19f4003c10 2024-09-11T00:23:58.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.091+0000 7f1a05400640 1 --2- 172.21.15.40:0/3135902624 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f19ec077fa0 0x7f19ec07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:58.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.092+0000 7f1a05400640 1 --2- 172.21.15.40:0/3135902624 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f19ec077fa0 0x7f19ec07a460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19f8001220 tx=0x7f19f80010b0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:58.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.095+0000 7f1a06a00640 1 -- 172.21.15.40:0/3135902624 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1a1006fa60 con 0x7f19f4003c10 2024-09-11T00:23:58.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.286+0000 7f1a0f200640 1 -- 172.21.15.40:0/3135902624 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a100b56f0 con 0x7f19ec077fa0 2024-09-11T00:23:58.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.291+0000 7f1a06a00640 1 -- 172.21.15.40:0/3135902624 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7f1a100b56f0 con 0x7f19ec077fa0 2024-09-11T00:23:58.295 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:23:58.297 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T00:23:58.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.295+0000 7f1a0f200640 1 -- 172.21.15.40:0/3135902624 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f19ec077fa0 msgr2=0x7f19ec07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:58.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.295+0000 7f1a0f200640 1 --2- 172.21.15.40:0/3135902624 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f19ec077fa0 0x7f19ec07a460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19f8001220 tx=0x7f19f80010b0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.295+0000 7f1a0f200640 1 -- 172.21.15.40:0/3135902624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19f4003c10 msgr2=0x7f1a10151bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:58.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.295+0000 7f1a0f200640 1 --2- 172.21.15.40:0/3135902624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19f4003c10 0x7f1a10151bc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1a0002aa50 tx=0x7f1a000069d0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.295+0000 7f1a0f200640 1 -- 172.21.15.40:0/3135902624 shutdown_connections 2024-09-11T00:23:58.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.295+0000 7f1a0f200640 1 --2- 172.21.15.40:0/3135902624 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f19ec077fa0 0x7f19ec07a460 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.295+0000 7f1a0f200640 1 --2- 172.21.15.40:0/3135902624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a100af1f0 0x7f1a100af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.295+0000 7f1a0f200640 1 --2- 172.21.15.40:0/3135902624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a100c46f0 0x7f1a100c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.295+0000 7f1a0f200640 1 --2- 172.21.15.40:0/3135902624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19f4003c10 0x7f1a10151bc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.295+0000 7f1a0f200640 1 -- 172.21.15.40:0/3135902624 >> 172.21.15.40:0/3135902624 conn(0x7f1a100cf770 msgr2=0x7f1a100cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:58.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.295+0000 7f1a0f200640 1 -- 172.21.15.40:0/3135902624 shutdown_connections 2024-09-11T00:23:58.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.295+0000 7f1a0f200640 1 -- 172.21.15.40:0/3135902624 wait complete. 2024-09-11T00:23:58.312 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-11T00:23:57.777776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219184,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755536,"statfs":{"total":773094113280,"available":772869668864,"internally_reserved":0,"allocated":3022848,"data_stored":1795828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.871190"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.872004+0000","last_change":"2024-09-11T00:23:48.948893+0000","last_active":"2024-09-11T00:23:50.872004+0000","last_peered":"2024-09-11T00:23:50.872004+0000","last_clean":"2024-09-11T00:23:50.872004+0000","last_became_active":"2024-09-11T00:23:48.948539+0000","last_became_peered":"2024-09-11T00:23:48.948539+0000","last_unstale":"2024-09-11T00:23:50.872004+0000","last_undegraded":"2024-09-11T00:23:50.872004+0000","last_fullsized":"2024-09-11T00:23:50.872004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:16.991662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934001+0000","last_change":"2024-09-11T00:23:48.937342+0000","last_active":"2024-09-11T00:23:49.934001+0000","last_peered":"2024-09-11T00:23:49.934001+0000","last_clean":"2024-09-11T00:23:49.934001+0000","last_became_active":"2024-09-11T00:23:48.936595+0000","last_became_peered":"2024-09-11T00:23:48.936595+0000","last_unstale":"2024-09-11T00:23:49.934001+0000","last_undegraded":"2024-09-11T00:23:49.934001+0000","last_fullsized":"2024-09-11T00:23:49.934001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:32.096363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526446+0000","last_change":"2024-09-11T00:23:48.937798+0000","last_active":"2024-09-11T00:23:50.526446+0000","last_peered":"2024-09-11T00:23:50.526446+0000","last_clean":"2024-09-11T00:23:50.526446+0000","last_became_active":"2024-09-11T00:23:48.937479+0000","last_became_peered":"2024-09-11T00:23:48.937479+0000","last_unstale":"2024-09-11T00:23:50.526446+0000","last_undegraded":"2024-09-11T00:23:50.526446+0000","last_fullsized":"2024-09-11T00:23:50.526446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:27.574913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935177+0000","last_change":"2024-09-11T00:23:48.931523+0000","last_active":"2024-09-11T00:23:49.935177+0000","last_peered":"2024-09-11T00:23:49.935177+0000","last_clean":"2024-09-11T00:23:49.935177+0000","last_became_active":"2024-09-11T00:23:48.930038+0000","last_became_peered":"2024-09-11T00:23:48.930038+0000","last_unstale":"2024-09-11T00:23:49.935177+0000","last_undegraded":"2024-09-11T00:23:49.935177+0000","last_fullsized":"2024-09-11T00:23:49.935177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:37.999694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871474+0000","last_change":"2024-09-11T00:23:48.936786+0000","last_active":"2024-09-11T00:23:50.871474+0000","last_peered":"2024-09-11T00:23:50.871474+0000","last_clean":"2024-09-11T00:23:50.871474+0000","last_became_active":"2024-09-11T00:23:48.936512+0000","last_became_peered":"2024-09-11T00:23:48.936512+0000","last_unstale":"2024-09-11T00:23:50.871474+0000","last_undegraded":"2024-09-11T00:23:50.871474+0000","last_fullsized":"2024-09-11T00:23:50.871474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:20.441191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934971+0000","last_change":"2024-09-11T00:23:48.935843+0000","last_active":"2024-09-11T00:23:49.934971+0000","last_peered":"2024-09-11T00:23:49.934971+0000","last_clean":"2024-09-11T00:23:49.934971+0000","last_became_active":"2024-09-11T00:23:48.935591+0000","last_became_peered":"2024-09-11T00:23:48.935591+0000","last_unstale":"2024-09-11T00:23:49.934971+0000","last_undegraded":"2024-09-11T00:23:49.934971+0000","last_fullsized":"2024-09-11T00:23:49.934971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:25.619010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870938+0000","last_change":"2024-09-11T00:23:48.939799+0000","last_active":"2024-09-11T00:23:50.870938+0000","last_peered":"2024-09-11T00:23:50.870938+0000","last_clean":"2024-09-11T00:23:50.870938+0000","last_became_active":"2024-09-11T00:23:48.939495+0000","last_became_peered":"2024-09-11T00:23:48.939495+0000","last_unstale":"2024-09-11T00:23:50.870938+0000","last_undegraded":"2024-09-11T00:23:50.870938+0000","last_fullsized":"2024-09-11T00:23:50.870938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:13.522317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869563+0000","last_change":"2024-09-11T00:23:48.933813+0000","last_active":"2024-09-11T00:23:50.869563+0000","last_peered":"2024-09-11T00:23:50.869563+0000","last_clean":"2024-09-11T00:23:50.869563+0000","last_became_active":"2024-09-11T00:23:48.932681+0000","last_became_peered":"2024-09-11T00:23:48.932681+0000","last_unstale":"2024-09-11T00:23:50.869563+0000","last_undegraded":"2024-09-11T00:23:50.869563+0000","last_fullsized":"2024-09-11T00:23:50.869563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:49.141326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.872030+0000","last_change":"2024-09-11T00:23:48.943035+0000","last_active":"2024-09-11T00:23:50.872030+0000","last_peered":"2024-09-11T00:23:50.872030+0000","last_clean":"2024-09-11T00:23:50.872030+0000","last_became_active":"2024-09-11T00:23:48.942299+0000","last_became_peered":"2024-09-11T00:23:48.942299+0000","last_unstale":"2024-09-11T00:23:50.872030+0000","last_undegraded":"2024-09-11T00:23:50.872030+0000","last_fullsized":"2024-09-11T00:23:50.872030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:04.169658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870722+0000","last_change":"2024-09-11T00:23:48.923914+0000","last_active":"2024-09-11T00:23:50.870722+0000","last_peered":"2024-09-11T00:23:50.870722+0000","last_clean":"2024-09-11T00:23:50.870722+0000","last_became_active":"2024-09-11T00:23:48.923637+0000","last_became_peered":"2024-09-11T00:23:48.923637+0000","last_unstale":"2024-09-11T00:23:50.870722+0000","last_undegraded":"2024-09-11T00:23:50.870722+0000","last_fullsized":"2024-09-11T00:23:50.870722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:08:27.071042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870678+0000","last_change":"2024-09-11T00:23:48.924320+0000","last_active":"2024-09-11T00:23:50.870678+0000","last_peered":"2024-09-11T00:23:50.870678+0000","last_clean":"2024-09-11T00:23:50.870678+0000","last_became_active":"2024-09-11T00:23:48.923963+0000","last_became_peered":"2024-09-11T00:23:48.923963+0000","last_unstale":"2024-09-11T00:23:50.870678+0000","last_undegraded":"2024-09-11T00:23:50.870678+0000","last_fullsized":"2024-09-11T00:23:50.870678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:57.017486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936400+0000","last_change":"2024-09-11T00:23:48.926315+0000","last_active":"2024-09-11T00:23:49.936400+0000","last_peered":"2024-09-11T00:23:49.936400+0000","last_clean":"2024-09-11T00:23:49.936400+0000","last_became_active":"2024-09-11T00:23:48.926023+0000","last_became_peered":"2024-09-11T00:23:48.926023+0000","last_unstale":"2024-09-11T00:23:49.936400+0000","last_undegraded":"2024-09-11T00:23:49.936400+0000","last_fullsized":"2024-09-11T00:23:49.936400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:53:00.946208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869742+0000","last_change":"2024-09-11T00:23:48.940397+0000","last_active":"2024-09-11T00:23:50.869742+0000","last_peered":"2024-09-11T00:23:50.869742+0000","last_clean":"2024-09-11T00:23:50.869742+0000","last_became_active":"2024-09-11T00:23:48.940131+0000","last_became_peered":"2024-09-11T00:23:48.940131+0000","last_unstale":"2024-09-11T00:23:50.869742+0000","last_undegraded":"2024-09-11T00:23:50.869742+0000","last_fullsized":"2024-09-11T00:23:50.869742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:08:27.071042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526136+0000","last_change":"2024-09-11T00:23:48.934059+0000","last_active":"2024-09-11T00:23:50.526136+0000","last_peered":"2024-09-11T00:23:50.526136+0000","last_clean":"2024-09-11T00:23:50.526136+0000","last_became_active":"2024-09-11T00:23:48.931545+0000","last_became_peered":"2024-09-11T00:23:48.931545+0000","last_unstale":"2024-09-11T00:23:50.526136+0000","last_undegraded":"2024-09-11T00:23:50.526136+0000","last_fullsized":"2024-09-11T00:23:50.526136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:22.406899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933205+0000","last_change":"2024-09-11T00:23:48.917392+0000","last_active":"2024-09-11T00:23:49.933205+0000","last_peered":"2024-09-11T00:23:49.933205+0000","last_clean":"2024-09-11T00:23:49.933205+0000","last_became_active":"2024-09-11T00:23:48.917076+0000","last_became_peered":"2024-09-11T00:23:48.917076+0000","last_unstale":"2024-09-11T00:23:49.933205+0000","last_undegraded":"2024-09-11T00:23:49.933205+0000","last_fullsized":"2024-09-11T00:23:49.933205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:33.143595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934240+0000","last_change":"2024-09-11T00:23:48.926949+0000","last_active":"2024-09-11T00:23:49.934240+0000","last_peered":"2024-09-11T00:23:49.934240+0000","last_clean":"2024-09-11T00:23:49.934240+0000","last_became_active":"2024-09-11T00:23:48.926624+0000","last_became_peered":"2024-09-11T00:23:48.926624+0000","last_unstale":"2024-09-11T00:23:49.934240+0000","last_undegraded":"2024-09-11T00:23:49.934240+0000","last_fullsized":"2024-09-11T00:23:49.934240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:40.283499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.937130+0000","last_change":"2024-09-11T00:23:48.927831+0000","last_active":"2024-09-11T00:23:49.937130+0000","last_peered":"2024-09-11T00:23:49.937130+0000","last_clean":"2024-09-11T00:23:49.937130+0000","last_became_active":"2024-09-11T00:23:48.927396+0000","last_became_peered":"2024-09-11T00:23:48.927396+0000","last_unstale":"2024-09-11T00:23:49.937130+0000","last_undegraded":"2024-09-11T00:23:49.937130+0000","last_fullsized":"2024-09-11T00:23:49.937130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:43.076990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713863+0000","last_change":"2024-09-11T00:23:48.925368+0000","last_active":"2024-09-11T00:23:50.713863+0000","last_peered":"2024-09-11T00:23:50.713863+0000","last_clean":"2024-09-11T00:23:50.713863+0000","last_became_active":"2024-09-11T00:23:48.925051+0000","last_became_peered":"2024-09-11T00:23:48.925051+0000","last_unstale":"2024-09-11T00:23:50.713863+0000","last_undegraded":"2024-09-11T00:23:50.713863+0000","last_fullsized":"2024-09-11T00:23:50.713863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:03.081754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871196+0000","last_change":"2024-09-11T00:23:48.945468+0000","last_active":"2024-09-11T00:23:50.871196+0000","last_peered":"2024-09-11T00:23:50.871196+0000","last_clean":"2024-09-11T00:23:50.871196+0000","last_became_active":"2024-09-11T00:23:48.944945+0000","last_became_peered":"2024-09-11T00:23:48.944945+0000","last_unstale":"2024-09-11T00:23:50.871196+0000","last_undegraded":"2024-09-11T00:23:50.871196+0000","last_fullsized":"2024-09-11T00:23:50.871196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:06.656916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870452+0000","last_change":"2024-09-11T00:23:48.921544+0000","last_active":"2024-09-11T00:23:50.870452+0000","last_peered":"2024-09-11T00:23:50.870452+0000","last_clean":"2024-09-11T00:23:50.870452+0000","last_became_active":"2024-09-11T00:23:48.921253+0000","last_became_peered":"2024-09-11T00:23:48.921253+0000","last_unstale":"2024-09-11T00:23:50.870452+0000","last_undegraded":"2024-09-11T00:23:50.870452+0000","last_fullsized":"2024-09-11T00:23:50.870452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:10.533107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526203+0000","last_change":"2024-09-11T00:23:48.942961+0000","last_active":"2024-09-11T00:23:50.526203+0000","last_peered":"2024-09-11T00:23:50.526203+0000","last_clean":"2024-09-11T00:23:50.526203+0000","last_became_active":"2024-09-11T00:23:48.941533+0000","last_became_peered":"2024-09-11T00:23:48.941533+0000","last_unstale":"2024-09-11T00:23:50.526203+0000","last_undegraded":"2024-09-11T00:23:50.526203+0000","last_fullsized":"2024-09-11T00:23:50.526203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:52.956083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935633+0000","last_change":"2024-09-11T00:23:48.935142+0000","last_active":"2024-09-11T00:23:49.935633+0000","last_peered":"2024-09-11T00:23:49.935633+0000","last_clean":"2024-09-11T00:23:49.935633+0000","last_became_active":"2024-09-11T00:23:48.933148+0000","last_became_peered":"2024-09-11T00:23:48.933148+0000","last_unstale":"2024-09-11T00:23:49.935633+0000","last_undegraded":"2024-09-11T00:23:49.935633+0000","last_fullsized":"2024-09-11T00:23:49.935633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:18:47.960332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869723+0000","last_change":"2024-09-11T00:23:48.929778+0000","last_active":"2024-09-11T00:23:50.869723+0000","last_peered":"2024-09-11T00:23:50.869723+0000","last_clean":"2024-09-11T00:23:50.869723+0000","last_became_active":"2024-09-11T00:23:48.928138+0000","last_became_peered":"2024-09-11T00:23:48.928138+0000","last_unstale":"2024-09-11T00:23:50.869723+0000","last_undegraded":"2024-09-11T00:23:50.869723+0000","last_fullsized":"2024-09-11T00:23:50.869723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:23.709720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934308+0000","last_change":"2024-09-11T00:23:48.947725+0000","last_active":"2024-09-11T00:23:49.934308+0000","last_peered":"2024-09-11T00:23:49.934308+0000","last_clean":"2024-09-11T00:23:49.934308+0000","last_became_active":"2024-09-11T00:23:48.947361+0000","last_became_peered":"2024-09-11T00:23:48.947361+0000","last_unstale":"2024-09-11T00:23:49.934308+0000","last_undegraded":"2024-09-11T00:23:49.934308+0000","last_fullsized":"2024-09-11T00:23:49.934308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:31.087205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870205+0000","last_change":"2024-09-11T00:23:48.944855+0000","last_active":"2024-09-11T00:23:50.870205+0000","last_peered":"2024-09-11T00:23:50.870205+0000","last_clean":"2024-09-11T00:23:50.870205+0000","last_became_active":"2024-09-11T00:23:48.944551+0000","last_became_peered":"2024-09-11T00:23:48.944551+0000","last_unstale":"2024-09-11T00:23:50.870205+0000","last_undegraded":"2024-09-11T00:23:50.870205+0000","last_fullsized":"2024-09-11T00:23:50.870205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:53.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870796+0000","last_change":"2024-09-11T00:23:48.937626+0000","last_active":"2024-09-11T00:23:50.870796+0000","last_peered":"2024-09-11T00:23:50.870796+0000","last_clean":"2024-09-11T00:23:50.870796+0000","last_became_active":"2024-09-11T00:23:48.937263+0000","last_became_peered":"2024-09-11T00:23:48.937263+0000","last_unstale":"2024-09-11T00:23:50.870796+0000","last_undegraded":"2024-09-11T00:23:50.870796+0000","last_fullsized":"2024-09-11T00:23:50.870796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:50.142533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933798+0000","last_change":"2024-09-11T00:23:48.928952+0000","last_active":"2024-09-11T00:23:49.933798+0000","last_peered":"2024-09-11T00:23:49.933798+0000","last_clean":"2024-09-11T00:23:49.933798+0000","last_became_active":"2024-09-11T00:23:48.928683+0000","last_became_peered":"2024-09-11T00:23:48.928683+0000","last_unstale":"2024-09-11T00:23:49.933798+0000","last_undegraded":"2024-09-11T00:23:49.933798+0000","last_fullsized":"2024-09-11T00:23:49.933798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:50.142533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870161+0000","last_change":"2024-09-11T00:23:48.929575+0000","last_active":"2024-09-11T00:23:50.870161+0000","last_peered":"2024-09-11T00:23:50.870161+0000","last_clean":"2024-09-11T00:23:50.870161+0000","last_became_active":"2024-09-11T00:23:48.928625+0000","last_became_peered":"2024-09-11T00:23:48.928625+0000","last_unstale":"2024-09-11T00:23:50.870161+0000","last_undegraded":"2024-09-11T00:23:50.870161+0000","last_fullsized":"2024-09-11T00:23:50.870161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:13.522317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526474+0000","last_change":"2024-09-11T00:23:48.947976+0000","last_active":"2024-09-11T00:23:50.526474+0000","last_peered":"2024-09-11T00:23:50.526474+0000","last_clean":"2024-09-11T00:23:50.526474+0000","last_became_active":"2024-09-11T00:23:48.947725+0000","last_became_peered":"2024-09-11T00:23:48.947725+0000","last_unstale":"2024-09-11T00:23:50.526474+0000","last_undegraded":"2024-09-11T00:23:50.526474+0000","last_fullsized":"2024-09-11T00:23:50.526474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:09:52.162272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935202+0000","last_change":"2024-09-11T00:23:48.930538+0000","last_active":"2024-09-11T00:23:49.935202+0000","last_peered":"2024-09-11T00:23:49.935202+0000","last_clean":"2024-09-11T00:23:49.935202+0000","last_became_active":"2024-09-11T00:23:48.930224+0000","last_became_peered":"2024-09-11T00:23:48.930224+0000","last_unstale":"2024-09-11T00:23:49.935202+0000","last_undegraded":"2024-09-11T00:23:49.935202+0000","last_fullsized":"2024-09-11T00:23:49.935202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:18.427715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713776+0000","last_change":"2024-09-11T00:23:48.927566+0000","last_active":"2024-09-11T00:23:50.713776+0000","last_peered":"2024-09-11T00:23:50.713776+0000","last_clean":"2024-09-11T00:23:50.713776+0000","last_became_active":"2024-09-11T00:23:48.927306+0000","last_became_peered":"2024-09-11T00:23:48.927306+0000","last_unstale":"2024-09-11T00:23:50.713776+0000","last_undegraded":"2024-09-11T00:23:50.713776+0000","last_fullsized":"2024-09-11T00:23:50.713776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:35.800616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870322+0000","last_change":"2024-09-11T00:23:48.926632+0000","last_active":"2024-09-11T00:23:50.870322+0000","last_peered":"2024-09-11T00:23:50.870322+0000","last_clean":"2024-09-11T00:23:50.870322+0000","last_became_active":"2024-09-11T00:23:48.926014+0000","last_became_peered":"2024-09-11T00:23:48.926014+0000","last_unstale":"2024-09-11T00:23:50.870322+0000","last_undegraded":"2024-09-11T00:23:50.870322+0000","last_fullsized":"2024-09-11T00:23:50.870322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:49.141326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936248+0000","last_change":"2024-09-11T00:23:48.925940+0000","last_active":"2024-09-11T00:23:49.936248+0000","last_peered":"2024-09-11T00:23:49.936248+0000","last_clean":"2024-09-11T00:23:49.936248+0000","last_became_active":"2024-09-11T00:23:48.925589+0000","last_became_peered":"2024-09-11T00:23:48.925589+0000","last_unstale":"2024-09-11T00:23:49.936248+0000","last_undegraded":"2024-09-11T00:23:49.936248+0000","last_fullsized":"2024-09-11T00:23:49.936248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:41.419916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869814+0000","last_change":"2024-09-11T00:23:47.934229+0000","last_active":"2024-09-11T00:23:50.869814+0000","last_peered":"2024-09-11T00:23:50.869814+0000","last_clean":"2024-09-11T00:23:50.869814+0000","last_became_active":"2024-09-11T00:23:47.933880+0000","last_became_peered":"2024-09-11T00:23:47.933880+0000","last_unstale":"2024-09-11T00:23:50.869814+0000","last_undegraded":"2024-09-11T00:23:50.869814+0000","last_fullsized":"2024-09-11T00:23:50.869814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:30.892853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526491+0000","last_change":"2024-09-11T00:23:48.934481+0000","last_active":"2024-09-11T00:23:50.526491+0000","last_peered":"2024-09-11T00:23:50.526491+0000","last_clean":"2024-09-11T00:23:50.526491+0000","last_became_active":"2024-09-11T00:23:48.931082+0000","last_became_peered":"2024-09-11T00:23:48.931082+0000","last_unstale":"2024-09-11T00:23:50.526491+0000","last_undegraded":"2024-09-11T00:23:50.526491+0000","last_fullsized":"2024-09-11T00:23:50.526491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:04.133148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870136+0000","last_change":"2024-09-11T00:23:47.933078+0000","last_active":"2024-09-11T00:23:50.870136+0000","last_peered":"2024-09-11T00:23:50.870136+0000","last_clean":"2024-09-11T00:23:50.870136+0000","last_became_active":"2024-09-11T00:23:47.932815+0000","last_became_peered":"2024-09-11T00:23:47.932815+0000","last_unstale":"2024-09-11T00:23:50.870136+0000","last_undegraded":"2024-09-11T00:23:50.870136+0000","last_fullsized":"2024-09-11T00:23:50.870136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:00.103061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869652+0000","last_change":"2024-09-11T00:23:47.927116+0000","last_active":"2024-09-11T00:23:50.869652+0000","last_peered":"2024-09-11T00:23:50.869652+0000","last_clean":"2024-09-11T00:23:50.869652+0000","last_became_active":"2024-09-11T00:23:47.926760+0000","last_became_peered":"2024-09-11T00:23:47.926760+0000","last_unstale":"2024-09-11T00:23:50.869652+0000","last_undegraded":"2024-09-11T00:23:50.869652+0000","last_fullsized":"2024-09-11T00:23:50.869652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:14:45.347474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869585+0000","last_change":"2024-09-11T00:23:48.947208+0000","last_active":"2024-09-11T00:23:50.869585+0000","last_peered":"2024-09-11T00:23:50.869585+0000","last_clean":"2024-09-11T00:23:50.869585+0000","last_became_active":"2024-09-11T00:23:48.946963+0000","last_became_peered":"2024-09-11T00:23:48.946963+0000","last_unstale":"2024-09-11T00:23:50.869585+0000","last_undegraded":"2024-09-11T00:23:50.869585+0000","last_fullsized":"2024-09-11T00:23:50.869585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:10.533107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934435+0000","last_change":"2024-09-11T00:23:47.924168+0000","last_active":"2024-09-11T00:23:49.934435+0000","last_peered":"2024-09-11T00:23:49.934435+0000","last_clean":"2024-09-11T00:23:49.934435+0000","last_became_active":"2024-09-11T00:23:47.923810+0000","last_became_peered":"2024-09-11T00:23:47.923810+0000","last_unstale":"2024-09-11T00:23:49.934435+0000","last_undegraded":"2024-09-11T00:23:49.934435+0000","last_fullsized":"2024-09-11T00:23:49.934435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:09.057962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933208+0000","last_change":"2024-09-11T00:23:48.932214+0000","last_active":"2024-09-11T00:23:49.933208+0000","last_peered":"2024-09-11T00:23:49.933208+0000","last_clean":"2024-09-11T00:23:49.933208+0000","last_became_active":"2024-09-11T00:23:48.931946+0000","last_became_peered":"2024-09-11T00:23:48.931946+0000","last_unstale":"2024-09-11T00:23:49.933208+0000","last_undegraded":"2024-09-11T00:23:49.933208+0000","last_fullsized":"2024-09-11T00:23:49.933208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:10.533107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871004+0000","last_change":"2024-09-11T00:23:47.929315+0000","last_active":"2024-09-11T00:23:50.871004+0000","last_peered":"2024-09-11T00:23:50.871004+0000","last_clean":"2024-09-11T00:23:50.871004+0000","last_became_active":"2024-09-11T00:23:47.928873+0000","last_became_peered":"2024-09-11T00:23:47.928873+0000","last_unstale":"2024-09-11T00:23:50.871004+0000","last_undegraded":"2024-09-11T00:23:50.871004+0000","last_fullsized":"2024-09-11T00:23:50.871004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:27.835276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935414+0000","last_change":"2024-09-11T00:23:48.933958+0000","last_active":"2024-09-11T00:23:49.935414+0000","last_peered":"2024-09-11T00:23:49.935414+0000","last_clean":"2024-09-11T00:23:49.935414+0000","last_became_active":"2024-09-11T00:23:48.933311+0000","last_became_peered":"2024-09-11T00:23:48.933311+0000","last_unstale":"2024-09-11T00:23:49.935414+0000","last_undegraded":"2024-09-11T00:23:49.935414+0000","last_fullsized":"2024-09-11T00:23:49.935414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:48.420430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936215+0000","last_change":"2024-09-11T00:23:47.936415+0000","last_active":"2024-09-11T00:23:49.936215+0000","last_peered":"2024-09-11T00:23:49.936215+0000","last_clean":"2024-09-11T00:23:49.936215+0000","last_became_active":"2024-09-11T00:23:47.935508+0000","last_became_peered":"2024-09-11T00:23:47.935508+0000","last_unstale":"2024-09-11T00:23:49.936215+0000","last_undegraded":"2024-09-11T00:23:49.936215+0000","last_fullsized":"2024-09-11T00:23:49.936215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:14:04.971648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526665+0000","last_change":"2024-09-11T00:23:48.925280+0000","last_active":"2024-09-11T00:23:50.526665+0000","last_peered":"2024-09-11T00:23:50.526665+0000","last_clean":"2024-09-11T00:23:50.526665+0000","last_became_active":"2024-09-11T00:23:48.923558+0000","last_became_peered":"2024-09-11T00:23:48.923558+0000","last_unstale":"2024-09-11T00:23:50.526665+0000","last_undegraded":"2024-09-11T00:23:50.526665+0000","last_fullsized":"2024-09-11T00:23:50.526665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:51.437783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933648+0000","last_change":"2024-09-11T00:23:47.917495+0000","last_active":"2024-09-11T00:23:49.933648+0000","last_peered":"2024-09-11T00:23:49.933648+0000","last_clean":"2024-09-11T00:23:49.933648+0000","last_became_active":"2024-09-11T00:23:47.917190+0000","last_became_peered":"2024-09-11T00:23:47.917190+0000","last_unstale":"2024-09-11T00:23:49.933648+0000","last_undegraded":"2024-09-11T00:23:49.933648+0000","last_fullsized":"2024-09-11T00:23:49.933648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:40.413211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936314+0000","last_change":"2024-09-11T00:23:48.931464+0000","last_active":"2024-09-11T00:23:49.936314+0000","last_peered":"2024-09-11T00:23:49.936314+0000","last_clean":"2024-09-11T00:23:49.936314+0000","last_became_active":"2024-09-11T00:23:48.929780+0000","last_became_peered":"2024-09-11T00:23:48.929780+0000","last_unstale":"2024-09-11T00:23:49.936314+0000","last_undegraded":"2024-09-11T00:23:49.936314+0000","last_fullsized":"2024-09-11T00:23:49.936314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:06.878857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870468+0000","last_change":"2024-09-11T00:23:47.929964+0000","last_active":"2024-09-11T00:23:50.870468+0000","last_peered":"2024-09-11T00:23:50.870468+0000","last_clean":"2024-09-11T00:23:50.870468+0000","last_became_active":"2024-09-11T00:23:47.929635+0000","last_became_peered":"2024-09-11T00:23:47.929635+0000","last_unstale":"2024-09-11T00:23:50.870468+0000","last_undegraded":"2024-09-11T00:23:50.870468+0000","last_fullsized":"2024-09-11T00:23:50.870468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:05.769710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870963+0000","last_change":"2024-09-11T00:23:48.946941+0000","last_active":"2024-09-11T00:23:50.870963+0000","last_peered":"2024-09-11T00:23:50.870963+0000","last_clean":"2024-09-11T00:23:50.870963+0000","last_became_active":"2024-09-11T00:23:48.946690+0000","last_became_peered":"2024-09-11T00:23:48.946690+0000","last_unstale":"2024-09-11T00:23:50.870963+0000","last_undegraded":"2024-09-11T00:23:50.870963+0000","last_fullsized":"2024-09-11T00:23:50.870963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:18.427715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526613+0000","last_change":"2024-09-11T00:23:47.931967+0000","last_active":"2024-09-11T00:23:50.526613+0000","last_peered":"2024-09-11T00:23:50.526613+0000","last_clean":"2024-09-11T00:23:50.526613+0000","last_became_active":"2024-09-11T00:23:47.929613+0000","last_became_peered":"2024-09-11T00:23:47.929613+0000","last_unstale":"2024-09-11T00:23:50.526613+0000","last_undegraded":"2024-09-11T00:23:50.526613+0000","last_fullsized":"2024-09-11T00:23:50.526613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:07.537335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526168+0000","last_change":"2024-09-11T00:23:48.942082+0000","last_active":"2024-09-11T00:23:50.526168+0000","last_peered":"2024-09-11T00:23:50.526168+0000","last_clean":"2024-09-11T00:23:50.526168+0000","last_became_active":"2024-09-11T00:23:48.941719+0000","last_became_peered":"2024-09-11T00:23:48.941719+0000","last_unstale":"2024-09-11T00:23:50.526168+0000","last_undegraded":"2024-09-11T00:23:50.526168+0000","last_fullsized":"2024-09-11T00:23:50.526168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:12.862149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935272+0000","last_change":"2024-09-11T00:23:47.923106+0000","last_active":"2024-09-11T00:23:49.935272+0000","last_peered":"2024-09-11T00:23:49.935272+0000","last_clean":"2024-09-11T00:23:49.935272+0000","last_became_active":"2024-09-11T00:23:47.922184+0000","last_became_peered":"2024-09-11T00:23:47.922184+0000","last_unstale":"2024-09-11T00:23:49.935272+0000","last_undegraded":"2024-09-11T00:23:49.935272+0000","last_fullsized":"2024-09-11T00:23:49.935272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:25.625230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871459+0000","last_change":"2024-09-11T00:23:48.944533+0000","last_active":"2024-09-11T00:23:50.871459+0000","last_peered":"2024-09-11T00:23:50.871459+0000","last_clean":"2024-09-11T00:23:50.871459+0000","last_became_active":"2024-09-11T00:23:48.943682+0000","last_became_peered":"2024-09-11T00:23:48.943682+0000","last_unstale":"2024-09-11T00:23:50.871459+0000","last_undegraded":"2024-09-11T00:23:50.871459+0000","last_fullsized":"2024-09-11T00:23:50.871459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:30.501339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870124+0000","last_change":"2024-09-11T00:23:47.927380+0000","last_active":"2024-09-11T00:23:50.870124+0000","last_peered":"2024-09-11T00:23:50.870124+0000","last_clean":"2024-09-11T00:23:50.870124+0000","last_became_active":"2024-09-11T00:23:47.926325+0000","last_became_peered":"2024-09-11T00:23:47.926325+0000","last_unstale":"2024-09-11T00:23:50.870124+0000","last_undegraded":"2024-09-11T00:23:50.870124+0000","last_fullsized":"2024-09-11T00:23:50.870124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:17.848252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871625+0000","last_change":"2024-09-11T00:23:48.926985+0000","last_active":"2024-09-11T00:23:50.871625+0000","last_peered":"2024-09-11T00:23:50.871625+0000","last_clean":"2024-09-11T00:23:50.871625+0000","last_became_active":"2024-09-11T00:23:48.926337+0000","last_became_peered":"2024-09-11T00:23:48.926337+0000","last_unstale":"2024-09-11T00:23:50.871625+0000","last_undegraded":"2024-09-11T00:23:50.871625+0000","last_fullsized":"2024-09-11T00:23:50.871625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:32.096363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713565+0000","last_change":"2024-09-11T00:23:47.923036+0000","last_active":"2024-09-11T00:23:50.713565+0000","last_peered":"2024-09-11T00:23:50.713565+0000","last_clean":"2024-09-11T00:23:50.713565+0000","last_became_active":"2024-09-11T00:23:47.921195+0000","last_became_peered":"2024-09-11T00:23:47.921195+0000","last_unstale":"2024-09-11T00:23:50.713565+0000","last_undegraded":"2024-09-11T00:23:50.713565+0000","last_fullsized":"2024-09-11T00:23:50.713565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:14:45.347474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871089+0000","last_change":"2024-09-11T00:23:48.943396+0000","last_active":"2024-09-11T00:23:50.871089+0000","last_peered":"2024-09-11T00:23:50.871089+0000","last_clean":"2024-09-11T00:23:50.871089+0000","last_became_active":"2024-09-11T00:23:48.943075+0000","last_became_peered":"2024-09-11T00:23:48.943075+0000","last_unstale":"2024-09-11T00:23:50.871089+0000","last_undegraded":"2024-09-11T00:23:50.871089+0000","last_fullsized":"2024-09-11T00:23:50.871089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:52.627600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936327+0000","last_change":"2024-09-11T00:23:47.927064+0000","last_active":"2024-09-11T00:23:49.936327+0000","last_peered":"2024-09-11T00:23:49.936327+0000","last_clean":"2024-09-11T00:23:49.936327+0000","last_became_active":"2024-09-11T00:23:47.926712+0000","last_became_peered":"2024-09-11T00:23:47.926712+0000","last_unstale":"2024-09-11T00:23:49.936327+0000","last_undegraded":"2024-09-11T00:23:49.936327+0000","last_fullsized":"2024-09-11T00:23:49.936327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:04.442035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871836+0000","last_change":"2024-09-11T00:23:48.944697+0000","last_active":"2024-09-11T00:23:50.871836+0000","last_peered":"2024-09-11T00:23:50.871836+0000","last_clean":"2024-09-11T00:23:50.871836+0000","last_became_active":"2024-09-11T00:23:48.944401+0000","last_became_peered":"2024-09-11T00:23:48.944401+0000","last_unstale":"2024-09-11T00:23:50.871836+0000","last_undegraded":"2024-09-11T00:23:50.871836+0000","last_fullsized":"2024-09-11T00:23:50.871836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:37.819167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713804+0000","last_change":"2024-09-11T00:23:47.925285+0000","last_active":"2024-09-11T00:23:50.713804+0000","last_peered":"2024-09-11T00:23:50.713804+0000","last_clean":"2024-09-11T00:23:50.713804+0000","last_became_active":"2024-09-11T00:23:47.923814+0000","last_became_peered":"2024-09-11T00:23:47.923814+0000","last_unstale":"2024-09-11T00:23:50.713804+0000","last_undegraded":"2024-09-11T00:23:50.713804+0000","last_fullsized":"2024-09-11T00:23:50.713804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:05.769710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.872231+0000","last_change":"2024-09-11T00:23:48.943572+0000","last_active":"2024-09-11T00:23:50.872231+0000","last_peered":"2024-09-11T00:23:50.872231+0000","last_clean":"2024-09-11T00:23:50.872231+0000","last_became_active":"2024-09-11T00:23:48.943332+0000","last_became_peered":"2024-09-11T00:23:48.943332+0000","last_unstale":"2024-09-11T00:23:50.872231+0000","last_undegraded":"2024-09-11T00:23:50.872231+0000","last_fullsized":"2024-09-11T00:23:50.872231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:27.017230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933857+0000","last_change":"2024-09-11T00:23:47.916785+0000","last_active":"2024-09-11T00:23:49.933857+0000","last_peered":"2024-09-11T00:23:49.933857+0000","last_clean":"2024-09-11T00:23:49.933857+0000","last_became_active":"2024-09-11T00:23:47.916497+0000","last_became_peered":"2024-09-11T00:23:47.916497+0000","last_unstale":"2024-09-11T00:23:49.933857+0000","last_undegraded":"2024-09-11T00:23:49.933857+0000","last_fullsized":"2024-09-11T00:23:49.933857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:05.872152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935575+0000","last_change":"2024-09-11T00:23:48.930287+0000","last_active":"2024-09-11T00:23:49.935575+0000","last_peered":"2024-09-11T00:23:49.935575+0000","last_clean":"2024-09-11T00:23:49.935575+0000","last_became_active":"2024-09-11T00:23:48.929725+0000","last_became_peered":"2024-09-11T00:23:48.929725+0000","last_unstale":"2024-09-11T00:23:49.935575+0000","last_undegraded":"2024-09-11T00:23:49.935575+0000","last_fullsized":"2024-09-11T00:23:49.935575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:27.758680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713703+0000","last_change":"2024-09-11T00:23:47.921536+0000","last_active":"2024-09-11T00:23:50.713703+0000","last_peered":"2024-09-11T00:23:50.713703+0000","last_clean":"2024-09-11T00:23:50.713703+0000","last_became_active":"2024-09-11T00:23:47.921189+0000","last_became_peered":"2024-09-11T00:23:47.921189+0000","last_unstale":"2024-09-11T00:23:50.713703+0000","last_undegraded":"2024-09-11T00:23:50.713703+0000","last_fullsized":"2024-09-11T00:23:50.713703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:00.103061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870954+0000","last_change":"2024-09-11T00:23:48.938303+0000","last_active":"2024-09-11T00:23:50.870954+0000","last_peered":"2024-09-11T00:23:50.870954+0000","last_clean":"2024-09-11T00:23:50.870954+0000","last_became_active":"2024-09-11T00:23:48.938020+0000","last_became_peered":"2024-09-11T00:23:48.938020+0000","last_unstale":"2024-09-11T00:23:50.870954+0000","last_undegraded":"2024-09-11T00:23:50.870954+0000","last_fullsized":"2024-09-11T00:23:50.870954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:27:37.871843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870713+0000","last_change":"2024-09-11T00:23:38.923873+0000","last_active":"2024-09-11T00:23:50.870713+0000","last_peered":"2024-09-11T00:23:50.870713+0000","last_clean":"2024-09-11T00:23:50.870713+0000","last_became_active":"2024-09-11T00:23:38.920629+0000","last_became_peered":"2024-09-11T00:23:38.920629+0000","last_unstale":"2024-09-11T00:23:50.870713+0000","last_undegraded":"2024-09-11T00:23:50.870713+0000","last_fullsized":"2024-09-11T00:23:50.870713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_clean_scrub_stamp":"2024-09-11T00:23:37.844553+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.533941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934753+0000","last_change":"2024-09-11T00:23:47.922903+0000","last_active":"2024-09-11T00:23:49.934753+0000","last_peered":"2024-09-11T00:23:49.934753+0000","last_clean":"2024-09-11T00:23:49.934753+0000","last_became_active":"2024-09-11T00:23:47.921860+0000","last_became_peered":"2024-09-11T00:23:47.921860+0000","last_unstale":"2024-09-11T00:23:49.934753+0000","last_undegraded":"2024-09-11T00:23:49.934753+0000","last_fullsized":"2024-09-11T00:23:49.934753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:36.398079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869697+0000","last_change":"2024-09-11T00:23:48.943469+0000","last_active":"2024-09-11T00:23:50.869697+0000","last_peered":"2024-09-11T00:23:50.869697+0000","last_clean":"2024-09-11T00:23:50.869697+0000","last_became_active":"2024-09-11T00:23:48.939041+0000","last_became_peered":"2024-09-11T00:23:48.939041+0000","last_unstale":"2024-09-11T00:23:50.869697+0000","last_undegraded":"2024-09-11T00:23:50.869697+0000","last_fullsized":"2024-09-11T00:23:50.869697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:57.017486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870591+0000","last_change":"2024-09-11T00:23:47.938200+0000","last_active":"2024-09-11T00:23:50.870591+0000","last_peered":"2024-09-11T00:23:50.870591+0000","last_clean":"2024-09-11T00:23:50.870591+0000","last_became_active":"2024-09-11T00:23:47.937671+0000","last_became_peered":"2024-09-11T00:23:47.937671+0000","last_unstale":"2024-09-11T00:23:50.870591+0000","last_undegraded":"2024-09-11T00:23:50.870591+0000","last_fullsized":"2024-09-11T00:23:50.870591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:21.182195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526116+0000","last_change":"2024-09-11T00:23:48.933693+0000","last_active":"2024-09-11T00:23:50.526116+0000","last_peered":"2024-09-11T00:23:50.526116+0000","last_clean":"2024-09-11T00:23:50.526116+0000","last_became_active":"2024-09-11T00:23:48.933355+0000","last_became_peered":"2024-09-11T00:23:48.933355+0000","last_unstale":"2024-09-11T00:23:50.526116+0000","last_undegraded":"2024-09-11T00:23:50.526116+0000","last_fullsized":"2024-09-11T00:23:50.526116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:26.797108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713671+0000","last_change":"2024-09-11T00:23:47.929198+0000","last_active":"2024-09-11T00:23:50.713671+0000","last_peered":"2024-09-11T00:23:50.713671+0000","last_clean":"2024-09-11T00:23:50.713671+0000","last_became_active":"2024-09-11T00:23:47.928882+0000","last_became_peered":"2024-09-11T00:23:47.928882+0000","last_unstale":"2024-09-11T00:23:50.713671+0000","last_undegraded":"2024-09-11T00:23:50.713671+0000","last_fullsized":"2024-09-11T00:23:50.713671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:17.848252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933279+0000","last_change":"2024-09-11T00:23:48.932829+0000","last_active":"2024-09-11T00:23:49.933279+0000","last_peered":"2024-09-11T00:23:49.933279+0000","last_clean":"2024-09-11T00:23:49.933279+0000","last_became_active":"2024-09-11T00:23:48.932546+0000","last_became_peered":"2024-09-11T00:23:48.932546+0000","last_unstale":"2024-09-11T00:23:49.933279+0000","last_undegraded":"2024-09-11T00:23:49.933279+0000","last_fullsized":"2024-09-11T00:23:49.933279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:23.709720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935373+0000","last_change":"2024-09-11T00:23:47.917787+0000","last_active":"2024-09-11T00:23:49.935373+0000","last_peered":"2024-09-11T00:23:49.935373+0000","last_clean":"2024-09-11T00:23:49.935373+0000","last_became_active":"2024-09-11T00:23:47.916390+0000","last_became_peered":"2024-09-11T00:23:47.916390+0000","last_unstale":"2024-09-11T00:23:49.935373+0000","last_undegraded":"2024-09-11T00:23:49.935373+0000","last_fullsized":"2024-09-11T00:23:49.935373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:21.182195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935541+0000","last_change":"2024-09-11T00:23:48.936767+0000","last_active":"2024-09-11T00:23:49.935541+0000","last_peered":"2024-09-11T00:23:49.935541+0000","last_clean":"2024-09-11T00:23:49.935541+0000","last_became_active":"2024-09-11T00:23:48.936263+0000","last_became_peered":"2024-09-11T00:23:48.936263+0000","last_unstale":"2024-09-11T00:23:49.935541+0000","last_undegraded":"2024-09-11T00:23:49.935541+0000","last_fullsized":"2024-09-11T00:23:49.935541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:28.841981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933635+0000","last_change":"2024-09-11T00:23:47.930283+0000","last_active":"2024-09-11T00:23:49.933635+0000","last_peered":"2024-09-11T00:23:49.933635+0000","last_clean":"2024-09-11T00:23:49.933635+0000","last_became_active":"2024-09-11T00:23:47.930008+0000","last_became_peered":"2024-09-11T00:23:47.930008+0000","last_unstale":"2024-09-11T00:23:49.933635+0000","last_undegraded":"2024-09-11T00:23:49.933635+0000","last_fullsized":"2024-09-11T00:23:49.933635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:27.835276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935676+0000","last_change":"2024-09-11T00:23:48.929269+0000","last_active":"2024-09-11T00:23:49.935676+0000","last_peered":"2024-09-11T00:23:49.935676+0000","last_clean":"2024-09-11T00:23:49.935676+0000","last_became_active":"2024-09-11T00:23:48.928947+0000","last_became_peered":"2024-09-11T00:23:48.928947+0000","last_unstale":"2024-09-11T00:23:49.935676+0000","last_undegraded":"2024-09-11T00:23:49.935676+0000","last_fullsized":"2024-09-11T00:23:49.935676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:31.745356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871434+0000","last_change":"2024-09-11T00:23:47.940851+0000","last_active":"2024-09-11T00:23:50.871434+0000","last_peered":"2024-09-11T00:23:50.871434+0000","last_clean":"2024-09-11T00:23:50.871434+0000","last_became_active":"2024-09-11T00:23:47.940667+0000","last_became_peered":"2024-09-11T00:23:47.940667+0000","last_unstale":"2024-09-11T00:23:50.871434+0000","last_undegraded":"2024-09-11T00:23:50.871434+0000","last_fullsized":"2024-09-11T00:23:50.871434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:06.334712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933539+0000","last_change":"2024-09-11T00:23:48.928214+0000","last_active":"2024-09-11T00:23:49.933539+0000","last_peered":"2024-09-11T00:23:49.933539+0000","last_clean":"2024-09-11T00:23:49.933539+0000","last_became_active":"2024-09-11T00:23:48.927947+0000","last_became_peered":"2024-09-11T00:23:48.927947+0000","last_unstale":"2024-09-11T00:23:49.933539+0000","last_undegraded":"2024-09-11T00:23:49.933539+0000","last_fullsized":"2024-09-11T00:23:49.933539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:08:27.071042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934052+0000","last_change":"2024-09-11T00:23:47.935782+0000","last_active":"2024-09-11T00:23:49.934052+0000","last_peered":"2024-09-11T00:23:49.934052+0000","last_clean":"2024-09-11T00:23:49.934052+0000","last_became_active":"2024-09-11T00:23:47.935518+0000","last_became_peered":"2024-09-11T00:23:47.935518+0000","last_unstale":"2024-09-11T00:23:49.934052+0000","last_undegraded":"2024-09-11T00:23:49.934052+0000","last_fullsized":"2024-09-11T00:23:49.934052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:59.939503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870137+0000","last_change":"2024-09-11T00:23:48.942240+0000","last_active":"2024-09-11T00:23:50.870137+0000","last_peered":"2024-09-11T00:23:50.870137+0000","last_clean":"2024-09-11T00:23:50.870137+0000","last_became_active":"2024-09-11T00:23:48.941950+0000","last_became_peered":"2024-09-11T00:23:48.941950+0000","last_unstale":"2024-09-11T00:23:50.870137+0000","last_undegraded":"2024-09-11T00:23:50.870137+0000","last_fullsized":"2024-09-11T00:23:50.870137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:05.378796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871100+0000","last_change":"2024-09-11T00:23:47.940231+0000","last_active":"2024-09-11T00:23:50.871100+0000","last_peered":"2024-09-11T00:23:50.871100+0000","last_clean":"2024-09-11T00:23:50.871100+0000","last_became_active":"2024-09-11T00:23:47.939887+0000","last_became_peered":"2024-09-11T00:23:47.939887+0000","last_unstale":"2024-09-11T00:23:50.871100+0000","last_undegraded":"2024-09-11T00:23:50.871100+0000","last_fullsized":"2024-09-11T00:23:50.871100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:40.413211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526432+0000","last_change":"2024-09-11T00:23:48.948747+0000","last_active":"2024-09-11T00:23:50.526432+0000","last_peered":"2024-09-11T00:23:50.526432+0000","last_clean":"2024-09-11T00:23:50.526432+0000","last_became_active":"2024-09-11T00:23:48.948439+0000","last_became_peered":"2024-09-11T00:23:48.948439+0000","last_unstale":"2024-09-11T00:23:50.526432+0000","last_undegraded":"2024-09-11T00:23:50.526432+0000","last_fullsized":"2024-09-11T00:23:50.526432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:59.951812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870404+0000","last_change":"2024-09-11T00:23:47.938518+0000","last_active":"2024-09-11T00:23:50.870404+0000","last_peered":"2024-09-11T00:23:50.870404+0000","last_clean":"2024-09-11T00:23:50.870404+0000","last_became_active":"2024-09-11T00:23:47.937928+0000","last_became_peered":"2024-09-11T00:23:47.937928+0000","last_unstale":"2024-09-11T00:23:50.870404+0000","last_undegraded":"2024-09-11T00:23:50.870404+0000","last_fullsized":"2024-09-11T00:23:50.870404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:25.625230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934570+0000","last_change":"2024-09-11T00:23:48.929011+0000","last_active":"2024-09-11T00:23:49.934570+0000","last_peered":"2024-09-11T00:23:49.934570+0000","last_clean":"2024-09-11T00:23:49.934570+0000","last_became_active":"2024-09-11T00:23:48.927838+0000","last_became_peered":"2024-09-11T00:23:48.927838+0000","last_unstale":"2024-09-11T00:23:49.934570+0000","last_undegraded":"2024-09-11T00:23:49.934570+0000","last_fullsized":"2024-09-11T00:23:49.934570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:01.109766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933263+0000","last_change":"2024-09-11T00:23:47.930702+0000","last_active":"2024-09-11T00:23:49.933263+0000","last_peered":"2024-09-11T00:23:49.933263+0000","last_clean":"2024-09-11T00:23:49.933263+0000","last_became_active":"2024-09-11T00:23:47.930044+0000","last_became_peered":"2024-09-11T00:23:47.930044+0000","last_unstale":"2024-09-11T00:23:49.933263+0000","last_undegraded":"2024-09-11T00:23:49.933263+0000","last_fullsized":"2024-09-11T00:23:49.933263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:05.769710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869927+0000","last_change":"2024-09-11T00:23:48.932964+0000","last_active":"2024-09-11T00:23:50.869927+0000","last_peered":"2024-09-11T00:23:50.869927+0000","last_clean":"2024-09-11T00:23:50.869927+0000","last_became_active":"2024-09-11T00:23:48.932262+0000","last_became_peered":"2024-09-11T00:23:48.932262+0000","last_unstale":"2024-09-11T00:23:50.869927+0000","last_undegraded":"2024-09-11T00:23:50.869927+0000","last_fullsized":"2024-09-11T00:23:50.869927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:50.142533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933446+0000","last_change":"2024-09-11T00:23:47.924671+0000","last_active":"2024-09-11T00:23:49.933446+0000","last_peered":"2024-09-11T00:23:49.933446+0000","last_clean":"2024-09-11T00:23:49.933446+0000","last_became_active":"2024-09-11T00:23:47.924383+0000","last_became_peered":"2024-09-11T00:23:47.924383+0000","last_unstale":"2024-09-11T00:23:49.933446+0000","last_undegraded":"2024-09-11T00:23:49.933446+0000","last_fullsized":"2024-09-11T00:23:49.933446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:00.103061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869954+0000","last_change":"2024-09-11T00:23:48.949725+0000","last_active":"2024-09-11T00:23:50.869954+0000","last_peered":"2024-09-11T00:23:50.869954+0000","last_clean":"2024-09-11T00:23:50.869954+0000","last_became_active":"2024-09-11T00:23:48.949445+0000","last_became_peered":"2024-09-11T00:23:48.949445+0000","last_unstale":"2024-09-11T00:23:50.869954+0000","last_undegraded":"2024-09-11T00:23:50.869954+0000","last_fullsized":"2024-09-11T00:23:50.869954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:32.096363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871560+0000","last_change":"2024-09-11T00:23:47.940381+0000","last_active":"2024-09-11T00:23:50.871560+0000","last_peered":"2024-09-11T00:23:50.871560+0000","last_clean":"2024-09-11T00:23:50.871560+0000","last_became_active":"2024-09-11T00:23:47.940030+0000","last_became_peered":"2024-09-11T00:23:47.940030+0000","last_unstale":"2024-09-11T00:23:50.871560+0000","last_undegraded":"2024-09-11T00:23:50.871560+0000","last_fullsized":"2024-09-11T00:23:50.871560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:49.214733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870694+0000","last_change":"2024-09-11T00:23:48.934776+0000","last_active":"2024-09-11T00:23:50.870694+0000","last_peered":"2024-09-11T00:23:50.870694+0000","last_clean":"2024-09-11T00:23:50.870694+0000","last_became_active":"2024-09-11T00:23:48.925601+0000","last_became_peered":"2024-09-11T00:23:48.925601+0000","last_unstale":"2024-09-11T00:23:50.870694+0000","last_undegraded":"2024-09-11T00:23:50.870694+0000","last_fullsized":"2024-09-11T00:23:50.870694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:23.709720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935472+0000","last_change":"2024-09-11T00:23:48.921538+0000","last_active":"2024-09-11T00:23:49.935472+0000","last_peered":"2024-09-11T00:23:49.935472+0000","last_clean":"2024-09-11T00:23:49.935472+0000","last_became_active":"2024-09-11T00:23:48.921162+0000","last_became_peered":"2024-09-11T00:23:48.921162+0000","last_unstale":"2024-09-11T00:23:49.935472+0000","last_undegraded":"2024-09-11T00:23:49.935472+0000","last_fullsized":"2024-09-11T00:23:49.935472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:14:08.841886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871337+0000","last_change":"2024-09-11T00:23:47.938661+0000","last_active":"2024-09-11T00:23:50.871337+0000","last_peered":"2024-09-11T00:23:50.871337+0000","last_clean":"2024-09-11T00:23:50.871337+0000","last_became_active":"2024-09-11T00:23:47.937858+0000","last_became_peered":"2024-09-11T00:23:47.937858+0000","last_unstale":"2024-09-11T00:23:50.871337+0000","last_undegraded":"2024-09-11T00:23:50.871337+0000","last_fullsized":"2024-09-11T00:23:50.871337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:34.793911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935205+0000","last_change":"2024-09-11T00:23:48.916507+0000","last_active":"2024-09-11T00:23:49.935205+0000","last_peered":"2024-09-11T00:23:49.935205+0000","last_clean":"2024-09-11T00:23:49.935205+0000","last_became_active":"2024-09-11T00:23:48.916168+0000","last_became_peered":"2024-09-11T00:23:48.916168+0000","last_unstale":"2024-09-11T00:23:49.935205+0000","last_undegraded":"2024-09-11T00:23:49.935205+0000","last_fullsized":"2024-09-11T00:23:49.935205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:53.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871007+0000","last_change":"2024-09-11T00:23:47.941406+0000","last_active":"2024-09-11T00:23:50.871007+0000","last_peered":"2024-09-11T00:23:50.871007+0000","last_clean":"2024-09-11T00:23:50.871007+0000","last_became_active":"2024-09-11T00:23:47.940051+0000","last_became_peered":"2024-09-11T00:23:47.940051+0000","last_unstale":"2024-09-11T00:23:50.871007+0000","last_undegraded":"2024-09-11T00:23:50.871007+0000","last_fullsized":"2024-09-11T00:23:50.871007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:02.075049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526442+0000","last_change":"2024-09-11T00:23:48.925648+0000","last_active":"2024-09-11T00:23:50.526442+0000","last_peered":"2024-09-11T00:23:50.526442+0000","last_clean":"2024-09-11T00:23:50.526442+0000","last_became_active":"2024-09-11T00:23:48.924442+0000","last_became_peered":"2024-09-11T00:23:48.924442+0000","last_unstale":"2024-09-11T00:23:50.526442+0000","last_undegraded":"2024-09-11T00:23:50.526442+0000","last_fullsized":"2024-09-11T00:23:50.526442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:54.299102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870045+0000","last_change":"2024-09-11T00:23:47.932359+0000","last_active":"2024-09-11T00:23:50.870045+0000","last_peered":"2024-09-11T00:23:50.870045+0000","last_clean":"2024-09-11T00:23:50.870045+0000","last_became_active":"2024-09-11T00:23:47.932075+0000","last_became_peered":"2024-09-11T00:23:47.932075+0000","last_unstale":"2024-09-11T00:23:50.870045+0000","last_undegraded":"2024-09-11T00:23:50.870045+0000","last_fullsized":"2024-09-11T00:23:50.870045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:17.848252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870089+0000","last_change":"2024-09-11T00:23:48.939724+0000","last_active":"2024-09-11T00:23:50.870089+0000","last_peered":"2024-09-11T00:23:50.870089+0000","last_clean":"2024-09-11T00:23:50.870089+0000","last_became_active":"2024-09-11T00:23:48.939505+0000","last_became_peered":"2024-09-11T00:23:48.939505+0000","last_unstale":"2024-09-11T00:23:50.870089+0000","last_undegraded":"2024-09-11T00:23:50.870089+0000","last_fullsized":"2024-09-11T00:23:50.870089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:19.018125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526569+0000","last_change":"2024-09-11T00:23:47.940123+0000","last_active":"2024-09-11T00:23:50.526569+0000","last_peered":"2024-09-11T00:23:50.526569+0000","last_clean":"2024-09-11T00:23:50.526569+0000","last_became_active":"2024-09-11T00:23:47.939901+0000","last_became_peered":"2024-09-11T00:23:47.939901+0000","last_unstale":"2024-09-11T00:23:50.526569+0000","last_undegraded":"2024-09-11T00:23:50.526569+0000","last_fullsized":"2024-09-11T00:23:50.526569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:45.637790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":667234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":76410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":667290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:23:58.316 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T00:23:58.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-11T00:23:58.317 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-11T00:23:58.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.511+0000 7f0d43e00640 1 -- 172.21.15.40:0/2242737674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d4415baa0 msgr2=0x7f0d4406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:58.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.511+0000 7f0d43e00640 1 --2- 172.21.15.40:0/2242737674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d4415baa0 0x7f0d4406e890 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0d4406a060 tx=0x7f0d3402a560 comp rx=0 tx=0).stop 2024-09-11T00:23:58.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.511+0000 7f0d43e00640 1 -- 172.21.15.40:0/2242737674 shutdown_connections 2024-09-11T00:23:58.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.511+0000 7f0d43e00640 1 --2- 172.21.15.40:0/2242737674 >> v2:172.21.15.175:3300/0 conn(0x7f0d44073830 0x7f0d44073cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.511+0000 7f0d43e00640 1 --2- 172.21.15.40:0/2242737674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d440ae640 0x7f0d4406edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.511+0000 7f0d43e00640 1 --2- 172.21.15.40:0/2242737674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d4415baa0 0x7f0d4406e890 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.511+0000 7f0d43e00640 1 -- 172.21.15.40:0/2242737674 >> 172.21.15.40:0/2242737674 conn(0x7f0d440cf770 msgr2=0x7f0d440cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:58.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.511+0000 7f0d43e00640 1 -- 172.21.15.40:0/2242737674 shutdown_connections 2024-09-11T00:23:58.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.511+0000 7f0d43e00640 1 -- 172.21.15.40:0/2242737674 wait complete. 2024-09-11T00:23:58.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.513+0000 7f0d43e00640 1 Processor -- start 2024-09-11T00:23:58.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.513+0000 7f0d43e00640 1 -- start start 2024-09-11T00:23:58.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.514+0000 7f0d43e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d44073830 0x7f0d4414dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:58.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.514+0000 7f0d43e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d440ae640 0x7f0d441f4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:58.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.514+0000 7f0d43e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d4415baa0 0x7f0d440c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:58.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.514+0000 7f0d43e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0d440b56d0 con 0x7f0d44073830 2024-09-11T00:23:58.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.514+0000 7f0d43e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0d440b5550 con 0x7f0d4415baa0 2024-09-11T00:23:58.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.514+0000 7f0d43e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0d4415be80 con 0x7f0d440ae640 2024-09-11T00:23:58.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.514+0000 7f0d42a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d44073830 0x7f0d4414dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:58.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.514+0000 7f0d42a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d44073830 0x7f0d4414dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39382/0 (socket says 172.21.15.40:39382) 2024-09-11T00:23:58.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.514+0000 7f0d42a00640 1 -- 172.21.15.40:0/1014626203 learned_addr learned my addr 172.21.15.40:0/1014626203 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:58.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.515+0000 7f0d43400640 1 --2- 172.21.15.40:0/1014626203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d4415baa0 0x7f0d440c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:58.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.515+0000 7f0d42a00640 1 -- 172.21.15.40:0/1014626203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d440ae640 msgr2=0x7f0d441f4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:58.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.515+0000 7f0d3a000640 1 --2- 172.21.15.40:0/1014626203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d440ae640 0x7f0d441f4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:58.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.515+0000 7f0d42a00640 1 --2- 172.21.15.40:0/1014626203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d440ae640 0x7f0d441f4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.515+0000 7f0d42a00640 1 -- 172.21.15.40:0/1014626203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d4415baa0 msgr2=0x7f0d440c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:58.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.515+0000 7f0d42a00640 1 --2- 172.21.15.40:0/1014626203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d4415baa0 0x7f0d440c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.515+0000 7f0d42a00640 1 -- 172.21.15.40:0/1014626203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d441f5180 con 0x7f0d44073830 2024-09-11T00:23:58.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.515+0000 7f0d43400640 1 --2- 172.21.15.40:0/1014626203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d4415baa0 0x7f0d440c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:58.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.515+0000 7f0d3a000640 1 --2- 172.21.15.40:0/1014626203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d440ae640 0x7f0d441f4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:58.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.515+0000 7f0d42a00640 1 --2- 172.21.15.40:0/1014626203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d44073830 0x7f0d4414dcd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d34034040 tx=0x7f0d34003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:58.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.515+0000 7f0d3b400640 1 -- 172.21.15.40:0/1014626203 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3403e030 con 0x7f0d44073830 2024-09-11T00:23:58.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.515+0000 7f0d3b400640 1 -- 172.21.15.40:0/1014626203 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d34003d10 con 0x7f0d44073830 2024-09-11T00:23:58.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.515+0000 7f0d43e00640 1 -- 172.21.15.40:0/1014626203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d441f5460 con 0x7f0d44073830 2024-09-11T00:23:58.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.515+0000 7f0d3b400640 1 -- 172.21.15.40:0/1014626203 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34035040 con 0x7f0d44073830 2024-09-11T00:23:58.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.515+0000 7f0d43e00640 1 -- 172.21.15.40:0/1014626203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d440c7090 con 0x7f0d44073830 2024-09-11T00:23:58.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.516+0000 7f0d43e00640 1 -- 172.21.15.40:0/1014626203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d44073130 con 0x7f0d44073830 2024-09-11T00:23:58.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.518+0000 7f0d3b400640 1 -- 172.21.15.40:0/1014626203 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0d340049c0 con 0x7f0d44073830 2024-09-11T00:23:58.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.519+0000 7f0d3b400640 1 --2- 172.21.15.40:0/1014626203 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0d20077f70 0x7f0d2007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:58.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.519+0000 7f0d3b400640 1 -- 172.21.15.40:0/1014626203 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0d340bac30 con 0x7f0d44073830 2024-09-11T00:23:58.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.519+0000 7f0d3a000640 1 --2- 172.21.15.40:0/1014626203 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0d20077f70 0x7f0d2007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:58.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.520+0000 7f0d3a000640 1 --2- 172.21.15.40:0/1014626203 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0d20077f70 0x7f0d2007a430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0d440af7d0 tx=0x7f0d2c005c70 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:58.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.521+0000 7f0d3b400640 1 -- 172.21.15.40:0/1014626203 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0d44073130 con 0x7f0d44073830 2024-09-11T00:23:58.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.715+0000 7f0d43e00640 1 -- 172.21.15.40:0/1014626203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f0d44073cc0 con 0x7f0d44073830 2024-09-11T00:23:58.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.716+0000 7f0d3b400640 1 -- 172.21.15.40:0/1014626203 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v27) ==== 86+0+160 (secure 0 0 0) 0x7f0d34083710 con 0x7f0d44073830 2024-09-11T00:23:58.717 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:23:58.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.718+0000 7f0d43e00640 1 -- 172.21.15.40:0/1014626203 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0d20077f70 msgr2=0x7f0d2007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:58.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.718+0000 7f0d43e00640 1 --2- 172.21.15.40:0/1014626203 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0d20077f70 0x7f0d2007a430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0d440af7d0 tx=0x7f0d2c005c70 comp rx=0 tx=0).stop 2024-09-11T00:23:58.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.718+0000 7f0d43e00640 1 -- 172.21.15.40:0/1014626203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d44073830 msgr2=0x7f0d4414dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:58.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.719+0000 7f0d43e00640 1 --2- 172.21.15.40:0/1014626203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d44073830 0x7f0d4414dcd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d34034040 tx=0x7f0d34003820 comp rx=0 tx=0).stop 2024-09-11T00:23:58.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.719+0000 7f0d43e00640 1 -- 172.21.15.40:0/1014626203 shutdown_connections 2024-09-11T00:23:58.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.719+0000 7f0d43e00640 1 --2- 172.21.15.40:0/1014626203 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0d20077f70 0x7f0d2007a430 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.719+0000 7f0d43e00640 1 --2- 172.21.15.40:0/1014626203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d4415baa0 0x7f0d440c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.719+0000 7f0d43e00640 1 --2- 172.21.15.40:0/1014626203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d440ae640 0x7f0d441f4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.719+0000 7f0d43e00640 1 --2- 172.21.15.40:0/1014626203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d44073830 0x7f0d4414dcd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.719+0000 7f0d43e00640 1 -- 172.21.15.40:0/1014626203 >> 172.21.15.40:0/1014626203 conn(0x7f0d440cf770 msgr2=0x7f0d440b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:58.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.719+0000 7f0d43e00640 1 -- 172.21.15.40:0/1014626203 shutdown_connections 2024-09-11T00:23:58.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.719+0000 7f0d43e00640 1 -- 172.21.15.40:0/1014626203 wait complete. 2024-09-11T00:23:58.735 INFO:teuthology.orchestra.run.smithi040.stdout:[{"version":27,"timestamp":"2024-09-11T00:23:36.321118+0000","name":"","changes":[{"name":"osd.7/osd_mclock_max_capacity_iops_ssd","new_value":"4277.831007"}]}] 2024-09-11T00:23:58.735 INFO:tasks.ceph_manager:config epoch is 27 2024-09-11T00:23:58.736 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T00:23:58.736 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-11T00:23:58.736 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-11T00:23:58.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.894+0000 7fb6db200640 1 -- 172.21.15.40:0/3310037799 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6dc15baa0 msgr2=0x7fb6dc06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:58.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.894+0000 7fb6db200640 1 --2- 172.21.15.40:0/3310037799 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6dc15baa0 0x7fb6dc06e890 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc005fd0 tx=0x7fb6cc02aa00 comp rx=0 tx=0).stop 2024-09-11T00:23:58.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.894+0000 7fb6db200640 1 -- 172.21.15.40:0/3310037799 shutdown_connections 2024-09-11T00:23:58.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.894+0000 7fb6db200640 1 --2- 172.21.15.40:0/3310037799 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6dc073f40 0x7fb6dc06edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.894+0000 7fb6db200640 1 --2- 172.21.15.40:0/3310037799 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6dc15baa0 0x7fb6dc06e890 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.894+0000 7fb6db200640 1 -- 172.21.15.40:0/3310037799 >> 172.21.15.40:0/3310037799 conn(0x7fb6dc0cf770 msgr2=0x7fb6dc0cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:58.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.895+0000 7fb6db200640 1 -- 172.21.15.40:0/3310037799 shutdown_connections 2024-09-11T00:23:58.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.895+0000 7fb6db200640 1 -- 172.21.15.40:0/3310037799 wait complete. 2024-09-11T00:23:58.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.896+0000 7fb6db200640 1 Processor -- start 2024-09-11T00:23:58.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.896+0000 7fb6db200640 1 -- start start 2024-09-11T00:23:58.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.897+0000 7fb6db200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6dc073f40 0x7fb6dc1f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:58.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.897+0000 7fb6db200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6dc0ae640 0x7fb6dc0b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:58.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.897+0000 7fb6db200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6dc15baa0 0x7fb6dc153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:58.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.897+0000 7fb6db200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc15be80 con 0x7fb6dc073f40 2024-09-11T00:23:58.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.897+0000 7fb6db200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc0b5760 con 0x7fb6dc0ae640 2024-09-11T00:23:58.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.897+0000 7fb6db200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb6dc15c000 con 0x7fb6dc15baa0 2024-09-11T00:23:58.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.897+0000 7fb6d9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6dc073f40 0x7fb6dc1f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:58.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.897+0000 7fb6d9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6dc073f40 0x7fb6dc1f6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39412/0 (socket says 172.21.15.40:39412) 2024-09-11T00:23:58.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.897+0000 7fb6d9e00640 1 -- 172.21.15.40:0/2699502491 learned_addr learned my addr 172.21.15.40:0/2699502491 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:58.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.898+0000 7fb6da800640 1 --2- 172.21.15.40:0/2699502491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6dc15baa0 0x7fb6dc153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:58.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.898+0000 7fb6d1400640 1 --2- 172.21.15.40:0/2699502491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6dc0ae640 0x7fb6dc0b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:58.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.898+0000 7fb6d9e00640 1 -- 172.21.15.40:0/2699502491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6dc15baa0 msgr2=0x7fb6dc153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:58.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.898+0000 7fb6d9e00640 1 --2- 172.21.15.40:0/2699502491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6dc15baa0 0x7fb6dc153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.898+0000 7fb6d9e00640 1 -- 172.21.15.40:0/2699502491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6dc0ae640 msgr2=0x7fb6dc0b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:58.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.898+0000 7fb6d9e00640 1 --2- 172.21.15.40:0/2699502491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6dc0ae640 0x7fb6dc0b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:58.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.898+0000 7fb6d9e00640 1 -- 172.21.15.40:0/2699502491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6dc1f6a40 con 0x7fb6dc073f40 2024-09-11T00:23:58.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.898+0000 7fb6d9e00640 1 --2- 172.21.15.40:0/2699502491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6dc073f40 0x7fb6dc1f6500 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc000f80 tx=0x7fb6cc003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:58.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.898+0000 7fb6d2a00640 1 -- 172.21.15.40:0/2699502491 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc046070 con 0x7fb6dc073f40 2024-09-11T00:23:58.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.898+0000 7fb6d2a00640 1 -- 172.21.15.40:0/2699502491 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6cc0045c0 con 0x7fb6dc073f40 2024-09-11T00:23:58.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.898+0000 7fb6d2a00640 1 -- 172.21.15.40:0/2699502491 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc033070 con 0x7fb6dc073f40 2024-09-11T00:23:58.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.898+0000 7fb6db200640 1 -- 172.21.15.40:0/2699502491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6dc1f26a0 con 0x7fb6dc073f40 2024-09-11T00:23:58.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.898+0000 7fb6db200640 1 -- 172.21.15.40:0/2699502491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6dc1f2c60 con 0x7fb6dc073f40 2024-09-11T00:23:58.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.900+0000 7fb6db200640 1 -- 172.21.15.40:0/2699502491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6dc15cd40 con 0x7fb6dc073f40 2024-09-11T00:23:58.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.901+0000 7fb6d2a00640 1 -- 172.21.15.40:0/2699502491 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb6cc040030 con 0x7fb6dc073f40 2024-09-11T00:23:58.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.901+0000 7fb6d2a00640 1 --2- 172.21.15.40:0/2699502491 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb6b8077f70 0x7fb6b807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:58.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.902+0000 7fb6d2a00640 1 -- 172.21.15.40:0/2699502491 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb6cc0bae70 con 0x7fb6dc073f40 2024-09-11T00:23:58.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.902+0000 7fb6d1400640 1 --2- 172.21.15.40:0/2699502491 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb6b8077f70 0x7fb6b807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:58.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.902+0000 7fb6d1400640 1 --2- 172.21.15.40:0/2699502491 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb6b8077f70 0x7fb6b807a430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4007fd0 tx=0x7fb6c4009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:58.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:58.906+0000 7fb6d2a00640 1 -- 172.21.15.40:0/2699502491 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb6dc1f6a40 con 0x7fb6dc073f40 2024-09-11T00:23:59.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.150+0000 7fb6db200640 1 -- 172.21.15.40:0/2699502491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb6dc0b29c0 con 0x7fb6dc073f40 2024-09-11T00:23:59.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.153+0000 7fb6d2a00640 1 -- 172.21.15.40:0/2699502491 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+193245 (secure 0 0 0) 0x7fb6cc03e070 con 0x7fb6dc073f40 2024-09-11T00:23:59.157 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:23:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.157+0000 7fb6db200640 1 -- 172.21.15.40:0/2699502491 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb6b8077f70 msgr2=0x7fb6b807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.157+0000 7fb6db200640 1 --2- 172.21.15.40:0/2699502491 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb6b8077f70 0x7fb6b807a430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4007fd0 tx=0x7fb6c4009040 comp rx=0 tx=0).stop 2024-09-11T00:23:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.157+0000 7fb6db200640 1 -- 172.21.15.40:0/2699502491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6dc073f40 msgr2=0x7fb6dc1f6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.157+0000 7fb6db200640 1 --2- 172.21.15.40:0/2699502491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6dc073f40 0x7fb6dc1f6500 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc000f80 tx=0x7fb6cc003f90 comp rx=0 tx=0).stop 2024-09-11T00:23:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.157+0000 7fb6db200640 1 -- 172.21.15.40:0/2699502491 shutdown_connections 2024-09-11T00:23:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.157+0000 7fb6db200640 1 --2- 172.21.15.40:0/2699502491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6dc15baa0 0x7fb6dc153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.157+0000 7fb6db200640 1 --2- 172.21.15.40:0/2699502491 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb6b8077f70 0x7fb6b807a430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.157+0000 7fb6db200640 1 --2- 172.21.15.40:0/2699502491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6dc0ae640 0x7fb6dc0b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.157+0000 7fb6db200640 1 --2- 172.21.15.40:0/2699502491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6dc073f40 0x7fb6dc1f6500 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.157+0000 7fb6db200640 1 -- 172.21.15.40:0/2699502491 >> 172.21.15.40:0/2699502491 conn(0x7fb6dc0cf770 msgr2=0x7fb6dc0b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:59.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.157+0000 7fb6db200640 1 -- 172.21.15.40:0/2699502491 shutdown_connections 2024-09-11T00:23:59.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.157+0000 7fb6db200640 1 -- 172.21.15.40:0/2699502491 wait complete. 2024-09-11T00:23:59.174 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":5,"flags":0,"active_gid":4115,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":422726646},{"type":"v1","addr":"172.21.15.175:6801","nonce":422726646}]},"active_addr":"172.21.15.175:6801/422726646","active_change":"2024-09-11T00:23:27.763198+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4118,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":3665139944}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":20281523}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":1724304329}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":3053561618}]}]} 2024-09-11T00:23:59.178 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-11T00:23:59.179 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T00:23:59.179 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:23:59.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.338+0000 7f1035800640 1 -- 172.21.15.40:0/4111438413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10300ca200 msgr2=0x7f10300ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.338+0000 7f1035800640 1 --2- 172.21.15.40:0/4111438413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10300ca200 0x7f10300ca660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1018009830 tx=0x7f101802a510 comp rx=0 tx=0).stop 2024-09-11T00:23:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.338+0000 7f1035800640 1 -- 172.21.15.40:0/4111438413 shutdown_connections 2024-09-11T00:23:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.338+0000 7f1035800640 1 --2- 172.21.15.40:0/4111438413 >> v2:172.21.15.175:3300/0 conn(0x7f103006e550 0x7f103006e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.338+0000 7f1035800640 1 --2- 172.21.15.40:0/4111438413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10300ca200 0x7f10300ca660 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.338+0000 7f1035800640 1 -- 172.21.15.40:0/4111438413 >> 172.21.15.40:0/4111438413 conn(0x7f10300cfbb0 msgr2=0x7f10300cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.338+0000 7f1035800640 1 -- 172.21.15.40:0/4111438413 shutdown_connections 2024-09-11T00:23:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.338+0000 7f1035800640 1 -- 172.21.15.40:0/4111438413 wait complete. 2024-09-11T00:23:59.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.340+0000 7f1035800640 1 Processor -- start 2024-09-11T00:23:59.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.340+0000 7f1035800640 1 -- start start 2024-09-11T00:23:59.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.341+0000 7f1035800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f103006e550 0x7f103014f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.341+0000 7f1035800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10300705e0 0x7f10300b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.341+0000 7f1035800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10300ca200 0x7f1030156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.341+0000 7f1035800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1030154650 con 0x7f103006e550 2024-09-11T00:23:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.341+0000 7f1035800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f10300cf320 con 0x7f10300ca200 2024-09-11T00:23:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.341+0000 7f1035800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f10301547d0 con 0x7f10300705e0 2024-09-11T00:23:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.341+0000 7f102ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f103006e550 0x7f103014f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.341+0000 7f1026000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10300705e0 0x7f10300b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.341+0000 7f1026000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10300705e0 0x7f10300b5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.40:38360/0 (socket says 172.21.15.40:38360) 2024-09-11T00:23:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.341+0000 7f1026000640 1 -- 172.21.15.40:0/2909652636 learned_addr learned my addr 172.21.15.40:0/2909652636 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.341+0000 7f102f400640 1 --2- 172.21.15.40:0/2909652636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10300ca200 0x7f1030156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:59.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.341+0000 7f102ea00640 1 -- 172.21.15.40:0/2909652636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10300705e0 msgr2=0x7f10300b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:59.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.341+0000 7f102ea00640 1 --2- 172.21.15.40:0/2909652636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10300705e0 0x7f10300b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.341+0000 7f102ea00640 1 -- 172.21.15.40:0/2909652636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10300ca200 msgr2=0x7f1030156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.341+0000 7f102ea00640 1 --2- 172.21.15.40:0/2909652636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10300ca200 0x7f1030156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.341+0000 7f102ea00640 1 -- 172.21.15.40:0/2909652636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10301f4eb0 con 0x7f103006e550 2024-09-11T00:23:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.342+0000 7f102ea00640 1 --2- 172.21.15.40:0/2909652636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f103006e550 0x7f103014f120 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f102000c3c0 tx=0x7f102000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.342+0000 7f1027400640 1 -- 172.21.15.40:0/2909652636 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020011790 con 0x7f103006e550 2024-09-11T00:23:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.342+0000 7f1027400640 1 -- 172.21.15.40:0/2909652636 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1020017070 con 0x7f103006e550 2024-09-11T00:23:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.342+0000 7f1035800640 1 -- 172.21.15.40:0/2909652636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10301f5190 con 0x7f103006e550 2024-09-11T00:23:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.342+0000 7f1027400640 1 -- 172.21.15.40:0/2909652636 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020011ce0 con 0x7f103006e550 2024-09-11T00:23:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.342+0000 7f1035800640 1 -- 172.21.15.40:0/2909652636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10301f5750 con 0x7f103006e550 2024-09-11T00:23:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.343+0000 7f1035800640 1 -- 172.21.15.40:0/2909652636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f103006e9c0 con 0x7f103006e550 2024-09-11T00:23:59.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.344+0000 7f1027400640 1 -- 172.21.15.40:0/2909652636 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f102001c460 con 0x7f103006e550 2024-09-11T00:23:59.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.345+0000 7f1027400640 1 --2- 172.21.15.40:0/2909652636 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f100c077f70 0x7f100c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:59.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.345+0000 7f1027400640 1 -- 172.21.15.40:0/2909652636 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1020099940 con 0x7f103006e550 2024-09-11T00:23:59.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.345+0000 7f1026000640 1 --2- 172.21.15.40:0/2909652636 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f100c077f70 0x7f100c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:59.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.346+0000 7f1026000640 1 --2- 172.21.15.40:0/2909652636 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f100c077f70 0x7f100c07a430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1018009830 tx=0x7f1018004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:59.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.349+0000 7f1027400640 1 -- 172.21.15.40:0/2909652636 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1020061de0 con 0x7f103006e550 2024-09-11T00:23:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.544+0000 7f1035800640 1 -- 172.21.15.40:0/2909652636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10300ae360 con 0x7f103006e550 2024-09-11T00:23:59.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.545+0000 7f1027400640 1 -- 172.21.15.40:0/2909652636 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16641 (secure 0 0 0) 0x7f1020066810 con 0x7f103006e550 2024-09-11T00:23:59.548 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:23:59.548 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":22,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","created":"2024-09-11T00:23:22.512139+0000","modified":"2024-09-11T00:23:49.924132+0000","last_up_change":"2024-09-11T00:23:36.842446+0000","last_in_change":"2024-09-11T00:23:26.734953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:23:37.800502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:23:46.379819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:23:47.307802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee10e123-8817-4d94-a340-73d00121af37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6801","nonce":973366008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6803","nonce":973366008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6807","nonce":973366008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6805","nonce":973366008}]},"public_addr":"172.21.15.40:6801/973366008","cluster_addr":"172.21.15.40:6803/973366008","heartbeat_back_addr":"172.21.15.40:6807/973366008","heartbeat_front_addr":"172.21.15.40:6805/973366008","state":["exists","up"]},{"osd":1,"uuid":"f90895e9-8660-42b9-8aba-3f9d4d130b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6823","nonce":2542266029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6827","nonce":2542266029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6831","nonce":2542266029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6829","nonce":2542266029}]},"public_addr":"172.21.15.40:6823/2542266029","cluster_addr":"172.21.15.40:6827/2542266029","heartbeat_back_addr":"172.21.15.40:6831/2542266029","heartbeat_front_addr":"172.21.15.40:6829/2542266029","state":["exists","up"]},{"osd":2,"uuid":"a190497a-2aba-4748-8f1d-7e372259d65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6815","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6817","nonce":559505356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6819","nonce":559505356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6826","nonce":559505356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6822","nonce":559505356}]},"public_addr":"172.21.15.40:6817/559505356","cluster_addr":"172.21.15.40:6819/559505356","heartbeat_back_addr":"172.21.15.40:6826/559505356","heartbeat_front_addr":"172.21.15.40:6822/559505356","state":["exists","up"]},{"osd":3,"uuid":"8be32ced-898a-46f2-b850-1517667766b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6809","nonce":503633839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6811","nonce":503633839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6816","nonce":503633839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6813","nonce":503633839}]},"public_addr":"172.21.15.40:6809/503633839","cluster_addr":"172.21.15.40:6811/503633839","heartbeat_back_addr":"172.21.15.40:6816/503633839","heartbeat_front_addr":"172.21.15.40:6813/503633839","state":["exists","up"]},{"osd":4,"uuid":"9867fdfc-6f93-466e-b768-b5a1da7157de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6811","nonce":2418348042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6813","nonce":2418348042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6817","nonce":2418348042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6815","nonce":2418348042}]},"public_addr":"172.21.15.175:6811/2418348042","cluster_addr":"172.21.15.175:6813/2418348042","heartbeat_back_addr":"172.21.15.175:6817/2418348042","heartbeat_front_addr":"172.21.15.175:6815/2418348042","state":["exists","up"]},{"osd":5,"uuid":"e2f6f616-b5db-466e-942f-e2762171a8ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6827","nonce":520822300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6829","nonce":520822300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6833","nonce":520822300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6831","nonce":520822300}]},"public_addr":"172.21.15.175:6827/520822300","cluster_addr":"172.21.15.175:6829/520822300","heartbeat_back_addr":"172.21.15.175:6833/520822300","heartbeat_front_addr":"172.21.15.175:6831/520822300","state":["exists","up"]},{"osd":6,"uuid":"807ac045-bf63-4ff6-9a06-7f7022f9ef32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6819","nonce":1431736593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6821","nonce":1431736593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6825","nonce":1431736593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6823","nonce":1431736593}]},"public_addr":"172.21.15.175:6819/1431736593","cluster_addr":"172.21.15.175:6821/1431736593","heartbeat_back_addr":"172.21.15.175:6825/1431736593","heartbeat_front_addr":"172.21.15.175:6823/1431736593","state":["exists","up"]},{"osd":7,"uuid":"8e0b3293-390f-4b43-b29d-babdc5e88f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6803","nonce":3300317000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6805","nonce":3300317000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6809","nonce":3300317000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6807","nonce":3300317000}]},"public_addr":"172.21.15.175:6803/3300317000","cluster_addr":"172.21.15.175:6805/3300317000","heartbeat_back_addr":"172.21.15.175:6809/3300317000","heartbeat_front_addr":"172.21.15.175:6807/3300317000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:32.967062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.266558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.063509+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.616332+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.431077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.866822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.645225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.016210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:23:59.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.547+0000 7f1035800640 1 -- 172.21.15.40:0/2909652636 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f100c077f70 msgr2=0x7f100c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:59.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.547+0000 7f1035800640 1 --2- 172.21.15.40:0/2909652636 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f100c077f70 0x7f100c07a430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1018009830 tx=0x7f1018004730 comp rx=0 tx=0).stop 2024-09-11T00:23:59.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.547+0000 7f1035800640 1 -- 172.21.15.40:0/2909652636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f103006e550 msgr2=0x7f103014f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:59.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.547+0000 7f1035800640 1 --2- 172.21.15.40:0/2909652636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f103006e550 0x7f103014f120 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f102000c3c0 tx=0x7f102000c880 comp rx=0 tx=0).stop 2024-09-11T00:23:59.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.547+0000 7f1035800640 1 -- 172.21.15.40:0/2909652636 shutdown_connections 2024-09-11T00:23:59.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.547+0000 7f1035800640 1 --2- 172.21.15.40:0/2909652636 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f100c077f70 0x7f100c07a430 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.547+0000 7f1035800640 1 --2- 172.21.15.40:0/2909652636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10300ca200 0x7f1030156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.547+0000 7f1035800640 1 --2- 172.21.15.40:0/2909652636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10300705e0 0x7f10300b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.547+0000 7f1035800640 1 --2- 172.21.15.40:0/2909652636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f103006e550 0x7f103014f120 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.548+0000 7f1035800640 1 -- 172.21.15.40:0/2909652636 >> 172.21.15.40:0/2909652636 conn(0x7f10300cfbb0 msgr2=0x7f10300ce420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:59.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.548+0000 7f1035800640 1 -- 172.21.15.40:0/2909652636 shutdown_connections 2024-09-11T00:23:59.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.548+0000 7f1035800640 1 -- 172.21.15.40:0/2909652636 wait complete. 2024-09-11T00:23:59.565 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T00:23:59.565 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:23:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.724+0000 7fa4d1000640 1 -- 172.21.15.40:0/1429788842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4cc15bcc0 msgr2=0x7fa4cc0cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.724+0000 7fa4d1000640 1 --2- 172.21.15.40:0/1429788842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4cc15bcc0 0x7fa4cc0cb420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009900 tx=0x7fa4bc02a600 comp rx=0 tx=0).stop 2024-09-11T00:23:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.724+0000 7fa4d1000640 1 -- 172.21.15.40:0/1429788842 shutdown_connections 2024-09-11T00:23:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.724+0000 7fa4d1000640 1 --2- 172.21.15.40:0/1429788842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4cc15bcc0 0x7fa4cc0cb420 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.724+0000 7fa4d1000640 1 -- 172.21.15.40:0/1429788842 >> 172.21.15.40:0/1429788842 conn(0x7fa4cc0cfbb0 msgr2=0x7fa4cc0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:59.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.724+0000 7fa4d1000640 1 -- 172.21.15.40:0/1429788842 shutdown_connections 2024-09-11T00:23:59.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.725+0000 7fa4d1000640 1 -- 172.21.15.40:0/1429788842 wait complete. 2024-09-11T00:23:59.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.726+0000 7fa4d1000640 1 Processor -- start 2024-09-11T00:23:59.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.726+0000 7fa4d1000640 1 -- start start 2024-09-11T00:23:59.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.727+0000 7fa4d1000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4cc06f920 0x7fa4cc158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:59.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.727+0000 7fa4d1000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4cc0cba70 0x7fa4cc0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.727+0000 7fa4d1000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc15bcc0 0x7fa4cc151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.727+0000 7fa4d1000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc15f940 con 0x7fa4cc06f920 2024-09-11T00:23:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.727+0000 7fa4d1000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc15f7c0 con 0x7fa4cc15bcc0 2024-09-11T00:23:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.727+0000 7fa4d1000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa4cc0cbec0 con 0x7fa4cc0cba70 2024-09-11T00:23:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.728+0000 7fa4c9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4cc06f920 0x7fa4cc158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.728+0000 7fa4c9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4cc06f920 0x7fa4cc158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39430/0 (socket says 172.21.15.40:39430) 2024-09-11T00:23:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.728+0000 7fa4c9e00640 1 -- 172.21.15.40:0/636070976 learned_addr learned my addr 172.21.15.40:0/636070976 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:23:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.728+0000 7fa4c3e00640 1 --2- 172.21.15.40:0/636070976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4cc0cba70 0x7fa4cc0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.728+0000 7fa4ca800640 1 --2- 172.21.15.40:0/636070976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc15bcc0 0x7fa4cc151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.728+0000 7fa4c9e00640 1 -- 172.21.15.40:0/636070976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4cc0cba70 msgr2=0x7fa4cc0b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.728+0000 7fa4c9e00640 1 --2- 172.21.15.40:0/636070976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4cc0cba70 0x7fa4cc0b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.728+0000 7fa4c9e00640 1 -- 172.21.15.40:0/636070976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc15bcc0 msgr2=0x7fa4cc151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:59.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.728+0000 7fa4c9e00640 1 --2- 172.21.15.40:0/636070976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc15bcc0 0x7fa4cc151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.728+0000 7fa4c9e00640 1 -- 172.21.15.40:0/636070976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4cc0c9100 con 0x7fa4cc06f920 2024-09-11T00:23:59.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.728+0000 7fa4ca800640 1 --2- 172.21.15.40:0/636070976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc15bcc0 0x7fa4cc151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:59.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.728+0000 7fa4c9e00640 1 --2- 172.21.15.40:0/636070976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4cc06f920 0x7fa4cc158a60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc006010 tx=0x7fa4bc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:59.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.729+0000 7fa4c2000640 1 -- 172.21.15.40:0/636070976 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc03e030 con 0x7fa4cc06f920 2024-09-11T00:23:59.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.729+0000 7fa4c2000640 1 -- 172.21.15.40:0/636070976 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4bc0047a0 con 0x7fa4cc06f920 2024-09-11T00:23:59.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.729+0000 7fa4c2000640 1 -- 172.21.15.40:0/636070976 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc035040 con 0x7fa4cc06f920 2024-09-11T00:23:59.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.729+0000 7fa4d1000640 1 -- 172.21.15.40:0/636070976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4cc0c93e0 con 0x7fa4cc06f920 2024-09-11T00:23:59.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.729+0000 7fa4d1000640 1 -- 172.21.15.40:0/636070976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4cc0c99a0 con 0x7fa4cc06f920 2024-09-11T00:23:59.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.730+0000 7fa4d1000640 1 -- 172.21.15.40:0/636070976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4cc159000 con 0x7fa4cc06f920 2024-09-11T00:23:59.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.731+0000 7fa4c2000640 1 -- 172.21.15.40:0/636070976 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa4bc004bb0 con 0x7fa4cc06f920 2024-09-11T00:23:59.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.732+0000 7fa4c2000640 1 --2- 172.21.15.40:0/636070976 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa4a8077f70 0x7fa4a807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:59.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.732+0000 7fa4c2000640 1 -- 172.21.15.40:0/636070976 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa4bc0ba7d0 con 0x7fa4cc06f920 2024-09-11T00:23:59.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.732+0000 7fa4c3e00640 1 --2- 172.21.15.40:0/636070976 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa4a8077f70 0x7fa4a807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:59.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.733+0000 7fa4c3e00640 1 --2- 172.21.15.40:0/636070976 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa4a8077f70 0x7fa4a807a430 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4007fd0 tx=0x7fa4b4009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:59.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.736+0000 7fa4c2000640 1 -- 172.21.15.40:0/636070976 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa4bc083230 con 0x7fa4cc06f920 2024-09-11T00:23:59.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.934+0000 7fa4d1000640 1 -- 172.21.15.40:0/636070976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4cc0cc370 con 0x7fa4cc06f920 2024-09-11T00:23:59.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.935+0000 7fa4c2000640 1 -- 172.21.15.40:0/636070976 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16641 (secure 0 0 0) 0x7fa4bc082b30 con 0x7fa4cc06f920 2024-09-11T00:23:59.937 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:23:59.937 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":22,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","created":"2024-09-11T00:23:22.512139+0000","modified":"2024-09-11T00:23:49.924132+0000","last_up_change":"2024-09-11T00:23:36.842446+0000","last_in_change":"2024-09-11T00:23:26.734953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:23:37.800502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:23:46.379819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:23:47.307802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee10e123-8817-4d94-a340-73d00121af37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6801","nonce":973366008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6803","nonce":973366008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6807","nonce":973366008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6805","nonce":973366008}]},"public_addr":"172.21.15.40:6801/973366008","cluster_addr":"172.21.15.40:6803/973366008","heartbeat_back_addr":"172.21.15.40:6807/973366008","heartbeat_front_addr":"172.21.15.40:6805/973366008","state":["exists","up"]},{"osd":1,"uuid":"f90895e9-8660-42b9-8aba-3f9d4d130b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6823","nonce":2542266029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6827","nonce":2542266029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6831","nonce":2542266029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6829","nonce":2542266029}]},"public_addr":"172.21.15.40:6823/2542266029","cluster_addr":"172.21.15.40:6827/2542266029","heartbeat_back_addr":"172.21.15.40:6831/2542266029","heartbeat_front_addr":"172.21.15.40:6829/2542266029","state":["exists","up"]},{"osd":2,"uuid":"a190497a-2aba-4748-8f1d-7e372259d65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6815","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6817","nonce":559505356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6819","nonce":559505356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6826","nonce":559505356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6822","nonce":559505356}]},"public_addr":"172.21.15.40:6817/559505356","cluster_addr":"172.21.15.40:6819/559505356","heartbeat_back_addr":"172.21.15.40:6826/559505356","heartbeat_front_addr":"172.21.15.40:6822/559505356","state":["exists","up"]},{"osd":3,"uuid":"8be32ced-898a-46f2-b850-1517667766b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6809","nonce":503633839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6811","nonce":503633839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6816","nonce":503633839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6813","nonce":503633839}]},"public_addr":"172.21.15.40:6809/503633839","cluster_addr":"172.21.15.40:6811/503633839","heartbeat_back_addr":"172.21.15.40:6816/503633839","heartbeat_front_addr":"172.21.15.40:6813/503633839","state":["exists","up"]},{"osd":4,"uuid":"9867fdfc-6f93-466e-b768-b5a1da7157de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6811","nonce":2418348042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6813","nonce":2418348042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6817","nonce":2418348042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6815","nonce":2418348042}]},"public_addr":"172.21.15.175:6811/2418348042","cluster_addr":"172.21.15.175:6813/2418348042","heartbeat_back_addr":"172.21.15.175:6817/2418348042","heartbeat_front_addr":"172.21.15.175:6815/2418348042","state":["exists","up"]},{"osd":5,"uuid":"e2f6f616-b5db-466e-942f-e2762171a8ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6827","nonce":520822300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6829","nonce":520822300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6833","nonce":520822300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6831","nonce":520822300}]},"public_addr":"172.21.15.175:6827/520822300","cluster_addr":"172.21.15.175:6829/520822300","heartbeat_back_addr":"172.21.15.175:6833/520822300","heartbeat_front_addr":"172.21.15.175:6831/520822300","state":["exists","up"]},{"osd":6,"uuid":"807ac045-bf63-4ff6-9a06-7f7022f9ef32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6819","nonce":1431736593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6821","nonce":1431736593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6825","nonce":1431736593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6823","nonce":1431736593}]},"public_addr":"172.21.15.175:6819/1431736593","cluster_addr":"172.21.15.175:6821/1431736593","heartbeat_back_addr":"172.21.15.175:6825/1431736593","heartbeat_front_addr":"172.21.15.175:6823/1431736593","state":["exists","up"]},{"osd":7,"uuid":"8e0b3293-390f-4b43-b29d-babdc5e88f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6803","nonce":3300317000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6805","nonce":3300317000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6809","nonce":3300317000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6807","nonce":3300317000}]},"public_addr":"172.21.15.175:6803/3300317000","cluster_addr":"172.21.15.175:6805/3300317000","heartbeat_back_addr":"172.21.15.175:6809/3300317000","heartbeat_front_addr":"172.21.15.175:6807/3300317000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:32.967062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.266558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.063509+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.616332+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.431077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.866822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.645225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.016210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:23:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.938+0000 7fa4d1000640 1 -- 172.21.15.40:0/636070976 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa4a8077f70 msgr2=0x7fa4a807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.938+0000 7fa4d1000640 1 --2- 172.21.15.40:0/636070976 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa4a8077f70 0x7fa4a807a430 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4007fd0 tx=0x7fa4b4009040 comp rx=0 tx=0).stop 2024-09-11T00:23:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.938+0000 7fa4d1000640 1 -- 172.21.15.40:0/636070976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4cc06f920 msgr2=0x7fa4cc158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.938+0000 7fa4d1000640 1 --2- 172.21.15.40:0/636070976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4cc06f920 0x7fa4cc158a60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc006010 tx=0x7fa4bc0039e0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.938+0000 7fa4d1000640 1 -- 172.21.15.40:0/636070976 shutdown_connections 2024-09-11T00:23:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.938+0000 7fa4d1000640 1 --2- 172.21.15.40:0/636070976 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa4a8077f70 0x7fa4a807a430 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.938+0000 7fa4d1000640 1 --2- 172.21.15.40:0/636070976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc15bcc0 0x7fa4cc151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.938+0000 7fa4d1000640 1 --2- 172.21.15.40:0/636070976 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4cc0cba70 0x7fa4cc0b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.938+0000 7fa4d1000640 1 --2- 172.21.15.40:0/636070976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4cc06f920 0x7fa4cc158a60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:59.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.938+0000 7fa4d1000640 1 -- 172.21.15.40:0/636070976 >> 172.21.15.40:0/636070976 conn(0x7fa4cc0cfbb0 msgr2=0x7fa4cc0b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:59.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.938+0000 7fa4d1000640 1 -- 172.21.15.40:0/636070976 shutdown_connections 2024-09-11T00:23:59.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:23:59.938+0000 7fa4d1000640 1 -- 172.21.15.40:0/636070976 wait complete. 2024-09-11T00:23:59.956 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T00:23:59.957 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T00:23:59.957 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T00:23:59.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T00:23:59.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-11T00:23:59.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-11T00:23:59.959 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-11T00:23:59.959 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-11T00:24:00.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.248+0000 7fa7ba000640 1 -- 172.21.15.40:0/976455686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac037f10 msgr2=0x7fa7ac0e6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.248+0000 7fa7ba000640 1 --2- 172.21.15.40:0/976455686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac037f10 0x7fa7ac0e6970 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa7b406ae00 tx=0x7fa7b40a5c60 comp rx=0 tx=0).stop 2024-09-11T00:24:00.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.249+0000 7fa7ba000640 1 -- 172.21.15.40:0/976455686 shutdown_connections 2024-09-11T00:24:00.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.249+0000 7fa7ba000640 1 --2- 172.21.15.40:0/976455686 >> v2:172.21.15.40:3300/0 conn(0x7fa7ac03b940 0x7fa7ac0066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.249+0000 7fa7ba000640 1 --2- 172.21.15.40:0/976455686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac037f10 0x7fa7ac0e6970 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.249+0000 7fa7ba000640 1 --2- 172.21.15.40:0/976455686 >> v2:172.21.15.175:3300/0 conn(0x7fa7ac0e27a0 0x7fa7ac0e6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.249+0000 7fa7ba000640 1 -- 172.21.15.40:0/976455686 >> 172.21.15.40:0/976455686 conn(0x7fa7ac03a3d0 msgr2=0x7fa7ac03a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.249+0000 7fa7ba000640 1 -- 172.21.15.40:0/976455686 shutdown_connections 2024-09-11T00:24:00.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.249+0000 7f727a600640 1 -- 172.21.15.40:0/3411546751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726c0e6f80 msgr2=0x7f726c03e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.249+0000 7f727a600640 1 --2- 172.21.15.40:0/3411546751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726c0e6f80 0x7f726c03e3e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7268009830 tx=0x7f726802a480 comp rx=0 tx=0).stop 2024-09-11T00:24:00.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.249+0000 7fa7ba000640 1 -- 172.21.15.40:0/976455686 wait complete. 2024-09-11T00:24:00.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.250+0000 7f727a600640 1 -- 172.21.15.40:0/3411546751 shutdown_connections 2024-09-11T00:24:00.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.250+0000 7f727a600640 1 --2- 172.21.15.40:0/3411546751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f726c0535b0 0x7f726c0063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.250+0000 7f727a600640 1 --2- 172.21.15.40:0/3411546751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726c0e6f80 0x7f726c03e3e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.250+0000 7f727a600640 1 -- 172.21.15.40:0/3411546751 >> 172.21.15.40:0/3411546751 conn(0x7f726c03a3d0 msgr2=0x7f726c03a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.250+0000 7f727a600640 1 -- 172.21.15.40:0/3411546751 shutdown_connections 2024-09-11T00:24:00.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.251+0000 7f17eb200640 1 -- 172.21.15.40:0/2442807073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17ec072340 msgr2=0x7f17ec06cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.251+0000 7f17eb200640 1 --2- 172.21.15.40:0/2442807073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17ec072340 0x7f17ec06cab0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f17d8009830 tx=0x7f17d802a440 comp rx=0 tx=0).stop 2024-09-11T00:24:00.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.251+0000 7fa7ba000640 1 Processor -- start 2024-09-11T00:24:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.251+0000 7f727a600640 1 -- 172.21.15.40:0/3411546751 wait complete. 2024-09-11T00:24:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.252+0000 7f17eb200640 1 -- 172.21.15.40:0/2442807073 shutdown_connections 2024-09-11T00:24:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.252+0000 7f17eb200640 1 --2- 172.21.15.40:0/2442807073 >> v2:172.21.15.175:3300/0 conn(0x7f17ec158360 0x7f17ec06cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.252+0000 7f17eb200640 1 --2- 172.21.15.40:0/2442807073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17ec072340 0x7f17ec06cab0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.252+0000 7f17eb200640 1 -- 172.21.15.40:0/2442807073 >> 172.21.15.40:0/2442807073 conn(0x7f17ec0b1500 msgr2=0x7f17ec0b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.251+0000 7fa7ba000640 1 -- start start 2024-09-11T00:24:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.252+0000 7f17eb200640 1 -- 172.21.15.40:0/2442807073 shutdown_connections 2024-09-11T00:24:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.252+0000 7fa7ba000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac037f10 0x7fa7ac03d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.253+0000 7fa7ba000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7ac03b940 0x7fa7ac051330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.253+0000 7f17eb200640 1 -- 172.21.15.40:0/2442807073 wait complete. 2024-09-11T00:24:00.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.253+0000 7ff40c200640 1 -- 172.21.15.40:0/2514757450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff404154c80 msgr2=0x7ff4040cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.253+0000 7ff40c200640 1 --2- 172.21.15.40:0/2514757450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff404154c80 0x7ff4040cdbf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4040c9800 tx=0x7ff3f402a5e0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.253+0000 7fa7ba000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7ac0e27a0 0x7fa7ac1788f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.254+0000 7fa7ba000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac006fc0 con 0x7fa7ac03b940 2024-09-11T00:24:00.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.254+0000 7fa7ba000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac006e40 con 0x7fa7ac0e27a0 2024-09-11T00:24:00.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.254+0000 7fa7ba000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa7ac007140 con 0x7fa7ac037f10 2024-09-11T00:24:00.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.254+0000 7fa7b3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7ac03b940 0x7fa7ac051330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.254+0000 7f727a600640 1 Processor -- start 2024-09-11T00:24:00.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.253+0000 7fa7b8c00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac037f10 0x7fa7ac03d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.254+0000 7fa7b8c00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac037f10 0x7fa7ac03d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.40:38410/0 (socket says 172.21.15.40:38410) 2024-09-11T00:24:00.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.254+0000 7fa7b8c00640 1 -- 172.21.15.40:0/3201295589 learned_addr learned my addr 172.21.15.40:0/3201295589 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:00.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.255+0000 7fa7b9600640 1 --2- 172.21.15.40:0/3201295589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7ac0e27a0 0x7fa7ac1788f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.254+0000 7ff40c200640 1 -- 172.21.15.40:0/2514757450 shutdown_connections 2024-09-11T00:24:00.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.255+0000 7ff40c200640 1 --2- 172.21.15.40:0/2514757450 >> v2:172.21.15.40:3300/0 conn(0x7ff4040aedc0 0x7ff4040ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.255+0000 7ff40c200640 1 --2- 172.21.15.40:0/2514757450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff404154c80 0x7ff4040cdbf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.255+0000 7ff40c200640 1 -- 172.21.15.40:0/2514757450 >> 172.21.15.40:0/2514757450 conn(0x7ff4040cc320 msgr2=0x7ff4040cc730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.255+0000 7f727a600640 1 -- start start 2024-09-11T00:24:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.255+0000 7ff40c200640 1 -- 172.21.15.40:0/2514757450 shutdown_connections 2024-09-11T00:24:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.255+0000 7fa7b8c00640 1 -- 172.21.15.40:0/3201295589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7ac0e27a0 msgr2=0x7fa7ac1788f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.255+0000 7ff40c200640 1 -- 172.21.15.40:0/2514757450 wait complete. 2024-09-11T00:24:00.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.255+0000 7f17eb200640 1 Processor -- start 2024-09-11T00:24:00.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.255+0000 7fa7b8c00640 1 --2- 172.21.15.40:0/3201295589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7ac0e27a0 0x7fa7ac1788f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.256+0000 7fa7b8c00640 1 -- 172.21.15.40:0/3201295589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7ac03b940 msgr2=0x7fa7ac051330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.256+0000 7fa7b8c00640 1 --2- 172.21.15.40:0/3201295589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7ac03b940 0x7fa7ac051330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.256+0000 7fa7b8c00640 1 -- 172.21.15.40:0/3201295589 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ac051870 con 0x7fa7ac037f10 2024-09-11T00:24:00.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.256+0000 7f17eb200640 1 -- start start 2024-09-11T00:24:00.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.256+0000 7fa7b9600640 1 --2- 172.21.15.40:0/3201295589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7ac0e27a0 0x7fa7ac1788f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:24:00.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.256+0000 7fa7b3e00640 1 --2- 172.21.15.40:0/3201295589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7ac03b940 0x7fa7ac051330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:24:00.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.256+0000 7fa7b8c00640 1 --2- 172.21.15.40:0/3201295589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac037f10 0x7fa7ac03d470 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800b440 tx=0x7fa7a800b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.257+0000 7fa7b0c00640 1 -- 172.21.15.40:0/3201295589 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8015020 con 0x7fa7ac037f10 2024-09-11T00:24:00.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.257+0000 7f727a600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f726c0535b0 0x7f726c04e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.257+0000 7f727a600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726c056420 0x7f726c0e0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.257+0000 7f727a600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f726c0e6f80 0x7f726c0e5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.257+0000 7f727a600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f726c006ca0 con 0x7f726c056420 2024-09-11T00:24:00.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.257+0000 7f727a600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f726c006b20 con 0x7f726c0535b0 2024-09-11T00:24:00.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.257+0000 7f727a600640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f726c006e20 con 0x7f726c0e6f80 2024-09-11T00:24:00.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.257+0000 7fa7b0c00640 1 -- 172.21.15.40:0/3201295589 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7a8011890 con 0x7fa7ac037f10 2024-09-11T00:24:00.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.257+0000 7fa7b0c00640 1 -- 172.21.15.40:0/3201295589 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8011ce0 con 0x7fa7ac037f10 2024-09-11T00:24:00.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.257+0000 7fa7ba000640 1 -- 172.21.15.40:0/3201295589 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7ac178e30 con 0x7fa7ac037f10 2024-09-11T00:24:00.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.258+0000 7f7273e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726c056420 0x7f726c0e0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.258+0000 7fe984800640 1 -- 172.21.15.40:0/2319798804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe97c0d2350 msgr2=0x7fe97c0d2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.258+0000 7fe984800640 1 --2- 172.21.15.40:0/2319798804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe97c0d2350 0x7fe97c0d2730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe974005fd0 tx=0x7fe97402a780 comp rx=0 tx=0).stop 2024-09-11T00:24:00.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.257+0000 7fa7ba000640 1 -- 172.21.15.40:0/3201295589 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7ac051e00 con 0x7fa7ac037f10 2024-09-11T00:24:00.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.258+0000 7f7273e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726c056420 0x7f726c0e0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39506/0 (socket says 172.21.15.40:39506) 2024-09-11T00:24:00.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.258+0000 7f7273e00640 1 -- 172.21.15.40:0/3090533615 learned_addr learned my addr 172.21.15.40:0/3090533615 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:00.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.258+0000 7ff40c200640 1 Processor -- start 2024-09-11T00:24:00.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.259+0000 7f17eb200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17ec072340 0x7f17ec1f7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.258+0000 7fa7ba000640 1 -- 172.21.15.40:0/3201295589 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa7ac04c490 con 0x7fa7ac037f10 2024-09-11T00:24:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.259+0000 7f17eb200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17ec157f80 0x7f17ec14f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.259+0000 7f7273e00640 1 -- 172.21.15.40:0/3090533615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f726c0e6f80 msgr2=0x7f726c0e5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.259+0000 7f7273e00640 1 --2- 172.21.15.40:0/3090533615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f726c0e6f80 0x7f726c0e5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.259+0000 7f7273e00640 1 -- 172.21.15.40:0/3090533615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f726c0535b0 msgr2=0x7f726c04e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.259+0000 7f7273e00640 1 --2- 172.21.15.40:0/3090533615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f726c0535b0 0x7f726c04e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.259+0000 7f7273e00640 1 -- 172.21.15.40:0/3090533615 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c0e0d60 con 0x7f726c056420 2024-09-11T00:24:00.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.259+0000 7f17eb200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17ec158360 0x7f17ec14d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.259+0000 7f17eb200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec0adeb0 con 0x7f17ec072340 2024-09-11T00:24:00.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.259+0000 7fe984800640 1 -- 172.21.15.40:0/2319798804 shutdown_connections 2024-09-11T00:24:00.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.259+0000 7fe984800640 1 --2- 172.21.15.40:0/2319798804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe97c0d4aa0 0x7fe97c0d0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.259+0000 7fe984800640 1 --2- 172.21.15.40:0/2319798804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe97c0d2350 0x7fe97c0d2730 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.259+0000 7fe984800640 1 -- 172.21.15.40:0/2319798804 >> 172.21.15.40:0/2319798804 conn(0x7fe97c0d3f80 msgr2=0x7fe97c0d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.259+0000 7ff40c200640 1 -- start start 2024-09-11T00:24:00.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.259+0000 7f7273e00640 1 --2- 172.21.15.40:0/3090533615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726c056420 0x7f726c0e0360 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f72740527e0 tx=0x7f727406de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.259+0000 7f17ea800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17ec158360 0x7f17ec14d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.259+0000 7f17ea800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17ec158360 0x7f17ec14d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.40:38450/0 (socket says 172.21.15.40:38450) 2024-09-11T00:24:00.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.259+0000 7f17ea800640 1 -- 172.21.15.40:0/4076821250 learned_addr learned my addr 172.21.15.40:0/4076821250 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:00.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.259+0000 7f17e9e00640 1 --2- 172.21.15.40:0/4076821250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17ec072340 0x7f17ec1f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.260+0000 7f17e9400640 1 --2- 172.21.15.40:0/4076821250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17ec157f80 0x7f17ec14f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.260+0000 7f17eb200640 1 -- 172.21.15.40:0/4076821250 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec0add30 con 0x7f17ec157f80 2024-09-11T00:24:00.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.260+0000 7f7270c00640 1 -- 172.21.15.40:0/3090533615 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727408f070 con 0x7f726c056420 2024-09-11T00:24:00.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.260+0000 7f17eb200640 1 -- 172.21.15.40:0/4076821250 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f17ec0ae030 con 0x7f17ec158360 2024-09-11T00:24:00.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.260+0000 7f7270c00640 1 -- 172.21.15.40:0/3090533615 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72740746c0 con 0x7f726c056420 2024-09-11T00:24:00.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.260+0000 7f7270c00640 1 -- 172.21.15.40:0/3090533615 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7274074b30 con 0x7f726c056420 2024-09-11T00:24:00.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.260+0000 7f727a600640 1 -- 172.21.15.40:0/3090533615 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726c0e1040 con 0x7f726c056420 2024-09-11T00:24:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.261+0000 7f17ea800640 1 -- 172.21.15.40:0/4076821250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17ec157f80 msgr2=0x7f17ec14f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.261+0000 7f17ea800640 1 --2- 172.21.15.40:0/4076821250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17ec157f80 0x7f17ec14f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.261+0000 7f17ea800640 1 -- 172.21.15.40:0/4076821250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17ec072340 msgr2=0x7f17ec1f7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.261+0000 7f17ea800640 1 --2- 172.21.15.40:0/4076821250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17ec072340 0x7f17ec1f7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.261+0000 7f17ea800640 1 -- 172.21.15.40:0/4076821250 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ec1f8260 con 0x7f17ec158360 2024-09-11T00:24:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.261+0000 7f17e9e00640 1 --2- 172.21.15.40:0/4076821250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17ec072340 0x7f17ec1f7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.261+0000 7f17e9400640 1 --2- 172.21.15.40:0/4076821250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17ec157f80 0x7f17ec14f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.261+0000 7fe984800640 1 -- 172.21.15.40:0/2319798804 shutdown_connections 2024-09-11T00:24:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.261+0000 7fe984800640 1 -- 172.21.15.40:0/2319798804 wait complete. 2024-09-11T00:24:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.261+0000 7f727a600640 1 -- 172.21.15.40:0/3090533615 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726c0e1600 con 0x7f726c056420 2024-09-11T00:24:00.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.261+0000 7f17ea800640 1 --2- 172.21.15.40:0/4076821250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17ec158360 0x7f17ec14d890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f17e400edc0 tx=0x7f17e400c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.262+0000 7ff40c200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4040aedc0 0x7ff404152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.262+0000 7ff40c200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4040ce130 0x7ff404152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.262+0000 7ff40c200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff404154c80 0x7ff4040b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.262+0000 7ff40c200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff4040cac40 con 0x7ff4040aedc0 2024-09-11T00:24:00.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.262+0000 7ff40c200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff4040caac0 con 0x7ff404154c80 2024-09-11T00:24:00.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.262+0000 7ff40c200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff4040cadc0 con 0x7ff4040ce130 2024-09-11T00:24:00.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.262+0000 7fc714c00640 1 -- 172.21.15.40:0/2546580777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc71015bcc0 msgr2=0x7fc7100cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.262+0000 7fc714c00640 1 --2- 172.21.15.40:0/2546580777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc71015bcc0 0x7fc7100cb420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009860 tx=0x7fc6fc02a590 comp rx=0 tx=0).stop 2024-09-11T00:24:00.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.262+0000 7ff408e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4040ce130 0x7ff404152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.262+0000 7ff408e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4040ce130 0x7ff404152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.40:38462/0 (socket says 172.21.15.40:38462) 2024-09-11T00:24:00.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.262+0000 7ff408e00640 1 -- 172.21.15.40:0/1585700889 learned_addr learned my addr 172.21.15.40:0/1585700889 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:00.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.262+0000 7ff409800640 1 --2- 172.21.15.40:0/1585700889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4040aedc0 0x7ff404152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.262+0000 7ff40a200640 1 --2- 172.21.15.40:0/1585700889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff404154c80 0x7ff4040b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.263+0000 7f17e2000640 1 -- 172.21.15.40:0/4076821250 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4004b20 con 0x7f17ec158360 2024-09-11T00:24:00.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.263+0000 7f17e2000640 1 -- 172.21.15.40:0/4076821250 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17e4004db0 con 0x7f17ec158360 2024-09-11T00:24:00.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.263+0000 7f17e2000640 1 -- 172.21.15.40:0/4076821250 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4003bb0 con 0x7f17ec158360 2024-09-11T00:24:00.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.263+0000 7ff408e00640 1 -- 172.21.15.40:0/1585700889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff404154c80 msgr2=0x7ff4040b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.263+0000 7fc714c00640 1 -- 172.21.15.40:0/2546580777 shutdown_connections 2024-09-11T00:24:00.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.263+0000 7fc714c00640 1 --2- 172.21.15.40:0/2546580777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc71015bcc0 0x7fc7100cb420 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.263+0000 7fc714c00640 1 -- 172.21.15.40:0/2546580777 >> 172.21.15.40:0/2546580777 conn(0x7fc7100cfbb0 msgr2=0x7fc7100cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.263+0000 7f727a600640 1 -- 172.21.15.40:0/3090533615 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f726c0063d0 con 0x7f726c056420 2024-09-11T00:24:00.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.262+0000 7fa7b0c00640 1 -- 172.21.15.40:0/3201295589 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa7a801a400 con 0x7fa7ac037f10 2024-09-11T00:24:00.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.263+0000 7fa7b0c00640 1 --2- 172.21.15.40:0/3201295589 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa794077fc0 0x7fa79407a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.263+0000 7fc714c00640 1 -- 172.21.15.40:0/2546580777 shutdown_connections 2024-09-11T00:24:00.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.264+0000 7ff408e00640 1 --2- 172.21.15.40:0/1585700889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff404154c80 0x7ff4040b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.264+0000 7ff408e00640 1 -- 172.21.15.40:0/1585700889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4040aedc0 msgr2=0x7ff404152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.264+0000 7ff408e00640 1 --2- 172.21.15.40:0/1585700889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4040aedc0 0x7ff404152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.264+0000 7ff408e00640 1 -- 172.21.15.40:0/1585700889 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff404153fc0 con 0x7ff4040ce130 2024-09-11T00:24:00.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.264+0000 7ff409800640 1 --2- 172.21.15.40:0/1585700889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4040aedc0 0x7ff404152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:00.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.264+0000 7ff40a200640 1 --2- 172.21.15.40:0/1585700889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff404154c80 0x7ff4040b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:00.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.264+0000 7ff408e00640 1 --2- 172.21.15.40:0/1585700889 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4040ce130 0x7ff404152cd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000c790 tx=0x7ff3f000cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.263+0000 7f17eb200640 1 -- 172.21.15.40:0/4076821250 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17ec1f8540 con 0x7f17ec158360 2024-09-11T00:24:00.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.263+0000 7f17eb200640 1 -- 172.21.15.40:0/4076821250 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f17ec14f980 con 0x7f17ec158360 2024-09-11T00:24:00.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.264+0000 7ff401600640 1 -- 172.21.15.40:0/1585700889 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0003da0 con 0x7ff4040ce130 2024-09-11T00:24:00.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.264+0000 7ff401600640 1 -- 172.21.15.40:0/1585700889 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3f0005070 con 0x7ff4040ce130 2024-09-11T00:24:00.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.265+0000 7ff401600640 1 -- 172.21.15.40:0/1585700889 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0005460 con 0x7ff4040ce130 2024-09-11T00:24:00.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.263+0000 7fc714c00640 1 -- 172.21.15.40:0/2546580777 wait complete. 2024-09-11T00:24:00.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.265+0000 7fa7b3e00640 1 --2- 172.21.15.40:0/3201295589 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa794077fc0 0x7fa79407a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.265+0000 7fc714c00640 1 Processor -- start 2024-09-11T00:24:00.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.265+0000 7fe984800640 1 Processor -- start 2024-09-11T00:24:00.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.266+0000 7fe984800640 1 -- start start 2024-09-11T00:24:00.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.266+0000 7f17eb200640 1 -- 172.21.15.40:0/4076821250 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f17ec0ae570 con 0x7f17ec158360 2024-09-11T00:24:00.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.266+0000 7fa7b0c00640 1 -- 172.21.15.40:0/3201295589 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa7a805e8b0 con 0x7fa7ac037f10 2024-09-11T00:24:00.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.266+0000 7f7270c00640 1 -- 172.21.15.40:0/3090533615 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7274074cd0 con 0x7f726c056420 2024-09-11T00:24:00.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.266+0000 7fc714c00640 1 -- start start 2024-09-11T00:24:00.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.266+0000 7ff40c200640 1 -- 172.21.15.40:0/1585700889 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff404153440 con 0x7ff4040ce130 2024-09-11T00:24:00.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.266+0000 7ff40c200640 1 -- 172.21.15.40:0/1585700889 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff404153a00 con 0x7ff4040ce130 2024-09-11T00:24:00.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.266+0000 7fa7b3e00640 1 --2- 172.21.15.40:0/3201295589 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa794077fc0 0x7fa79407a480 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0539a0 tx=0x7fa7b40a8040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.267+0000 7fa7b0c00640 1 --2- 172.21.15.40:0/3201295589 >> [v2:172.21.15.40:6821/2542266029,v1:172.21.15.40:6823/2542266029] conn(0x7fa794080ec0 0x7fa794083360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.267+0000 7fa7b0c00640 1 -- 172.21.15.40:0/3201295589 --> [v2:172.21.15.40:6821/2542266029,v1:172.21.15.40:6823/2542266029] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa794083a30 con 0x7fa794080ec0 2024-09-11T00:24:00.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.267+0000 7f900dc00640 1 -- 172.21.15.40:0/2845058113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90080d2350 msgr2=0x7f90080d2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.267+0000 7f900dc00640 1 --2- 172.21.15.40:0/2845058113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90080d2350 0x7f90080d2730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9000005fd0 tx=0x7f900002a720 comp rx=0 tx=0).stop 2024-09-11T00:24:00.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.267+0000 7fa7b0c00640 1 -- 172.21.15.40:0/3201295589 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa7a805ee30 con 0x7fa7ac037f10 2024-09-11T00:24:00.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.267+0000 7ff40c200640 1 -- 172.21.15.40:0/1585700889 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff4040cecd0 con 0x7ff4040ce130 2024-09-11T00:24:00.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.267+0000 7f900dc00640 1 -- 172.21.15.40:0/2845058113 shutdown_connections 2024-09-11T00:24:00.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.268+0000 7f900dc00640 1 --2- 172.21.15.40:0/2845058113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90080d4aa0 0x7f90080d0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.267+0000 7f7270c00640 1 --2- 172.21.15.40:0/3090533615 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7254077fc0 0x7f725407a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.268+0000 7f900dc00640 1 --2- 172.21.15.40:0/2845058113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90080d2350 0x7f90080d2730 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.268+0000 7f900dc00640 1 -- 172.21.15.40:0/2845058113 >> 172.21.15.40:0/2845058113 conn(0x7f90080d3f80 msgr2=0x7f90080d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.268+0000 7f900dc00640 1 -- 172.21.15.40:0/2845058113 shutdown_connections 2024-09-11T00:24:00.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.268+0000 7f900dc00640 1 -- 172.21.15.40:0/2845058113 wait complete. 2024-09-11T00:24:00.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.268+0000 7f7279200640 1 --2- 172.21.15.40:0/3090533615 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7254077fc0 0x7f725407a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.268+0000 7fe984800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe97c0b2e50 0x7fe97c1f7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.268+0000 7fe984800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe97c0d2350 0x7fe97c0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.268+0000 7fe984800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe97c0d4aa0 0x7fe97c15f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.268+0000 7fe984800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c0b3670 con 0x7fe97c0b2e50 2024-09-11T00:24:00.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.268+0000 7fe984800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c0b34f0 con 0x7fe97c0d2350 2024-09-11T00:24:00.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.268+0000 7fe984800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe97c15e0d0 con 0x7fe97c0d4aa0 2024-09-11T00:24:00.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.268+0000 7fc714c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc71006e910 0x7fc71014b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.268+0000 7fe981400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe97c0d2350 0x7fe97c0a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.268+0000 7fe981400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe97c0d2350 0x7fe97c0a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.40:45418/0 (socket says 172.21.15.40:45418) 2024-09-11T00:24:00.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.268+0000 7fe981400640 1 -- 172.21.15.40:0/2556452166 learned_addr learned my addr 172.21.15.40:0/2556452166 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:00.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.269+0000 7fc714c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7100cba70 0x7fc710151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.269+0000 7fe981e00640 1 --2- 172.21.15.40:0/2556452166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe97c0b2e50 0x7fe97c1f7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.269+0000 7fc70de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc71006e910 0x7fc71014b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.269+0000 7fc70de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc71006e910 0x7fc71014b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.40:45426/0 (socket says 172.21.15.40:45426) 2024-09-11T00:24:00.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.269+0000 7fc70de00640 1 -- 172.21.15.40:0/1980599586 learned_addr learned my addr 172.21.15.40:0/1980599586 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:00.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.269+0000 7fe982800640 1 --2- 172.21.15.40:0/2556452166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe97c0d4aa0 0x7fe97c15f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.269+0000 7fc714c00640 1 --2- 172.21.15.40:0/1980599586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc71015bcc0 0x7fc71015c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.269+0000 7fc70d400640 1 --2- 172.21.15.40:0/1980599586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7100cba70 0x7fc710151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.269+0000 7fe981400640 1 -- 172.21.15.40:0/2556452166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe97c0d4aa0 msgr2=0x7fe97c15f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.269+0000 7fe981400640 1 --2- 172.21.15.40:0/2556452166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe97c0d4aa0 0x7fe97c15f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.269+0000 7fe981400640 1 -- 172.21.15.40:0/2556452166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe97c0b2e50 msgr2=0x7fe97c1f7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.269+0000 7fe981400640 1 --2- 172.21.15.40:0/2556452166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe97c0b2e50 0x7fe97c1f7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.269+0000 7fe981400640 1 -- 172.21.15.40:0/2556452166 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97c1f8310 con 0x7fe97c0d2350 2024-09-11T00:24:00.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.269+0000 7fe982800640 1 --2- 172.21.15.40:0/2556452166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe97c0d4aa0 0x7fe97c15f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:00.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.269+0000 7fc714c00640 1 -- 172.21.15.40:0/1980599586 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc71006f650 con 0x7fc7100cba70 2024-09-11T00:24:00.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.269+0000 7fa7b9600640 1 --2- 172.21.15.40:0/3201295589 >> [v2:172.21.15.40:6821/2542266029,v1:172.21.15.40:6823/2542266029] conn(0x7fa794080ec0 0x7fa794083360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.270+0000 7fc70e800640 1 --2- 172.21.15.40:0/1980599586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc71015bcc0 0x7fc71015c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.270+0000 7fe981400640 1 --2- 172.21.15.40:0/2556452166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe97c0d2350 0x7fe97c0a1520 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe97800d6d0 tx=0x7fe97800db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.270+0000 7ff401600640 1 -- 172.21.15.40:0/1585700889 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff3f0005600 con 0x7ff4040ce130 2024-09-11T00:24:00.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.270+0000 7fc714c00640 1 -- 172.21.15.40:0/1980599586 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc71006f4d0 con 0x7fc71006e910 2024-09-11T00:24:00.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.270+0000 7fc714c00640 1 -- 172.21.15.40:0/1980599586 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc71006f7d0 con 0x7fc71015bcc0 2024-09-11T00:24:00.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.270+0000 7f7270c00640 1 -- 172.21.15.40:0/3090533615 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7274115070 con 0x7f726c056420 2024-09-11T00:24:00.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.270+0000 7f7270c00640 1 --2- 172.21.15.40:0/3090533615 >> [v2:172.21.15.40:6808/503633839,v1:172.21.15.40:6809/503633839] conn(0x7f7254080160 0x7f7254082580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.270+0000 7f7270c00640 1 -- 172.21.15.40:0/3090533615 --> [v2:172.21.15.40:6808/503633839,v1:172.21.15.40:6809/503633839] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f727406fe50 con 0x7f7254080160 2024-09-11T00:24:00.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.270+0000 7fa7b9600640 1 --2- 172.21.15.40:0/3201295589 >> [v2:172.21.15.40:6821/2542266029,v1:172.21.15.40:6823/2542266029] conn(0x7fa794080ec0 0x7fa794083360 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.271+0000 7fc70e800640 1 -- 172.21.15.40:0/1980599586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc71006e910 msgr2=0x7fc71014b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.271+0000 7fc70e800640 1 --2- 172.21.15.40:0/1980599586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc71006e910 0x7fc71014b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.271+0000 7fc70e800640 1 -- 172.21.15.40:0/1980599586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7100cba70 msgr2=0x7fc710151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.271+0000 7fc70e800640 1 --2- 172.21.15.40:0/1980599586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7100cba70 0x7fc710151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.271+0000 7eff55400640 1 -- 172.21.15.40:0/375749325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff500705e0 msgr2=0x7eff5015ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.271+0000 7fc70e800640 1 -- 172.21.15.40:0/1980599586 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7100c7f20 con 0x7fc71015bcc0 2024-09-11T00:24:00.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.271+0000 7eff55400640 1 --2- 172.21.15.40:0/375749325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff500705e0 0x7eff5015ad80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7eff40009830 tx=0x7eff4002a5c0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.271+0000 7fc70d400640 1 --2- 172.21.15.40:0/1980599586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7100cba70 0x7fc710151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:00.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.271+0000 7ff401600640 1 --2- 172.21.15.40:0/1585700889 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff3e4077f70 0x7ff3e407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.272+0000 7ff401600640 1 -- 172.21.15.40:0/1585700889 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff3f00998d0 con 0x7ff4040ce130 2024-09-11T00:24:00.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.272+0000 7ff409800640 1 --2- 172.21.15.40:0/1585700889 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff3e4077f70 0x7ff3e407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.272+0000 7fa7b0c00640 1 -- 172.21.15.40:0/3201295589 <== osd.1 v2:172.21.15.40:6821/2542266029 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa794083a30 con 0x7fa794080ec0 2024-09-11T00:24:00.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.272+0000 7ff401600640 1 --2- 172.21.15.40:0/1585700889 >> [v2:172.21.15.40:6815/559505356,v1:172.21.15.40:6817/559505356] conn(0x7ff3e4080170 0x7ff3e4082590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.272+0000 7ff401600640 1 -- 172.21.15.40:0/1585700889 --> [v2:172.21.15.40:6815/559505356,v1:172.21.15.40:6817/559505356] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff3e4082c40 con 0x7ff3e4080170 2024-09-11T00:24:00.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.272+0000 7fc70e800640 1 --2- 172.21.15.40:0/1980599586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc71015bcc0 0x7fc71015c580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc70800c6e0 tx=0x7fc70800cba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.272+0000 7eff55400640 1 -- 172.21.15.40:0/375749325 shutdown_connections 2024-09-11T00:24:00.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.272+0000 7eff55400640 1 --2- 172.21.15.40:0/375749325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff500705e0 0x7eff5015ad80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.272+0000 7eff55400640 1 -- 172.21.15.40:0/375749325 >> 172.21.15.40:0/375749325 conn(0x7eff500cfbb0 msgr2=0x7eff500cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.272+0000 7fe972000640 1 -- 172.21.15.40:0/2556452166 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe978017070 con 0x7fe97c0d2350 2024-09-11T00:24:00.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.272+0000 7fe972000640 1 -- 172.21.15.40:0/2556452166 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe978004310 con 0x7fe97c0d2350 2024-09-11T00:24:00.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.272+0000 7fe972000640 1 -- 172.21.15.40:0/2556452166 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe978009a20 con 0x7fe97c0d2350 2024-09-11T00:24:00.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.272+0000 7f7270c00640 1 -- 172.21.15.40:0/3090533615 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f727411c050 con 0x7f726c056420 2024-09-11T00:24:00.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.272+0000 7f7279200640 1 --2- 172.21.15.40:0/3090533615 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7254077fc0 0x7f725407a480 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7268034000 tx=0x7f72680046c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.272+0000 7ff401600640 1 -- 172.21.15.40:0/1585700889 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff3f005e310 con 0x7ff4040ce130 2024-09-11T00:24:00.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.272+0000 7fe984800640 1 -- 172.21.15.40:0/2556452166 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe97c1f85f0 con 0x7fe97c0d2350 2024-09-11T00:24:00.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.272+0000 7fe984800640 1 -- 172.21.15.40:0/2556452166 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe97c1f4830 con 0x7fe97c0d2350 2024-09-11T00:24:00.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.273+0000 7ff40a200640 1 --2- 172.21.15.40:0/1585700889 >> [v2:172.21.15.40:6815/559505356,v1:172.21.15.40:6817/559505356] conn(0x7ff3e4080170 0x7ff3e4082590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.273+0000 7ff409800640 1 --2- 172.21.15.40:0/1585700889 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff3e4077f70 0x7ff3e407a430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4033000 tx=0x7ff3f4004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.273+0000 7fc706000640 1 -- 172.21.15.40:0/1980599586 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708003b70 con 0x7fc71015bcc0 2024-09-11T00:24:00.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.273+0000 7fc706000640 1 -- 172.21.15.40:0/1980599586 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc708003d30 con 0x7fc71015bcc0 2024-09-11T00:24:00.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.274+0000 7f900dc00640 1 Processor -- start 2024-09-11T00:24:00.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.274+0000 7f7279c00640 1 --2- 172.21.15.40:0/3090533615 >> [v2:172.21.15.40:6808/503633839,v1:172.21.15.40:6809/503633839] conn(0x7f7254080160 0x7f7254082580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.273+0000 7fc714c00640 1 -- 172.21.15.40:0/1980599586 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7100c8200 con 0x7fc71015bcc0 2024-09-11T00:24:00.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.273+0000 7fc714c00640 1 -- 172.21.15.40:0/1980599586 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc71014b8e0 con 0x7fc71015bcc0 2024-09-11T00:24:00.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.274+0000 7fc706000640 1 -- 172.21.15.40:0/1980599586 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708005330 con 0x7fc71015bcc0 2024-09-11T00:24:00.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.274+0000 7fc714c00640 1 -- 172.21.15.40:0/1980599586 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc6e8001030 con 0x7fc71015bcc0 2024-09-11T00:24:00.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.274+0000 7ff40a200640 1 --2- 172.21.15.40:0/1585700889 >> [v2:172.21.15.40:6815/559505356,v1:172.21.15.40:6817/559505356] conn(0x7ff3e4080170 0x7ff3e4082590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.275+0000 7f7279c00640 1 --2- 172.21.15.40:0/3090533615 >> [v2:172.21.15.40:6808/503633839,v1:172.21.15.40:6809/503633839] conn(0x7f7254080160 0x7f7254082580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.272+0000 7eff55400640 1 -- 172.21.15.40:0/375749325 shutdown_connections 2024-09-11T00:24:00.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.272+0000 7eff55400640 1 -- 172.21.15.40:0/375749325 wait complete. 2024-09-11T00:24:00.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.275+0000 7eff55400640 1 Processor -- start 2024-09-11T00:24:00.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.275+0000 7eff55400640 1 -- start start 2024-09-11T00:24:00.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.274+0000 7f17e2000640 1 -- 172.21.15.40:0/4076821250 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f17e400b040 con 0x7f17ec158360 2024-09-11T00:24:00.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.274+0000 7fe984800640 1 -- 172.21.15.40:0/2556452166 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe97c0d1680 con 0x7fe97c0d2350 2024-09-11T00:24:00.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.276+0000 7ff401600640 1 -- 172.21.15.40:0/1585700889 <== osd.2 v2:172.21.15.40:6815/559505356 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff3e4082c40 con 0x7ff3e4080170 2024-09-11T00:24:00.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.276+0000 7f17e2000640 1 --2- 172.21.15.40:0/4076821250 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f17cc078040 0x7f17cc07a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.277+0000 7fe972000640 1 -- 172.21.15.40:0/2556452166 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe9780035f0 con 0x7fe97c0d2350 2024-09-11T00:24:00.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.276+0000 7f17e2000640 1 -- 172.21.15.40:0/4076821250 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f17e409a260 con 0x7f17ec158360 2024-09-11T00:24:00.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.276+0000 7f17e9e00640 1 --2- 172.21.15.40:0/4076821250 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f17cc078040 0x7f17cc07a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.277+0000 7f17e2000640 1 --2- 172.21.15.40:0/4076821250 >> [v2:172.21.15.40:6800/973366008,v1:172.21.15.40:6801/973366008] conn(0x7f17cc080260 0x7f17cc082680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.277+0000 7f900dc00640 1 -- start start 2024-09-11T00:24:00.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.277+0000 7eff55400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff500705e0 0x7eff50200db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.277+0000 7f7270c00640 1 -- 172.21.15.40:0/3090533615 <== osd.3 v2:172.21.15.40:6808/503633839 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f727406fe50 con 0x7f7254080160 2024-09-11T00:24:00.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.278+0000 7eff55400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff500ca910 0x7eff50201e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.277+0000 7f17e9e00640 1 --2- 172.21.15.40:0/4076821250 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f17cc078040 0x7f17cc07a500 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f17dc003eb0 tx=0x7f17dc009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.278+0000 7fc706000640 1 -- 172.21.15.40:0/1980599586 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc7080054d0 con 0x7fc71015bcc0 2024-09-11T00:24:00.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.278+0000 7f17e9400640 1 --2- 172.21.15.40:0/4076821250 >> [v2:172.21.15.40:6800/973366008,v1:172.21.15.40:6801/973366008] conn(0x7f17cc080260 0x7f17cc082680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.278+0000 7eff55400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff500ce300 0x7eff5015a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.278+0000 7eff4e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff500705e0 0x7eff50200db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.278+0000 7eff4de00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff500ca910 0x7eff50201e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.278+0000 7eff4de00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff500ca910 0x7eff50201e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.40:38474/0 (socket says 172.21.15.40:38474) 2024-09-11T00:24:00.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.278+0000 7f900dc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90080b2e50 0x7f9008161020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.278+0000 7f900dc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90080d2350 0x7f90080a1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.278+0000 7f900dc00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90080d4aa0 0x7f90080a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.278+0000 7f900dc00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f90080b3670 con 0x7f90080d2350 2024-09-11T00:24:00.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.278+0000 7f900dc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f90080b34f0 con 0x7f90080b2e50 2024-09-11T00:24:00.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.278+0000 7f900dc00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f900815e0d0 con 0x7f90080d4aa0 2024-09-11T00:24:00.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.279+0000 7f9006a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90080b2e50 0x7f9008161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.279+0000 7f9006a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90080b2e50 0x7f9008161020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.40:45438/0 (socket says 172.21.15.40:45438) 2024-09-11T00:24:00.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.279+0000 7f9006a00640 1 -- 172.21.15.40:0/3919801274 learned_addr learned my addr 172.21.15.40:0/3919801274 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:00.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.278+0000 7fe972000640 1 --2- 172.21.15.40:0/2556452166 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe960078070 0x7fe96007a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.279+0000 7fe972000640 1 -- 172.21.15.40:0/2556452166 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe97809a400 con 0x7fe97c0d2350 2024-09-11T00:24:00.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.278+0000 7eff4e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff500705e0 0x7eff50200db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.40:45428/0 (socket says 172.21.15.40:45428) 2024-09-11T00:24:00.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.278+0000 7eff4de00640 1 -- 172.21.15.40:0/6796027 learned_addr learned my addr 172.21.15.40:0/6796027 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:00.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.278+0000 7eff55400640 1 -- 172.21.15.40:0/6796027 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7eff50154650 con 0x7eff500ce300 2024-09-11T00:24:00.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.279+0000 7eff55400640 1 -- 172.21.15.40:0/6796027 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff500cf320 con 0x7eff500705e0 2024-09-11T00:24:00.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.279+0000 7eff55400640 1 -- 172.21.15.40:0/6796027 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7eff501547d0 con 0x7eff500ca910 2024-09-11T00:24:00.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.279+0000 7eff4f200640 1 --2- 172.21.15.40:0/6796027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff500ce300 0x7eff5015a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.279+0000 7f9007400640 1 --2- 172.21.15.40:0/3919801274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90080d4aa0 0x7f90080a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.279+0000 7f9006000640 1 --2- 172.21.15.40:0/3919801274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90080d2350 0x7f90080a1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.279+0000 7f9006a00640 1 -- 172.21.15.40:0/3919801274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90080d4aa0 msgr2=0x7f90080a17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.279+0000 7f9006a00640 1 --2- 172.21.15.40:0/3919801274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90080d4aa0 0x7f90080a17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.279+0000 7f9006a00640 1 -- 172.21.15.40:0/3919801274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90080d2350 msgr2=0x7f90080a1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.280+0000 7f9006a00640 1 --2- 172.21.15.40:0/3919801274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90080d2350 0x7f90080a1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.279+0000 7fe972000640 1 --2- 172.21.15.40:0/2556452166 >> [v2:172.21.15.175:6818/1431736593,v1:172.21.15.175:6819/1431736593] conn(0x7fe960080290 0x7fe9600826b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.279+0000 7fe972000640 1 -- 172.21.15.40:0/2556452166 --> [v2:172.21.15.175:6818/1431736593,v1:172.21.15.175:6819/1431736593] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe97803ee50 con 0x7fe960080290 2024-09-11T00:24:00.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.279+0000 7fe972000640 1 -- 172.21.15.40:0/2556452166 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe97809a7f0 con 0x7fe97c0d2350 2024-09-11T00:24:00.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.280+0000 7f9006a00640 1 -- 172.21.15.40:0/3919801274 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90080b8d30 con 0x7f90080b2e50 2024-09-11T00:24:00.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.280+0000 7f9006000640 1 --2- 172.21.15.40:0/3919801274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90080d2350 0x7f90080a1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:00.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.280+0000 7f9006a00640 1 --2- 172.21.15.40:0/3919801274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90080b2e50 0x7f9008161020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9000000f80 tx=0x7f9000032f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.280+0000 7f17e2000640 1 -- 172.21.15.40:0/4076821250 --> [v2:172.21.15.40:6800/973366008,v1:172.21.15.40:6801/973366008] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f17e401ce50 con 0x7f17cc080260 2024-09-11T00:24:00.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.281+0000 7f8ffea00640 1 -- 172.21.15.40:0/3919801274 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000041020 con 0x7f90080b2e50 2024-09-11T00:24:00.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.281+0000 7f8ffea00640 1 -- 172.21.15.40:0/3919801274 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9000037040 con 0x7f90080b2e50 2024-09-11T00:24:00.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.281+0000 7f900dc00640 1 -- 172.21.15.40:0/3919801274 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90080b9010 con 0x7f90080b2e50 2024-09-11T00:24:00.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.281+0000 7f8ffea00640 1 -- 172.21.15.40:0/3919801274 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000036070 con 0x7f90080b2e50 2024-09-11T00:24:00.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.280+0000 7f17e2000640 1 -- 172.21.15.40:0/4076821250 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f17e40a1050 con 0x7f17ec158360 2024-09-11T00:24:00.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.281+0000 7f900dc00640 1 -- 172.21.15.40:0/3919801274 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90080b95d0 con 0x7f90080b2e50 2024-09-11T00:24:00.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.281+0000 7f17e9400640 1 --2- 172.21.15.40:0/4076821250 >> [v2:172.21.15.40:6800/973366008,v1:172.21.15.40:6801/973366008] conn(0x7f17cc080260 0x7f17cc082680 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.280+0000 7eff4e800640 1 -- 172.21.15.40:0/6796027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff500ca910 msgr2=0x7eff50201e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.280+0000 7eff4e800640 1 --2- 172.21.15.40:0/6796027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff500ca910 0x7eff50201e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.280+0000 7eff4e800640 1 -- 172.21.15.40:0/6796027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff500ce300 msgr2=0x7eff5015a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.280+0000 7eff4e800640 1 --2- 172.21.15.40:0/6796027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff500ce300 0x7eff5015a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.280+0000 7eff4e800640 1 -- 172.21.15.40:0/6796027 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff50202370 con 0x7eff500705e0 2024-09-11T00:24:00.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.282+0000 7eff4e800640 1 --2- 172.21.15.40:0/6796027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff500705e0 0x7eff50200db0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7eff40031000 tx=0x7eff40032b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.282+0000 7f17e2000640 1 -- 172.21.15.40:0/4076821250 <== osd.0 v2:172.21.15.40:6800/973366008 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f17e401ce50 con 0x7f17cc080260 2024-09-11T00:24:00.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.282+0000 7eff46a00640 1 -- 172.21.15.40:0/6796027 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff40040070 con 0x7eff500705e0 2024-09-11T00:24:00.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.281+0000 7fc706000640 1 --2- 172.21.15.40:0/1980599586 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc6f0077f70 0x7fc6f007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.281+0000 7fc706000640 1 -- 172.21.15.40:0/1980599586 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc70809a4b0 con 0x7fc71015bcc0 2024-09-11T00:24:00.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.282+0000 7fc706000640 1 --2- 172.21.15.40:0/1980599586 >> [v2:172.21.15.175:6826/520822300,v1:172.21.15.175:6827/520822300] conn(0x7fc6f0080190 0x7fc6f00825b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.282+0000 7fc706000640 1 -- 172.21.15.40:0/1980599586 --> [v2:172.21.15.175:6826/520822300,v1:172.21.15.175:6827/520822300] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6f0082c60 con 0x7fc6f0080190 2024-09-11T00:24:00.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.282+0000 7fc706000640 1 -- 172.21.15.40:0/1980599586 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc70809a8a0 con 0x7fc71015bcc0 2024-09-11T00:24:00.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.283+0000 7fe981e00640 1 --2- 172.21.15.40:0/2556452166 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe960078070 0x7fe96007a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.283+0000 7fe982800640 1 --2- 172.21.15.40:0/2556452166 >> [v2:172.21.15.175:6818/1431736593,v1:172.21.15.175:6819/1431736593] conn(0x7fe960080290 0x7fe9600826b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.283+0000 7f900dc00640 1 -- 172.21.15.40:0/3919801274 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f90080d1730 con 0x7f90080b2e50 2024-09-11T00:24:00.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.283+0000 7eff55400640 1 -- 172.21.15.40:0/6796027 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff50159900 con 0x7eff500705e0 2024-09-11T00:24:00.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.282+0000 7eff46a00640 1 -- 172.21.15.40:0/6796027 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff40003900 con 0x7eff500705e0 2024-09-11T00:24:00.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.283+0000 7eff46a00640 1 -- 172.21.15.40:0/6796027 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff40003d50 con 0x7eff500705e0 2024-09-11T00:24:00.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.283+0000 7eff55400640 1 -- 172.21.15.40:0/6796027 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff50159e80 con 0x7eff500705e0 2024-09-11T00:24:00.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.283+0000 7fc70de00640 1 --2- 172.21.15.40:0/1980599586 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc6f0077f70 0x7fc6f007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.284+0000 7fc70d400640 1 --2- 172.21.15.40:0/1980599586 >> [v2:172.21.15.175:6826/520822300,v1:172.21.15.175:6827/520822300] conn(0x7fc6f0080190 0x7fc6f00825b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.284+0000 7eff55400640 1 -- 172.21.15.40:0/6796027 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff50158320 con 0x7eff500705e0 2024-09-11T00:24:00.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.284+0000 7f8ffea00640 1 -- 172.21.15.40:0/3919801274 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f90000045d0 con 0x7f90080b2e50 2024-09-11T00:24:00.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.284+0000 7fc70de00640 1 --2- 172.21.15.40:0/1980599586 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc6f0077f70 0x7fc6f007a430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc0095f0 tx=0x7fc6fc004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.284+0000 7fc70d400640 1 --2- 172.21.15.40:0/1980599586 >> [v2:172.21.15.175:6826/520822300,v1:172.21.15.175:6827/520822300] conn(0x7fc6f0080190 0x7fc6f00825b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.285+0000 7f8ffea00640 1 --2- 172.21.15.40:0/3919801274 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8fe8077f70 0x7f8fe807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.285+0000 7f8ffea00640 1 -- 172.21.15.40:0/3919801274 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f90000bae80 con 0x7f90080b2e50 2024-09-11T00:24:00.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.285+0000 7f8ffea00640 1 --2- 172.21.15.40:0/3919801274 >> [v2:172.21.15.175:6810/2418348042,v1:172.21.15.175:6811/2418348042] conn(0x7f8fe8080170 0x7f8fe8082590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.285+0000 7f8ffea00640 1 -- 172.21.15.40:0/3919801274 --> [v2:172.21.15.175:6810/2418348042,v1:172.21.15.175:6811/2418348042] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f900003ae50 con 0x7f8fe8080170 2024-09-11T00:24:00.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.285+0000 7f8ffea00640 1 -- 172.21.15.40:0/3919801274 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f90000c2050 con 0x7f90080b2e50 2024-09-11T00:24:00.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.286+0000 7fe981e00640 1 --2- 172.21.15.40:0/2556452166 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe960078070 0x7fe96007a530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe974033000 tx=0x7fe974004ab0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.286+0000 7fe982800640 1 --2- 172.21.15.40:0/2556452166 >> [v2:172.21.15.175:6818/1431736593,v1:172.21.15.175:6819/1431736593] conn(0x7fe960080290 0x7fe9600826b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.285+0000 7f9006000640 1 --2- 172.21.15.40:0/3919801274 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8fe8077f70 0x7f8fe807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.286+0000 7f9007400640 1 --2- 172.21.15.40:0/3919801274 >> [v2:172.21.15.175:6810/2418348042,v1:172.21.15.175:6811/2418348042] conn(0x7f8fe8080170 0x7f8fe8082590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.287+0000 7f9006000640 1 --2- 172.21.15.40:0/3919801274 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8fe8077f70 0x7f8fe807a430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f90080b54b0 tx=0x7f8ff4005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.287+0000 7f9007400640 1 --2- 172.21.15.40:0/3919801274 >> [v2:172.21.15.175:6810/2418348042,v1:172.21.15.175:6811/2418348042] conn(0x7f8fe8080170 0x7f8fe8082590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.287+0000 7fc706000640 1 -- 172.21.15.40:0/1980599586 <== osd.5 v2:172.21.15.175:6826/520822300 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc6f0082c60 con 0x7fc6f0080190 2024-09-11T00:24:00.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.287+0000 7fe972000640 1 -- 172.21.15.40:0/2556452166 <== osd.6 v2:172.21.15.175:6818/1431736593 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe97803ee50 con 0x7fe960080290 2024-09-11T00:24:00.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.287+0000 7eff46a00640 1 -- 172.21.15.40:0/6796027 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7eff40031770 con 0x7eff500705e0 2024-09-11T00:24:00.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.288+0000 7f8ffea00640 1 -- 172.21.15.40:0/3919801274 <== osd.4 v2:172.21.15.175:6810/2418348042 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f900003ae50 con 0x7f8fe8080170 2024-09-11T00:24:00.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.288+0000 7eff46a00640 1 --2- 172.21.15.40:0/6796027 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7eff30077f70 0x7eff3007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.288+0000 7eff46a00640 1 -- 172.21.15.40:0/6796027 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7eff400bb900 con 0x7eff500705e0 2024-09-11T00:24:00.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.289+0000 7eff46a00640 1 --2- 172.21.15.40:0/6796027 >> [v2:172.21.15.175:6802/3300317000,v1:172.21.15.175:6803/3300317000] conn(0x7eff30080170 0x7eff30082590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.289+0000 7eff46a00640 1 -- 172.21.15.40:0/6796027 --> [v2:172.21.15.175:6802/3300317000,v1:172.21.15.175:6803/3300317000] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff30082c40 con 0x7eff30080170 2024-09-11T00:24:00.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.289+0000 7eff46a00640 1 -- 172.21.15.40:0/6796027 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7eff400bbcb0 con 0x7eff500705e0 2024-09-11T00:24:00.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.289+0000 7eff4de00640 1 --2- 172.21.15.40:0/6796027 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7eff30077f70 0x7eff3007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.289+0000 7eff4f200640 1 --2- 172.21.15.40:0/6796027 >> [v2:172.21.15.175:6802/3300317000,v1:172.21.15.175:6803/3300317000] conn(0x7eff30080170 0x7eff30082590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.290+0000 7eff4f200640 1 --2- 172.21.15.40:0/6796027 >> [v2:172.21.15.175:6802/3300317000,v1:172.21.15.175:6803/3300317000] conn(0x7eff30080170 0x7eff30082590 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.290+0000 7eff4de00640 1 --2- 172.21.15.40:0/6796027 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7eff30077f70 0x7eff3007a430 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7eff500b1580 tx=0x7eff3c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.291+0000 7eff46a00640 1 -- 172.21.15.40:0/6796027 <== osd.7 v2:172.21.15.175:6802/3300317000 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff30082c40 con 0x7eff30080170 2024-09-11T00:24:00.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.307+0000 7ff40c200640 1 -- 172.21.15.40:0/1585700889 --> [v2:172.21.15.40:6815/559505356,v1:172.21.15.40:6817/559505356] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff4040cb270 con 0x7ff3e4080170 2024-09-11T00:24:00.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.307+0000 7fa7ba000640 1 -- 172.21.15.40:0/3201295589 --> [v2:172.21.15.40:6821/2542266029,v1:172.21.15.40:6823/2542266029] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa7ac0066f0 con 0x7fa794080ec0 2024-09-11T00:24:00.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.308+0000 7ff401600640 1 -- 172.21.15.40:0/1585700889 <== osd.2 v2:172.21.15.40:6815/559505356 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff4040cb270 con 0x7ff3e4080170 2024-09-11T00:24:00.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.308+0000 7fa7b0c00640 1 -- 172.21.15.40:0/3201295589 <== osd.1 v2:172.21.15.40:6821/2542266029 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa7ac0066f0 con 0x7fa794080ec0 2024-09-11T00:24:00.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.309+0000 7ff40c200640 1 -- 172.21.15.40:0/1585700889 >> [v2:172.21.15.40:6815/559505356,v1:172.21.15.40:6817/559505356] conn(0x7ff3e4080170 msgr2=0x7ff3e4082590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.309+0000 7ff40c200640 1 --2- 172.21.15.40:0/1585700889 >> [v2:172.21.15.40:6815/559505356,v1:172.21.15.40:6817/559505356] conn(0x7ff3e4080170 0x7ff3e4082590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.309+0000 7ff40c200640 1 -- 172.21.15.40:0/1585700889 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff3e4077f70 msgr2=0x7ff3e407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.309+0000 7ff40c200640 1 --2- 172.21.15.40:0/1585700889 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff3e4077f70 0x7ff3e407a430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4033000 tx=0x7ff3f4004730 comp rx=0 tx=0).stop 2024-09-11T00:24:00.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.309+0000 7ff40c200640 1 -- 172.21.15.40:0/1585700889 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4040ce130 msgr2=0x7ff404152cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.311+0000 7fa7ba000640 1 -- 172.21.15.40:0/3201295589 >> [v2:172.21.15.40:6821/2542266029,v1:172.21.15.40:6823/2542266029] conn(0x7fa794080ec0 msgr2=0x7fa794083360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.311+0000 7fa7ba000640 1 --2- 172.21.15.40:0/3201295589 >> [v2:172.21.15.40:6821/2542266029,v1:172.21.15.40:6823/2542266029] conn(0x7fa794080ec0 0x7fa794083360 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.311+0000 7fa7ba000640 1 -- 172.21.15.40:0/3201295589 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa794077fc0 msgr2=0x7fa79407a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.309+0000 7ff40c200640 1 --2- 172.21.15.40:0/1585700889 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4040ce130 0x7ff404152cd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000c790 tx=0x7ff3f000cc50 comp rx=0 tx=0).stop 2024-09-11T00:24:00.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.309+0000 7ff40a200640 1 -- 172.21.15.40:0/1585700889 reap_dead start 2024-09-11T00:24:00.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.309+0000 7ff40c200640 1 -- 172.21.15.40:0/1585700889 shutdown_connections 2024-09-11T00:24:00.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.309+0000 7ff40c200640 1 -- 172.21.15.40:0/1585700889 >> 172.21.15.40:0/1585700889 conn(0x7ff4040cc320 msgr2=0x7ff4040b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.311+0000 7ff40c200640 1 -- 172.21.15.40:0/1585700889 shutdown_connections 2024-09-11T00:24:00.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.311+0000 7ff40c200640 1 -- 172.21.15.40:0/1585700889 wait complete. 2024-09-11T00:24:00.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.312+0000 7fa7ba000640 1 --2- 172.21.15.40:0/3201295589 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa794077fc0 0x7fa79407a480 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0539a0 tx=0x7fa7b40a8040 comp rx=0 tx=0).stop 2024-09-11T00:24:00.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.312+0000 7fa7ba000640 1 -- 172.21.15.40:0/3201295589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac037f10 msgr2=0x7fa7ac03d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.312+0000 7fa7ba000640 1 --2- 172.21.15.40:0/3201295589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac037f10 0x7fa7ac03d470 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800b440 tx=0x7fa7a800b900 comp rx=0 tx=0).stop 2024-09-11T00:24:00.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.312+0000 7fa7b9600640 1 -- 172.21.15.40:0/3201295589 reap_dead start 2024-09-11T00:24:00.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.313+0000 7f727a600640 1 -- 172.21.15.40:0/3090533615 --> [v2:172.21.15.40:6808/503633839,v1:172.21.15.40:6809/503633839] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f726c038b70 con 0x7f7254080160 2024-09-11T00:24:00.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.313+0000 7f17eb200640 1 -- 172.21.15.40:0/4076821250 --> [v2:172.21.15.40:6800/973366008,v1:172.21.15.40:6801/973366008] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f17ec06eda0 con 0x7f17cc080260 2024-09-11T00:24:00.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.313+0000 7fa7ba000640 1 -- 172.21.15.40:0/3201295589 shutdown_connections 2024-09-11T00:24:00.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.313+0000 7fa7ba000640 1 -- 172.21.15.40:0/3201295589 >> 172.21.15.40:0/3201295589 conn(0x7fa7ac03a3d0 msgr2=0x7fa7ac00e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.313+0000 7f7270c00640 1 -- 172.21.15.40:0/3090533615 <== osd.3 v2:172.21.15.40:6808/503633839 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f726c038b70 con 0x7f7254080160 2024-09-11T00:24:00.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.314+0000 7fa7ba000640 1 -- 172.21.15.40:0/3201295589 shutdown_connections 2024-09-11T00:24:00.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.314+0000 7fa7ba000640 1 -- 172.21.15.40:0/3201295589 wait complete. 2024-09-11T00:24:00.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.314+0000 7f17e2000640 1 -- 172.21.15.40:0/4076821250 <== osd.0 v2:172.21.15.40:6800/973366008 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f17ec06eda0 con 0x7f17cc080260 2024-09-11T00:24:00.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.315+0000 7f727a600640 1 -- 172.21.15.40:0/3090533615 >> [v2:172.21.15.40:6808/503633839,v1:172.21.15.40:6809/503633839] conn(0x7f7254080160 msgr2=0x7f7254082580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.315+0000 7f727a600640 1 --2- 172.21.15.40:0/3090533615 >> [v2:172.21.15.40:6808/503633839,v1:172.21.15.40:6809/503633839] conn(0x7f7254080160 0x7f7254082580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.315+0000 7f727a600640 1 -- 172.21.15.40:0/3090533615 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7254077fc0 msgr2=0x7f725407a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.315+0000 7f727a600640 1 --2- 172.21.15.40:0/3090533615 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7254077fc0 0x7f725407a480 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7268034000 tx=0x7f72680046c0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.315+0000 7f727a600640 1 -- 172.21.15.40:0/3090533615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726c056420 msgr2=0x7f726c0e0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.315+0000 7f727a600640 1 --2- 172.21.15.40:0/3090533615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726c056420 0x7f726c0e0360 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f72740527e0 tx=0x7f727406de90 comp rx=0 tx=0).stop 2024-09-11T00:24:00.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.315+0000 7f7279c00640 1 -- 172.21.15.40:0/3090533615 reap_dead start 2024-09-11T00:24:00.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.315+0000 7f727a600640 1 -- 172.21.15.40:0/3090533615 shutdown_connections 2024-09-11T00:24:00.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.315+0000 7f727a600640 1 -- 172.21.15.40:0/3090533615 >> 172.21.15.40:0/3090533615 conn(0x7f726c03a3d0 msgr2=0x7f726c0390c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.315+0000 7f17eb200640 1 -- 172.21.15.40:0/4076821250 >> [v2:172.21.15.40:6800/973366008,v1:172.21.15.40:6801/973366008] conn(0x7f17cc080260 msgr2=0x7f17cc082680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.315+0000 7f17eb200640 1 --2- 172.21.15.40:0/4076821250 >> [v2:172.21.15.40:6800/973366008,v1:172.21.15.40:6801/973366008] conn(0x7f17cc080260 0x7f17cc082680 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.316+0000 7f17eb200640 1 -- 172.21.15.40:0/4076821250 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f17cc078040 msgr2=0x7f17cc07a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.316+0000 7f17eb200640 1 --2- 172.21.15.40:0/4076821250 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f17cc078040 0x7f17cc07a500 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f17dc003eb0 tx=0x7f17dc009040 comp rx=0 tx=0).stop 2024-09-11T00:24:00.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.316+0000 7f17eb200640 1 -- 172.21.15.40:0/4076821250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17ec158360 msgr2=0x7f17ec14d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.316+0000 7f17eb200640 1 --2- 172.21.15.40:0/4076821250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17ec158360 0x7f17ec14d890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f17e400edc0 tx=0x7f17e400c740 comp rx=0 tx=0).stop 2024-09-11T00:24:00.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.316+0000 7f17ea800640 1 -- 172.21.15.40:0/4076821250 reap_dead start 2024-09-11T00:24:00.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.316+0000 7f17eb200640 1 -- 172.21.15.40:0/4076821250 shutdown_connections 2024-09-11T00:24:00.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.316+0000 7f17eb200640 1 -- 172.21.15.40:0/4076821250 >> 172.21.15.40:0/4076821250 conn(0x7f17ec0b1500 msgr2=0x7f17ec160750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.317+0000 7f17eb200640 1 -- 172.21.15.40:0/4076821250 shutdown_connections 2024-09-11T00:24:00.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.317+0000 7f17eb200640 1 -- 172.21.15.40:0/4076821250 wait complete. 2024-09-11T00:24:00.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.318+0000 7fe984800640 1 -- 172.21.15.40:0/2556452166 --> [v2:172.21.15.175:6818/1431736593,v1:172.21.15.175:6819/1431736593] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe97c06ecc0 con 0x7fe960080290 2024-09-11T00:24:00.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.318+0000 7f727a600640 1 -- 172.21.15.40:0/3090533615 shutdown_connections 2024-09-11T00:24:00.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.318+0000 7f727a600640 1 -- 172.21.15.40:0/3090533615 wait complete. 2024-09-11T00:24:00.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.319+0000 7fe972000640 1 -- 172.21.15.40:0/2556452166 <== osd.6 v2:172.21.15.175:6818/1431736593 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe97c06ecc0 con 0x7fe960080290 2024-09-11T00:24:00.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.321+0000 7f900dc00640 1 -- 172.21.15.40:0/3919801274 --> [v2:172.21.15.175:6810/2418348042,v1:172.21.15.175:6811/2418348042] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f900806d8e0 con 0x7f8fe8080170 2024-09-11T00:24:00.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.320+0000 7fe984800640 1 -- 172.21.15.40:0/2556452166 >> [v2:172.21.15.175:6818/1431736593,v1:172.21.15.175:6819/1431736593] conn(0x7fe960080290 msgr2=0x7fe9600826b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.320+0000 7fe984800640 1 --2- 172.21.15.40:0/2556452166 >> [v2:172.21.15.175:6818/1431736593,v1:172.21.15.175:6819/1431736593] conn(0x7fe960080290 0x7fe9600826b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.321+0000 7fe984800640 1 -- 172.21.15.40:0/2556452166 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe960078070 msgr2=0x7fe96007a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.321+0000 7fe984800640 1 --2- 172.21.15.40:0/2556452166 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe960078070 0x7fe96007a530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe974033000 tx=0x7fe974004ab0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.321+0000 7fe984800640 1 -- 172.21.15.40:0/2556452166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe97c0d2350 msgr2=0x7fe97c0a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.321+0000 7fe984800640 1 --2- 172.21.15.40:0/2556452166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe97c0d2350 0x7fe97c0a1520 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe97800d6d0 tx=0x7fe97800db90 comp rx=0 tx=0).stop 2024-09-11T00:24:00.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.322+0000 7fe982800640 1 -- 172.21.15.40:0/2556452166 reap_dead start 2024-09-11T00:24:00.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.322+0000 7fc714c00640 1 -- 172.21.15.40:0/1980599586 --> [v2:172.21.15.175:6826/520822300,v1:172.21.15.175:6827/520822300] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc6e8002dd0 con 0x7fc6f0080190 2024-09-11T00:24:00.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.322+0000 7fe984800640 1 -- 172.21.15.40:0/2556452166 shutdown_connections 2024-09-11T00:24:00.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.322+0000 7fe984800640 1 -- 172.21.15.40:0/2556452166 >> 172.21.15.40:0/2556452166 conn(0x7fe97c0d3f80 msgr2=0x7fe97c0b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.322+0000 7fe984800640 1 -- 172.21.15.40:0/2556452166 shutdown_connections 2024-09-11T00:24:00.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.322+0000 7fe984800640 1 -- 172.21.15.40:0/2556452166 wait complete. 2024-09-11T00:24:00.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.322+0000 7f8ffea00640 1 -- 172.21.15.40:0/3919801274 <== osd.4 v2:172.21.15.175:6810/2418348042 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f900806d8e0 con 0x7f8fe8080170 2024-09-11T00:24:00.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.322+0000 7fc706000640 1 -- 172.21.15.40:0/1980599586 <== osd.5 v2:172.21.15.175:6826/520822300 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc6e8002dd0 con 0x7fc6f0080190 2024-09-11T00:24:00.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.322+0000 7eff55400640 1 -- 172.21.15.40:0/6796027 --> [v2:172.21.15.175:6802/3300317000,v1:172.21.15.175:6803/3300317000] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7eff500ce790 con 0x7eff30080170 2024-09-11T00:24:00.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.323+0000 7f900dc00640 1 -- 172.21.15.40:0/3919801274 >> [v2:172.21.15.175:6810/2418348042,v1:172.21.15.175:6811/2418348042] conn(0x7f8fe8080170 msgr2=0x7f8fe8082590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.323+0000 7f900dc00640 1 --2- 172.21.15.40:0/3919801274 >> [v2:172.21.15.175:6810/2418348042,v1:172.21.15.175:6811/2418348042] conn(0x7f8fe8080170 0x7f8fe8082590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.323+0000 7fc714c00640 1 -- 172.21.15.40:0/1980599586 >> [v2:172.21.15.175:6826/520822300,v1:172.21.15.175:6827/520822300] conn(0x7fc6f0080190 msgr2=0x7fc6f00825b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.323+0000 7fc714c00640 1 --2- 172.21.15.40:0/1980599586 >> [v2:172.21.15.175:6826/520822300,v1:172.21.15.175:6827/520822300] conn(0x7fc6f0080190 0x7fc6f00825b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.323+0000 7fc714c00640 1 -- 172.21.15.40:0/1980599586 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc6f0077f70 msgr2=0x7fc6f007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.323+0000 7fc714c00640 1 --2- 172.21.15.40:0/1980599586 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc6f0077f70 0x7fc6f007a430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc0095f0 tx=0x7fc6fc004730 comp rx=0 tx=0).stop 2024-09-11T00:24:00.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.323+0000 7fc714c00640 1 -- 172.21.15.40:0/1980599586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc71015bcc0 msgr2=0x7fc71015c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.323+0000 7fc714c00640 1 --2- 172.21.15.40:0/1980599586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc71015bcc0 0x7fc71015c580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc70800c6e0 tx=0x7fc70800cba0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.323+0000 7f900dc00640 1 -- 172.21.15.40:0/3919801274 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8fe8077f70 msgr2=0x7f8fe807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.324+0000 7f900dc00640 1 --2- 172.21.15.40:0/3919801274 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8fe8077f70 0x7f8fe807a430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f90080b54b0 tx=0x7f8ff4005f90 comp rx=0 tx=0).stop 2024-09-11T00:24:00.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.324+0000 7f900dc00640 1 -- 172.21.15.40:0/3919801274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90080b2e50 msgr2=0x7f9008161020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.324+0000 7f900dc00640 1 --2- 172.21.15.40:0/3919801274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90080b2e50 0x7f9008161020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9000000f80 tx=0x7f9000032f90 comp rx=0 tx=0).stop 2024-09-11T00:24:00.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.324+0000 7f9007400640 1 -- 172.21.15.40:0/3919801274 reap_dead start 2024-09-11T00:24:00.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.324+0000 7fc70e800640 1 -- 172.21.15.40:0/1980599586 reap_dead start 2024-09-11T00:24:00.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.324+0000 7fc714c00640 1 -- 172.21.15.40:0/1980599586 shutdown_connections 2024-09-11T00:24:00.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.324+0000 7fc714c00640 1 -- 172.21.15.40:0/1980599586 >> 172.21.15.40:0/1980599586 conn(0x7fc7100cfbb0 msgr2=0x7fc710155b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.324+0000 7eff46a00640 1 -- 172.21.15.40:0/6796027 <== osd.7 v2:172.21.15.175:6802/3300317000 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7eff500ce790 con 0x7eff30080170 2024-09-11T00:24:00.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.325+0000 7eff55400640 1 -- 172.21.15.40:0/6796027 >> [v2:172.21.15.175:6802/3300317000,v1:172.21.15.175:6803/3300317000] conn(0x7eff30080170 msgr2=0x7eff30082590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.325+0000 7f900dc00640 1 -- 172.21.15.40:0/3919801274 shutdown_connections 2024-09-11T00:24:00.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.325+0000 7f900dc00640 1 -- 172.21.15.40:0/3919801274 >> 172.21.15.40:0/3919801274 conn(0x7f90080d3f80 msgr2=0x7f90080b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.325+0000 7eff55400640 1 --2- 172.21.15.40:0/6796027 >> [v2:172.21.15.175:6802/3300317000,v1:172.21.15.175:6803/3300317000] conn(0x7eff30080170 0x7eff30082590 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.325+0000 7fc714c00640 1 -- 172.21.15.40:0/1980599586 shutdown_connections 2024-09-11T00:24:00.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.325+0000 7f900dc00640 1 -- 172.21.15.40:0/3919801274 shutdown_connections 2024-09-11T00:24:00.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.325+0000 7f900dc00640 1 -- 172.21.15.40:0/3919801274 wait complete. 2024-09-11T00:24:00.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.325+0000 7fc714c00640 1 -- 172.21.15.40:0/1980599586 wait complete. 2024-09-11T00:24:00.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.325+0000 7eff55400640 1 -- 172.21.15.40:0/6796027 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7eff30077f70 msgr2=0x7eff3007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.325+0000 7eff55400640 1 --2- 172.21.15.40:0/6796027 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7eff30077f70 0x7eff3007a430 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7eff500b1580 tx=0x7eff3c009040 comp rx=0 tx=0).stop 2024-09-11T00:24:00.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.325+0000 7eff55400640 1 -- 172.21.15.40:0/6796027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff500705e0 msgr2=0x7eff50200db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.325+0000 7eff55400640 1 --2- 172.21.15.40:0/6796027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff500705e0 0x7eff50200db0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7eff40031000 tx=0x7eff40032b90 comp rx=0 tx=0).stop 2024-09-11T00:24:00.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.325+0000 7eff4f200640 1 -- 172.21.15.40:0/6796027 reap_dead start 2024-09-11T00:24:00.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.326+0000 7eff55400640 1 -- 172.21.15.40:0/6796027 shutdown_connections 2024-09-11T00:24:00.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.326+0000 7eff55400640 1 -- 172.21.15.40:0/6796027 >> 172.21.15.40:0/6796027 conn(0x7eff500cfbb0 msgr2=0x7eff5015ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.328+0000 7eff55400640 1 -- 172.21.15.40:0/6796027 shutdown_connections 2024-09-11T00:24:00.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.328+0000 7eff55400640 1 -- 172.21.15.40:0/6796027 wait complete. 2024-09-11T00:24:00.343 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-09-11T00:24:00.343 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T00:24:00.351 INFO:teuthology.orchestra.run.smithi040.stdout:60129542152 2024-09-11T00:24:00.351 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-09-11T00:24:00.352 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T00:24:00.352 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T00:24:00.353 INFO:teuthology.orchestra.run.smithi040.stdout:64424509448 2024-09-11T00:24:00.353 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T00:24:00.354 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-09-11T00:24:00.355 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T00:24:00.356 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-09-11T00:24:00.356 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T00:24:00.357 INFO:teuthology.orchestra.run.smithi040.stdout:64424509446 2024-09-11T00:24:00.357 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T00:24:00.358 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-09-11T00:24:00.359 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T00:24:00.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.630+0000 7fb368200640 1 -- 172.21.15.40:0/1687479767 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb35803ab00 msgr2=0x7fb358037930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.630+0000 7fb368200640 1 --2- 172.21.15.40:0/1687479767 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb35803ab00 0x7fb358037930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb34c009830 tx=0x7fb34c02a5a0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.631+0000 7fb368200640 1 -- 172.21.15.40:0/1687479767 shutdown_connections 2024-09-11T00:24:00.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.631+0000 7fb368200640 1 --2- 172.21.15.40:0/1687479767 >> v2:172.21.15.175:3300/0 conn(0x7fb3580e39d0 0x7fb358052e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.631+0000 7fb368200640 1 --2- 172.21.15.40:0/1687479767 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb35803ab00 0x7fb358037930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.631+0000 7fb368200640 1 -- 172.21.15.40:0/1687479767 >> 172.21.15.40:0/1687479767 conn(0x7fb358055530 msgr2=0x7fb358055910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.631+0000 7fb368200640 1 -- 172.21.15.40:0/1687479767 shutdown_connections 2024-09-11T00:24:00.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.632+0000 7fb368200640 1 -- 172.21.15.40:0/1687479767 wait complete. 2024-09-11T00:24:00.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.634+0000 7fb368200640 1 Processor -- start 2024-09-11T00:24:00.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.635+0000 7fb368200640 1 -- start start 2024-09-11T00:24:00.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.637+0000 7fb368200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb35803ab00 0x7fb358036da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.638+0000 7fb368200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3580e2a50 0x7fb3580527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.638+0000 7fb365800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb35803ab00 0x7fb358036da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.638+0000 7fb365800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb35803ab00 0x7fb358036da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39586/0 (socket says 172.21.15.40:39586) 2024-09-11T00:24:00.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.638+0000 7fb365800640 1 -- 172.21.15.40:0/1567611654 learned_addr learned my addr 172.21.15.40:0/1567611654 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:00.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.639+0000 7fb368200640 1 --2- 172.21.15.40:0/1567611654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3580e39d0 0x7fb3580e4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.640+0000 7fccd9000640 1 -- 172.21.15.40:0/4176777916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccd40d09e0 msgr2=0x7fccd406cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.640+0000 7fccd9000640 1 --2- 172.21.15.40:0/4176777916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccd40d09e0 0x7fccd406cfc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fccd40b6790 tx=0x7fcccc02a870 comp rx=0 tx=0).stop 2024-09-11T00:24:00.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.640+0000 7fccd9000640 1 -- 172.21.15.40:0/4176777916 shutdown_connections 2024-09-11T00:24:00.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.640+0000 7fccd9000640 1 --2- 172.21.15.40:0/4176777916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccd40d09e0 0x7fccd406cfc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.640+0000 7fccd9000640 1 --2- 172.21.15.40:0/4176777916 >> v2:172.21.15.40:3300/0 conn(0x7fccd415dd10 0x7fccd40d4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.640+0000 7fccd9000640 1 -- 172.21.15.40:0/4176777916 >> 172.21.15.40:0/4176777916 conn(0x7fccd40d3c20 msgr2=0x7fccd40d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.640+0000 7fb366200640 1 --2- 172.21.15.40:0/1567611654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3580e39d0 0x7fb3580e4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.640+0000 7fb364e00640 1 --2- 172.21.15.40:0/1567611654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3580e2a50 0x7fb3580527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.641+0000 7fb368200640 1 -- 172.21.15.40:0/1567611654 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb358053760 con 0x7fb35803ab00 2024-09-11T00:24:00.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.641+0000 7fb368200640 1 -- 172.21.15.40:0/1567611654 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb3580535e0 con 0x7fb3580e39d0 2024-09-11T00:24:00.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.641+0000 7fb368200640 1 -- 172.21.15.40:0/1567611654 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb3580538e0 con 0x7fb3580e2a50 2024-09-11T00:24:00.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.641+0000 7fccd9000640 1 -- 172.21.15.40:0/4176777916 shutdown_connections 2024-09-11T00:24:00.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.641+0000 7fccd9000640 1 -- 172.21.15.40:0/4176777916 wait complete. 2024-09-11T00:24:00.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.641+0000 7fb365800640 1 -- 172.21.15.40:0/1567611654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3580e2a50 msgr2=0x7fb3580527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.641+0000 7fb365800640 1 --2- 172.21.15.40:0/1567611654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3580e2a50 0x7fb3580527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.641+0000 7fb365800640 1 -- 172.21.15.40:0/1567611654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3580e39d0 msgr2=0x7fb3580e4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.641+0000 7fb365800640 1 --2- 172.21.15.40:0/1567611654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3580e39d0 0x7fb3580e4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.642+0000 7fb365800640 1 -- 172.21.15.40:0/1567611654 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3581791c0 con 0x7fb35803ab00 2024-09-11T00:24:00.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.642+0000 7fb365800640 1 --2- 172.21.15.40:0/1567611654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb35803ab00 0x7fb358036da0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb35400c410 tx=0x7fb35400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.643+0000 7ff578e00640 1 -- 172.21.15.40:0/1584813275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5580039b0 msgr2=0x7ff558003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.643+0000 7ff578e00640 1 --2- 172.21.15.40:0/1584813275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5580039b0 0x7ff558003d90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff56400bb20 tx=0x7ff558005830 comp rx=0 tx=0).stop 2024-09-11T00:24:00.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.644+0000 7ff578e00640 1 -- 172.21.15.40:0/1584813275 shutdown_connections 2024-09-11T00:24:00.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.644+0000 7ff578e00640 1 --2- 172.21.15.40:0/1584813275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5580039b0 0x7ff558003d90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.644+0000 7ff578e00640 1 -- 172.21.15.40:0/1584813275 >> 172.21.15.40:0/1584813275 conn(0x7ff56c055530 msgr2=0x7ff56c055910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.644+0000 7fccd9000640 1 Processor -- start 2024-09-11T00:24:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.644+0000 7fb35d600640 1 -- 172.21.15.40:0/1567611654 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354017070 con 0x7fb35803ab00 2024-09-11T00:24:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.644+0000 7ff578e00640 1 -- 172.21.15.40:0/1584813275 shutdown_connections 2024-09-11T00:24:00.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.644+0000 7fb35d600640 1 -- 172.21.15.40:0/1567611654 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3540035f0 con 0x7fb35803ab00 2024-09-11T00:24:00.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.644+0000 7fb35d600640 1 -- 172.21.15.40:0/1567611654 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354003a40 con 0x7fb35803ab00 2024-09-11T00:24:00.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.644+0000 7fccd9000640 1 -- start start 2024-09-11T00:24:00.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.644+0000 7fb368200640 1 -- 172.21.15.40:0/1567611654 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3581794a0 con 0x7fb35803ab00 2024-09-11T00:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.646+0000 7fccd9000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccd40b2d20 0x7fccd415fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.646+0000 7fccd9000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccd40d09e0 0x7fccd41f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.646+0000 7fccd9000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccd415dd10 0x7fccd40ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.646+0000 7fccd9000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fccd406d890 con 0x7fccd415dd10 2024-09-11T00:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.646+0000 7fccd9000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fccd406d710 con 0x7fccd40d09e0 2024-09-11T00:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.646+0000 7fccd9000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fccd406da10 con 0x7fccd40b2d20 2024-09-11T00:24:00.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.644+0000 7fb368200640 1 -- 172.21.15.40:0/1567611654 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb358179f80 con 0x7fb35803ab00 2024-09-11T00:24:00.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.644+0000 7ff578e00640 1 -- 172.21.15.40:0/1584813275 wait complete. 2024-09-11T00:24:00.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.646+0000 7fccd3400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccd40b2d20 0x7fccd415fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.646+0000 7fccd3400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccd40b2d20 0x7fccd415fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.40:38526/0 (socket says 172.21.15.40:38526) 2024-09-11T00:24:00.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.646+0000 7fccd3400640 1 -- 172.21.15.40:0/1288423256 learned_addr learned my addr 172.21.15.40:0/1288423256 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:00.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.646+0000 7fccd3e00640 1 --2- 172.21.15.40:0/1288423256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccd415dd10 0x7fccd40ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.647+0000 7fccd3e00640 1 -- 172.21.15.40:0/1288423256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccd40b2d20 msgr2=0x7fccd415fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.647+0000 7fccd3e00640 1 --2- 172.21.15.40:0/1288423256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccd40b2d20 0x7fccd415fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.647+0000 7fccd3e00640 1 -- 172.21.15.40:0/1288423256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccd40d09e0 msgr2=0x7fccd41f3ca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:24:00.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.648+0000 7fb368200640 1 -- 172.21.15.40:0/1567611654 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb33c005290 con 0x7fb35803ab00 2024-09-11T00:24:00.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.647+0000 7fccd3e00640 1 --2- 172.21.15.40:0/1288423256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccd40d09e0 0x7fccd41f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.647+0000 7fccd3e00640 1 -- 172.21.15.40:0/1288423256 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd40c78d0 con 0x7fccd415dd10 2024-09-11T00:24:00.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.648+0000 7fccd3e00640 1 --2- 172.21.15.40:0/1288423256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccd415dd10 0x7fccd40ccec0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcccc009000 tx=0x7fcccc032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.648+0000 7ff578e00640 1 Processor -- start 2024-09-11T00:24:00.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.649+0000 7fe583e00640 1 -- 172.21.15.40:0/4121896682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5840d0290 msgr2=0x7fe58406f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.649+0000 7ff578e00640 1 -- start start 2024-09-11T00:24:00.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.649+0000 7fe583e00640 1 --2- 172.21.15.40:0/4121896682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5840d0290 0x7fe58406f340 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe574009830 tx=0x7fe57402a4a0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.649+0000 7f8895c00640 1 -- 172.21.15.40:0/1554028971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f889015e100 msgr2=0x7f889015ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.649+0000 7f8895c00640 1 --2- 172.21.15.40:0/1554028971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f889015e100 0x7f889015ba60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f88900cc5d0 tx=0x7f887c02a580 comp rx=0 tx=0).stop 2024-09-11T00:24:00.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.650+0000 7fe583e00640 1 -- 172.21.15.40:0/4121896682 shutdown_connections 2024-09-11T00:24:00.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.650+0000 7fe583e00640 1 --2- 172.21.15.40:0/4121896682 >> v2:172.21.15.40:3300/0 conn(0x7fe58406f880 0x7fe5841593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.650+0000 7fe583e00640 1 --2- 172.21.15.40:0/4121896682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5840d0290 0x7fe58406f340 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.650+0000 7fe583e00640 1 -- 172.21.15.40:0/4121896682 >> 172.21.15.40:0/4121896682 conn(0x7fe5840cf770 msgr2=0x7fe5840cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.650+0000 7fe583e00640 1 -- 172.21.15.40:0/4121896682 shutdown_connections 2024-09-11T00:24:00.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.650+0000 7fe583e00640 1 -- 172.21.15.40:0/4121896682 wait complete. 2024-09-11T00:24:00.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.651+0000 7ff578e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5580039b0 0x7ff56c17f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.651+0000 7ff578e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56c0e5410 0x7ff56c0e5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.651+0000 7ff578e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff56c16e3a0 0x7ff56c16e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.651+0000 7ff578e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c03a570 con 0x7ff56c16e3a0 2024-09-11T00:24:00.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.651+0000 7ff578e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c03a3f0 con 0x7ff56c0e5410 2024-09-11T00:24:00.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.651+0000 7ff578e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff56c03a6f0 con 0x7ff5580039b0 2024-09-11T00:24:00.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.652+0000 7f8895c00640 1 -- 172.21.15.40:0/1554028971 shutdown_connections 2024-09-11T00:24:00.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.652+0000 7f8895c00640 1 --2- 172.21.15.40:0/1554028971 >> v2:172.21.15.175:3300/0 conn(0x7f88900cae90 0x7f889015e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.652+0000 7f8895c00640 1 --2- 172.21.15.40:0/1554028971 >> v2:172.21.15.40:3300/0 conn(0x7f889015c3b0 0x7f88900ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.652+0000 7f8895c00640 1 --2- 172.21.15.40:0/1554028971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f889015e100 0x7f889015ba60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.652+0000 7f8895c00640 1 -- 172.21.15.40:0/1554028971 >> 172.21.15.40:0/1554028971 conn(0x7f88900cfbb0 msgr2=0x7f88900cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.652+0000 7f8895c00640 1 -- 172.21.15.40:0/1554028971 shutdown_connections 2024-09-11T00:24:00.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.652+0000 7ff572800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff56c16e3a0 0x7ff56c16e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.652+0000 7ff571400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56c0e5410 0x7ff56c0e5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.652+0000 7ff571400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56c0e5410 0x7ff56c0e5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.40:45478/0 (socket says 172.21.15.40:45478) 2024-09-11T00:24:00.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.652+0000 7ff571400640 1 -- 172.21.15.40:0/2069491890 learned_addr learned my addr 172.21.15.40:0/2069491890 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:00.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.653+0000 7ff572800640 1 -- 172.21.15.40:0/2069491890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5580039b0 msgr2=0x7ff56c17f930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:24:00.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.653+0000 7ff572800640 1 --2- 172.21.15.40:0/2069491890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5580039b0 0x7ff56c17f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.653+0000 7ff572800640 1 -- 172.21.15.40:0/2069491890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56c0e5410 msgr2=0x7ff56c0e5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.652+0000 7f8895c00640 1 -- 172.21.15.40:0/1554028971 wait complete. 2024-09-11T00:24:00.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.653+0000 7ff572800640 1 --2- 172.21.15.40:0/2069491890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56c0e5410 0x7ff56c0e5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.654+0000 7ff572800640 1 -- 172.21.15.40:0/2069491890 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56c04e3f0 con 0x7ff56c16e3a0 2024-09-11T00:24:00.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.653+0000 7fe583e00640 1 Processor -- start 2024-09-11T00:24:00.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.654+0000 7fe583e00640 1 -- start start 2024-09-11T00:24:00.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.654+0000 7ff572800640 1 --2- 172.21.15.40:0/2069491890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff56c16e3a0 0x7ff56c16e850 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff57406b260 tx=0x7ff574072690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.655+0000 7fb35d600640 1 -- 172.21.15.40:0/1567611654 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb354003be0 con 0x7fb35803ab00 2024-09-11T00:24:00.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.656+0000 7f8895c00640 1 Processor -- start 2024-09-11T00:24:00.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.656+0000 7f53bba00640 1 -- 172.21.15.40:0/4263282410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53b406e550 msgr2=0x7f53b4154e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.656+0000 7f53bba00640 1 --2- 172.21.15.40:0/4263282410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53b406e550 0x7f53b4154e20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f53a8005fd0 tx=0x7f53a802a5f0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.656+0000 7fe583e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe58406f880 0x7fe584159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.656+0000 7fe583e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe584070260 0x7fe5840c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.656+0000 7fe583e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5840d0290 0x7fe5840c2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.656+0000 7fe583e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe5840ca340 con 0x7fe584070260 2024-09-11T00:24:00.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.656+0000 7fe583e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe5840aeb30 con 0x7fe5840d0290 2024-09-11T00:24:00.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.656+0000 7fe583e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe5840ca4c0 con 0x7fe58406f880 2024-09-11T00:24:00.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.656+0000 7fe583400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5840d0290 0x7fe5840c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.656+0000 7fe583400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5840d0290 0x7fe5840c2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.40:45496/0 (socket says 172.21.15.40:45496) 2024-09-11T00:24:00.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.656+0000 7fe583400640 1 -- 172.21.15.40:0/837485444 learned_addr learned my addr 172.21.15.40:0/837485444 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:00.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.656+0000 7fe582a00640 1 --2- 172.21.15.40:0/837485444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe58406f880 0x7fe584159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.657+0000 7fe57be00640 1 --2- 172.21.15.40:0/837485444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe584070260 0x7fe5840c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.656+0000 7f8895c00640 1 -- start start 2024-09-11T00:24:00.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.657+0000 7f53bba00640 1 -- 172.21.15.40:0/4263282410 shutdown_connections 2024-09-11T00:24:00.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.657+0000 7f53bba00640 1 --2- 172.21.15.40:0/4263282410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53b406e550 0x7f53b4154e20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.657+0000 7fe582a00640 1 -- 172.21.15.40:0/837485444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5840d0290 msgr2=0x7fe5840c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.657+0000 7f53bba00640 1 --2- 172.21.15.40:0/4263282410 >> v2:172.21.15.40:3300/0 conn(0x7f53b415efe0 0x7f53b415e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.657+0000 7f53bba00640 1 -- 172.21.15.40:0/4263282410 >> 172.21.15.40:0/4263282410 conn(0x7f53b40cfbb0 msgr2=0x7f53b40cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.657+0000 7f53bba00640 1 -- 172.21.15.40:0/4263282410 shutdown_connections 2024-09-11T00:24:00.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.657+0000 7f53bba00640 1 -- 172.21.15.40:0/4263282410 wait complete. 2024-09-11T00:24:00.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.657+0000 7fe582a00640 1 --2- 172.21.15.40:0/837485444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5840d0290 0x7fe5840c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.657+0000 7fe582a00640 1 -- 172.21.15.40:0/837485444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe584070260 msgr2=0x7fe5840c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.657+0000 7fe582a00640 1 --2- 172.21.15.40:0/837485444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe584070260 0x7fe5840c1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.657+0000 7fe582a00640 1 -- 172.21.15.40:0/837485444 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5840c8aa0 con 0x7fe58406f880 2024-09-11T00:24:00.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.657+0000 7f8895c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88900cae90 0x7f88900c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.657+0000 7f8895c00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f889015c3b0 0x7f88900b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.657+0000 7f8895c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f889015e100 0x7f88901f9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.657+0000 7f8895c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f889015eb10 con 0x7f88900cae90 2024-09-11T00:24:00.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.657+0000 7f8895c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f88900ca410 con 0x7f889015e100 2024-09-11T00:24:00.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.657+0000 7f8895c00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f889015ec90 con 0x7f889015c3b0 2024-09-11T00:24:00.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.658+0000 7fe582a00640 1 --2- 172.21.15.40:0/837485444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe58406f880 0x7fe584159d30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe56c00c500 tx=0x7fe56c00c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.658+0000 7fb35d600640 1 --2- 172.21.15.40:0/1567611654 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb340078040 0x7fb34007a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.658+0000 7fb35d600640 1 -- 172.21.15.40:0/1567611654 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb354099690 con 0x7fb35803ab00 2024-09-11T00:24:00.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.658+0000 7f888e000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f889015c3b0 0x7f88900b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.658+0000 7fe57aa00640 1 -- 172.21.15.40:0/837485444 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c017070 con 0x7fe58406f880 2024-09-11T00:24:00.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.658+0000 7f888e000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f889015c3b0 0x7f88900b4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.40:38570/0 (socket says 172.21.15.40:38570) 2024-09-11T00:24:00.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.658+0000 7f888e000640 1 -- 172.21.15.40:0/3863836375 learned_addr learned my addr 172.21.15.40:0/3863836375 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:00.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.658+0000 7f888f400640 1 --2- 172.21.15.40:0/3863836375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f889015e100 0x7f88901f9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.658+0000 7f888ea00640 1 --2- 172.21.15.40:0/3863836375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88900cae90 0x7f88900c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.658+0000 7f888f400640 1 -- 172.21.15.40:0/3863836375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f889015c3b0 msgr2=0x7f88900b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.659+0000 7fe57aa00640 1 -- 172.21.15.40:0/837485444 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe56c0035f0 con 0x7fe58406f880 2024-09-11T00:24:00.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.659+0000 7fe57aa00640 1 -- 172.21.15.40:0/837485444 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c003a80 con 0x7fe58406f880 2024-09-11T00:24:00.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.658+0000 7fb364e00640 1 --2- 172.21.15.40:0/1567611654 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb340078040 0x7fb34007a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.658+0000 7f888f400640 1 --2- 172.21.15.40:0/3863836375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f889015c3b0 0x7f88900b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.658+0000 7f888f400640 1 -- 172.21.15.40:0/3863836375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88900cae90 msgr2=0x7f88900c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.658+0000 7f888f400640 1 --2- 172.21.15.40:0/3863836375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88900cae90 0x7f88900c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.658+0000 7f888f400640 1 -- 172.21.15.40:0/3863836375 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88900b4d50 con 0x7f889015e100 2024-09-11T00:24:00.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.659+0000 7f888ea00640 1 --2- 172.21.15.40:0/3863836375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88900cae90 0x7f88900c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:00.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.659+0000 7fcccb400640 1 -- 172.21.15.40:0/1288423256 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc040070 con 0x7fccd415dd10 2024-09-11T00:24:00.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.659+0000 7ff56a000640 1 -- 172.21.15.40:0/2069491890 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57406cad0 con 0x7ff56c16e3a0 2024-09-11T00:24:00.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.659+0000 7fccd9000640 1 -- 172.21.15.40:0/1288423256 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd40c7bb0 con 0x7fccd415dd10 2024-09-11T00:24:00.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.659+0000 7fccd9000640 1 -- 172.21.15.40:0/1288423256 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd40c8170 con 0x7fccd415dd10 2024-09-11T00:24:00.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.659+0000 7ff56a000640 1 -- 172.21.15.40:0/2069491890 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff57406c760 con 0x7ff56c16e3a0 2024-09-11T00:24:00.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.659+0000 7ff56a000640 1 -- 172.21.15.40:0/2069491890 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff574072d90 con 0x7ff56c16e3a0 2024-09-11T00:24:00.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.660+0000 7f53bba00640 1 Processor -- start 2024-09-11T00:24:00.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.659+0000 7fe583e00640 1 -- 172.21.15.40:0/837485444 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5840c8d80 con 0x7fe58406f880 2024-09-11T00:24:00.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.659+0000 7fe583e00640 1 -- 172.21.15.40:0/837485444 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5840c9340 con 0x7fe58406f880 2024-09-11T00:24:00.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.660+0000 7fcccb400640 1 -- 172.21.15.40:0/1288423256 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcccc0042f0 con 0x7fccd415dd10 2024-09-11T00:24:00.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.660+0000 7ff578e00640 1 -- 172.21.15.40:0/2069491890 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff56c04e6d0 con 0x7ff56c16e3a0 2024-09-11T00:24:00.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.660+0000 7fcccb400640 1 -- 172.21.15.40:0/1288423256 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc004720 con 0x7fccd415dd10 2024-09-11T00:24:00.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.660+0000 7fb35d600640 1 -- 172.21.15.40:0/1567611654 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb354021020 con 0x7fb35803ab00 2024-09-11T00:24:00.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.660+0000 7ff578e00640 1 -- 172.21.15.40:0/2069491890 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff56c04ec90 con 0x7ff56c16e3a0 2024-09-11T00:24:00.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.661+0000 7fb364e00640 1 --2- 172.21.15.40:0/1567611654 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb340078040 0x7fb34007a500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb34c034000 tx=0x7fb34c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.660+0000 7f53bba00640 1 -- start start 2024-09-11T00:24:00.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.661+0000 7fe583e00640 1 -- 172.21.15.40:0/837485444 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe584072e70 con 0x7fe58406f880 2024-09-11T00:24:00.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.661+0000 7f888f400640 1 --2- 172.21.15.40:0/3863836375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f889015e100 0x7f88901f9ae0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f888800e940 tx=0x7f888800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.661+0000 7f9342800640 1 -- 172.21.15.40:0/224445248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933c0c9dc0 msgr2=0x7f933c0cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.661+0000 7f9342800640 1 --2- 172.21.15.40:0/224445248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933c0c9dc0 0x7f933c0cc680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f933c0c3270 tx=0x7f932802a4b0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.661+0000 7f8886a00640 1 -- 172.21.15.40:0/3863836375 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888800cd80 con 0x7f889015e100 2024-09-11T00:24:00.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.661+0000 7f8886a00640 1 -- 172.21.15.40:0/3863836375 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8888004b20 con 0x7f889015e100 2024-09-11T00:24:00.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.661+0000 7f8886a00640 1 -- 172.21.15.40:0/3863836375 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888005020 con 0x7f889015e100 2024-09-11T00:24:00.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.662+0000 7f8895c00640 1 -- 172.21.15.40:0/3863836375 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88900b5030 con 0x7f889015e100 2024-09-11T00:24:00.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.662+0000 7f8895c00640 1 -- 172.21.15.40:0/3863836375 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88900b55f0 con 0x7f889015e100 2024-09-11T00:24:00.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.662+0000 7fccd9000640 1 -- 172.21.15.40:0/1288423256 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccac005290 con 0x7fccd415dd10 2024-09-11T00:24:00.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.662+0000 7f23df600640 1 -- 172.21.15.40:0/1180800653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d80d1140 msgr2=0x7f23d806e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.662+0000 7f23df600640 1 --2- 172.21.15.40:0/1180800653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d80d1140 0x7f23d806e210 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f23c4005fd0 tx=0x7f23c402a440 comp rx=0 tx=0).stop 2024-09-11T00:24:00.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.662+0000 7f53bba00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53b406e550 0x7f53b414ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.662+0000 7f53bba00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b406fc10 0x7f53b414c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.662+0000 7f53bba00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53b415efe0 0x7f53b40740d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.662+0000 7f53bba00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f53b40701e0 con 0x7f53b406fc10 2024-09-11T00:24:00.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.662+0000 7f53bba00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f53b4070060 con 0x7f53b415efe0 2024-09-11T00:24:00.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.662+0000 7f53bba00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f53b4070360 con 0x7f53b406e550 2024-09-11T00:24:00.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.663+0000 7f9342800640 1 -- 172.21.15.40:0/224445248 shutdown_connections 2024-09-11T00:24:00.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.663+0000 7f9342800640 1 --2- 172.21.15.40:0/224445248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933c0c9dc0 0x7f933c0cc680 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.663+0000 7f9342800640 1 --2- 172.21.15.40:0/224445248 >> v2:172.21.15.40:3300/0 conn(0x7f933c0aed30 0x7f933c0cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.663+0000 7f9342800640 1 -- 172.21.15.40:0/224445248 >> 172.21.15.40:0/224445248 conn(0x7f933c0b1280 msgr2=0x7f933c0b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.663+0000 7f23df600640 1 -- 172.21.15.40:0/1180800653 shutdown_connections 2024-09-11T00:24:00.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.663+0000 7f23df600640 1 --2- 172.21.15.40:0/1180800653 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23d8070b50 0x7f23d8070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.663+0000 7f23df600640 1 --2- 172.21.15.40:0/1180800653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d80d1140 0x7f23d806e210 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.663+0000 7f23df600640 1 -- 172.21.15.40:0/1180800653 >> 172.21.15.40:0/1180800653 conn(0x7f23d80d1d50 msgr2=0x7f23d80d2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:00.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.663+0000 7f53b9000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53b406e550 0x7f53b414ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.663+0000 7f53b9000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53b406e550 0x7f53b414ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.40:38574/0 (socket says 172.21.15.40:38574) 2024-09-11T00:24:00.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.663+0000 7f53b9000640 1 -- 172.21.15.40:0/2134698515 learned_addr learned my addr 172.21.15.40:0/2134698515 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:00.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.664+0000 7f9342800640 1 -- 172.21.15.40:0/224445248 shutdown_connections 2024-09-11T00:24:00.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.664+0000 7fcccb400640 1 -- 172.21.15.40:0/1288423256 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcccc03c420 con 0x7fccd415dd10 2024-09-11T00:24:00.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.664+0000 7f53b9000640 1 -- 172.21.15.40:0/2134698515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53b415efe0 msgr2=0x7f53b40740d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:24:00.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.664+0000 7f8895c00640 1 -- 172.21.15.40:0/3863836375 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8868005290 con 0x7f889015e100 2024-09-11T00:24:00.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.664+0000 7f53b9000640 1 --2- 172.21.15.40:0/2134698515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53b415efe0 0x7f53b40740d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.664+0000 7f53b9000640 1 -- 172.21.15.40:0/2134698515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b406fc10 msgr2=0x7f53b414c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.664+0000 7f53b9000640 1 --2- 172.21.15.40:0/2134698515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b406fc10 0x7f53b414c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.664+0000 7f53b9000640 1 -- 172.21.15.40:0/2134698515 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b4152fe0 con 0x7f53b406e550 2024-09-11T00:24:00.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.665+0000 7fcccb400640 1 --2- 172.21.15.40:0/1288423256 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fccb4077f70 0x7fccb407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.664+0000 7ff578e00640 1 -- 172.21.15.40:0/2069491890 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff56c037af0 con 0x7ff56c16e3a0 2024-09-11T00:24:00.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.665+0000 7fe57aa00640 1 -- 172.21.15.40:0/837485444 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe56c003c20 con 0x7fe58406f880 2024-09-11T00:24:00.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.666+0000 7fcccb400640 1 -- 172.21.15.40:0/1288423256 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcccc07ff00 con 0x7fccd415dd10 2024-09-11T00:24:00.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.667+0000 7f53b9000640 1 --2- 172.21.15.40:0/2134698515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53b406e550 0x7f53b414ee60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f53a400d750 tx=0x7f53a400dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.667+0000 7f23df600640 1 -- 172.21.15.40:0/1180800653 shutdown_connections 2024-09-11T00:24:00.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.665+0000 7f9342800640 1 -- 172.21.15.40:0/224445248 wait complete. 2024-09-11T00:24:00.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.667+0000 7f23df600640 1 -- 172.21.15.40:0/1180800653 wait complete. 2024-09-11T00:24:00.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.667+0000 7f8886a00640 1 -- 172.21.15.40:0/3863836375 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f88880051c0 con 0x7f889015e100 2024-09-11T00:24:00.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.667+0000 7fe57aa00640 1 --2- 172.21.15.40:0/837485444 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe560077fc0 0x7fe56007a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.667+0000 7fe57aa00640 1 -- 172.21.15.40:0/837485444 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe56c099350 con 0x7fe58406f880 2024-09-11T00:24:00.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.667+0000 7fe57be00640 1 --2- 172.21.15.40:0/837485444 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe560077fc0 0x7fe56007a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.667+0000 7fccd3400640 1 --2- 172.21.15.40:0/1288423256 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fccb4077f70 0x7fccb407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.668+0000 7f9342800640 1 Processor -- start 2024-09-11T00:24:00.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.668+0000 7ff56a000640 1 -- 172.21.15.40:0/2069491890 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff574094430 con 0x7ff56c16e3a0 2024-09-11T00:24:00.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.668+0000 7f8886a00640 1 --2- 172.21.15.40:0/3863836375 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8870078040 0x7f887007a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.669+0000 7f8886a00640 1 -- 172.21.15.40:0/3863836375 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f888809a840 con 0x7f889015e100 2024-09-11T00:24:00.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.669+0000 7f9342800640 1 -- start start 2024-09-11T00:24:00.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.669+0000 7f888ea00640 1 --2- 172.21.15.40:0/3863836375 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8870078040 0x7f887007a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.669+0000 7fccd3400640 1 --2- 172.21.15.40:0/1288423256 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fccb4077f70 0x7fccb407a430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fccc40058c0 tx=0x7fccc400b410 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.669+0000 7f23df600640 1 Processor -- start 2024-09-11T00:24:00.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.669+0000 7fe57be00640 1 --2- 172.21.15.40:0/837485444 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe560077fc0 0x7fe56007a480 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe574034000 tx=0x7fe574004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.669+0000 7ff56a000640 1 --2- 172.21.15.40:0/2069491890 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff554077fc0 0x7ff55407a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.669+0000 7ff56a000640 1 -- 172.21.15.40:0/2069491890 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff574115a60 con 0x7ff56c16e3a0 2024-09-11T00:24:00.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.670+0000 7ff571e00640 1 --2- 172.21.15.40:0/2069491890 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff554077fc0 0x7ff55407a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.669+0000 7f23df600640 1 -- start start 2024-09-11T00:24:00.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.670+0000 7f888ea00640 1 --2- 172.21.15.40:0/3863836375 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8870078040 0x7f887007a500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f887c033000 tx=0x7f887c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.671+0000 7f23df600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23d806de30 0x7f23d815c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.671+0000 7ff571e00640 1 --2- 172.21.15.40:0/2069491890 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff554077fc0 0x7ff55407a480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff564036000 tx=0x7ff5640046c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.671+0000 7f23df600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23d8070b50 0x7f23d81565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.671+0000 7f23df600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d80d1140 0x7f23d80aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.671+0000 7f23df600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f23d80d0d70 con 0x7f23d80d1140 2024-09-11T00:24:00.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.671+0000 7f23df600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f23d80b1110 con 0x7f23d806de30 2024-09-11T00:24:00.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.671+0000 7f23df600640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f23d80d0ef0 con 0x7f23d8070b50 2024-09-11T00:24:00.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.671+0000 7f23dcc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23d806de30 0x7f23d815c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.671+0000 7f23dd600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d80d1140 0x7f23d80aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.671+0000 7f23dcc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23d806de30 0x7f23d815c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.40:45512/0 (socket says 172.21.15.40:45512) 2024-09-11T00:24:00.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.671+0000 7f23dcc00640 1 -- 172.21.15.40:0/1173625768 learned_addr learned my addr 172.21.15.40:0/1173625768 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:00.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.671+0000 7f9342800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f933c06e120 0x7f933c0c1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.671+0000 7f23d7e00640 1 --2- 172.21.15.40:0/1173625768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23d8070b50 0x7f23d81565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.671+0000 7f9342800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933c0aed30 0x7f933c169bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.671+0000 7f9342800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f933c0c9dc0 0x7f933c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.672+0000 7f9340a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933c0aed30 0x7f933c169bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.672+0000 7f23dcc00640 1 -- 172.21.15.40:0/1173625768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23d8070b50 msgr2=0x7f23d81565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.672+0000 7f23dcc00640 1 --2- 172.21.15.40:0/1173625768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23d8070b50 0x7f23d81565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.672+0000 7f23dcc00640 1 -- 172.21.15.40:0/1173625768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d80d1140 msgr2=0x7f23d80aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.672+0000 7f23dcc00640 1 --2- 172.21.15.40:0/1173625768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d80d1140 0x7f23d80aea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.672+0000 7f23dcc00640 1 -- 172.21.15.40:0/1173625768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d80c92b0 con 0x7f23d806de30 2024-09-11T00:24:00.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.672+0000 7f9340a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933c0aed30 0x7f933c169bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.40:45522/0 (socket says 172.21.15.40:45522) 2024-09-11T00:24:00.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.672+0000 7f9340a00640 1 -- 172.21.15.40:0/136178415 learned_addr learned my addr 172.21.15.40:0/136178415 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:00.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.672+0000 7f9341400640 1 --2- 172.21.15.40:0/136178415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f933c06e120 0x7f933c0c1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.672+0000 7f23dcc00640 1 --2- 172.21.15.40:0/1173625768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23d806de30 0x7f23d815c2e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00c730 tx=0x7f23cc00cb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.672+0000 7f9341e00640 1 --2- 172.21.15.40:0/136178415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f933c0c9dc0 0x7f933c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.673+0000 7f9342800640 1 -- 172.21.15.40:0/136178415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f933c074470 con 0x7f933c06e120 2024-09-11T00:24:00.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.673+0000 7f9342800640 1 -- 172.21.15.40:0/136178415 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f933c06ee90 con 0x7f933c0aed30 2024-09-11T00:24:00.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.673+0000 7f9342800640 1 -- 172.21.15.40:0/136178415 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f933c06f830 con 0x7f933c0c9dc0 2024-09-11T00:24:00.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.673+0000 7f23d4c00640 1 -- 172.21.15.40:0/1173625768 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc017070 con 0x7f23d806de30 2024-09-11T00:24:00.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.673+0000 7f53b0c00640 1 -- 172.21.15.40:0/2134698515 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a4017070 con 0x7f53b406e550 2024-09-11T00:24:00.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.673+0000 7f53b0c00640 1 -- 172.21.15.40:0/2134698515 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53a4004310 con 0x7f53b406e550 2024-09-11T00:24:00.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.673+0000 7f53b0c00640 1 -- 172.21.15.40:0/2134698515 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a400de60 con 0x7f53b406e550 2024-09-11T00:24:00.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.673+0000 7f9341400640 1 -- 172.21.15.40:0/136178415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f933c0c9dc0 msgr2=0x7f933c0b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.673+0000 7f53bba00640 1 -- 172.21.15.40:0/2134698515 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b414f4f0 con 0x7f53b406e550 2024-09-11T00:24:00.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.674+0000 7f9341400640 1 --2- 172.21.15.40:0/136178415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f933c0c9dc0 0x7f933c0b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.674+0000 7f9341400640 1 -- 172.21.15.40:0/136178415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933c0aed30 msgr2=0x7f933c169bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:00.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.674+0000 7f8886a00640 1 -- 172.21.15.40:0/3863836375 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8888063320 con 0x7f889015e100 2024-09-11T00:24:00.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.674+0000 7fe57aa00640 1 -- 172.21.15.40:0/837485444 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe56c061970 con 0x7fe58406f880 2024-09-11T00:24:00.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.674+0000 7f53bba00640 1 -- 172.21.15.40:0/2134698515 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b40738d0 con 0x7f53b406e550 2024-09-11T00:24:00.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.675+0000 7f23d4c00640 1 -- 172.21.15.40:0/1173625768 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23cc005360 con 0x7f23d806de30 2024-09-11T00:24:00.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.675+0000 7f23d4c00640 1 -- 172.21.15.40:0/1173625768 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc00a8a0 con 0x7f23d806de30 2024-09-11T00:24:00.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.675+0000 7f23df600640 1 -- 172.21.15.40:0/1173625768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d80c9590 con 0x7f23d806de30 2024-09-11T00:24:00.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.675+0000 7f23df600640 1 -- 172.21.15.40:0/1173625768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d80cb9b0 con 0x7f23d806de30 2024-09-11T00:24:00.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.674+0000 7f9341400640 1 --2- 172.21.15.40:0/136178415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933c0aed30 0x7f933c169bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:00.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.674+0000 7f9341400640 1 -- 172.21.15.40:0/136178415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933c08b0b0 con 0x7f933c06e120 2024-09-11T00:24:00.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.674+0000 7f9340a00640 1 --2- 172.21.15.40:0/136178415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933c0aed30 0x7f933c169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:24:00.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.674+0000 7f9341400640 1 --2- 172.21.15.40:0/136178415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f933c06e120 0x7f933c0c1060 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9330005fd0 tx=0x7f933000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.675+0000 7f9341e00640 1 --2- 172.21.15.40:0/136178415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f933c0c9dc0 0x7f933c0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:00.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.676+0000 7fcccb400640 1 -- 172.21.15.40:0/1288423256 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcccc084390 con 0x7fccd415dd10 2024-09-11T00:24:00.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.676+0000 7f23df600640 1 -- 172.21.15.40:0/1173625768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d80b1d30 con 0x7f23d806de30 2024-09-11T00:24:00.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.675+0000 7f53bba00640 1 -- 172.21.15.40:0/2134698515 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53b415e3d0 con 0x7f53b406e550 2024-09-11T00:24:00.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.677+0000 7f53b0c00640 1 -- 172.21.15.40:0/2134698515 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f53a4009c30 con 0x7f53b406e550 2024-09-11T00:24:00.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.679+0000 7f23d4c00640 1 -- 172.21.15.40:0/1173625768 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f23cc038ac0 con 0x7f23d806de30 2024-09-11T00:24:00.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.679+0000 7f53b0c00640 1 --2- 172.21.15.40:0/2134698515 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5398077fa0 0x7f539807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.679+0000 7f53b0c00640 1 -- 172.21.15.40:0/2134698515 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f53a409a6d0 con 0x7f53b406e550 2024-09-11T00:24:00.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.680+0000 7f53b3e00640 1 --2- 172.21.15.40:0/2134698515 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5398077fa0 0x7f539807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.681+0000 7f53b3e00640 1 --2- 172.21.15.40:0/2134698515 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5398077fa0 0x7f539807a460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f53a8032000 tx=0x7f53a80046c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.681+0000 7f23d4c00640 1 --2- 172.21.15.40:0/1173625768 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f23b8078070 0x7f23b807a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.681+0000 7f23d4c00640 1 -- 172.21.15.40:0/1173625768 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f23cc099470 con 0x7f23d806de30 2024-09-11T00:24:00.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.682+0000 7f53b0c00640 1 -- 172.21.15.40:0/2134698515 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f53a4020020 con 0x7f53b406e550 2024-09-11T00:24:00.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.682+0000 7f23d7e00640 1 --2- 172.21.15.40:0/1173625768 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f23b8078070 0x7f23b807a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.683+0000 7f23d4c00640 1 -- 172.21.15.40:0/1173625768 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f23cc061990 con 0x7f23d806de30 2024-09-11T00:24:00.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.683+0000 7f23d7e00640 1 --2- 172.21.15.40:0/1173625768 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f23b8078070 0x7f23b807a530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f23c4033000 tx=0x7f23c4004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.684+0000 7f9339600640 1 -- 172.21.15.40:0/136178415 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933000edf0 con 0x7f933c06e120 2024-09-11T00:24:00.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.684+0000 7f9342800640 1 -- 172.21.15.40:0/136178415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f933c085cd0 con 0x7f933c06e120 2024-09-11T00:24:00.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.684+0000 7ff56a000640 1 -- 172.21.15.40:0/2069491890 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff56c03ad40 con 0x7ff56c16e3a0 2024-09-11T00:24:00.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.684+0000 7f9342800640 1 -- 172.21.15.40:0/136178415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f933c16a890 con 0x7f933c06e120 2024-09-11T00:24:00.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.685+0000 7f9339600640 1 -- 172.21.15.40:0/136178415 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9330004020 con 0x7f933c06e120 2024-09-11T00:24:00.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.686+0000 7f9339600640 1 -- 172.21.15.40:0/136178415 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933000edf0 con 0x7f933c06e120 2024-09-11T00:24:00.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.688+0000 7f9342800640 1 -- 172.21.15.40:0/136178415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f933c08b950 con 0x7f933c06e120 2024-09-11T00:24:00.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.689+0000 7f9339600640 1 -- 172.21.15.40:0/136178415 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f93300041d0 con 0x7f933c06e120 2024-09-11T00:24:00.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.691+0000 7f9339600640 1 --2- 172.21.15.40:0/136178415 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f931c078170 0x7f931c07a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:00.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.691+0000 7f9339600640 1 -- 172.21.15.40:0/136178415 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f933009a3f0 con 0x7f933c06e120 2024-09-11T00:24:00.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.692+0000 7f9340a00640 1 --2- 172.21.15.40:0/136178415 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f931c078170 0x7f931c07a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:00.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.696+0000 7f9340a00640 1 --2- 172.21.15.40:0/136178415 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f931c078170 0x7f931c07a630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f933c0cc2a0 tx=0x7f9328004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:00.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:00.699+0000 7f9339600640 1 -- 172.21.15.40:0/136178415 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f933c08b950 con 0x7f933c06e120 2024-09-11T00:24:01.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.105+0000 7fb368200640 1 -- 172.21.15.40:0/1567611654 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb33c005850 con 0x7fb35803ab00 2024-09-11T00:24:01.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.106+0000 7fb35d600640 1 -- 172.21.15.40:0/1567611654 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb354061bb0 con 0x7fb35803ab00 2024-09-11T00:24:01.108 INFO:teuthology.orchestra.run.smithi040.stdout:64424509446 2024-09-11T00:24:01.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.111+0000 7fb368200640 1 -- 172.21.15.40:0/1567611654 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb340078040 msgr2=0x7fb34007a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:01.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.111+0000 7fb368200640 1 --2- 172.21.15.40:0/1567611654 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb340078040 0x7fb34007a500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb34c034000 tx=0x7fb34c004730 comp rx=0 tx=0).stop 2024-09-11T00:24:01.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.111+0000 7fb368200640 1 -- 172.21.15.40:0/1567611654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb35803ab00 msgr2=0x7fb358036da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:01.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.111+0000 7fb368200640 1 --2- 172.21.15.40:0/1567611654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb35803ab00 0x7fb358036da0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb35400c410 tx=0x7fb35400c810 comp rx=0 tx=0).stop 2024-09-11T00:24:01.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.111+0000 7fb368200640 1 -- 172.21.15.40:0/1567611654 shutdown_connections 2024-09-11T00:24:01.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.111+0000 7fb368200640 1 --2- 172.21.15.40:0/1567611654 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb340078040 0x7fb34007a500 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb34c034000 tx=0x7fb34c004730 comp rx=0 tx=0).stop 2024-09-11T00:24:01.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.111+0000 7fb368200640 1 --2- 172.21.15.40:0/1567611654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3580e39d0 0x7fb3580e4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.111+0000 7fb368200640 1 --2- 172.21.15.40:0/1567611654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3580e2a50 0x7fb3580527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.111+0000 7fb368200640 1 --2- 172.21.15.40:0/1567611654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb35803ab00 0x7fb358036da0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.111+0000 7fb368200640 1 -- 172.21.15.40:0/1567611654 >> 172.21.15.40:0/1567611654 conn(0x7fb358055530 msgr2=0x7fb35803a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:01.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.112+0000 7fb368200640 1 -- 172.21.15.40:0/1567611654 shutdown_connections 2024-09-11T00:24:01.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.112+0000 7fb368200640 1 -- 172.21.15.40:0/1567611654 wait complete. 2024-09-11T00:24:01.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.121+0000 7fe583e00640 1 -- 172.21.15.40:0/837485444 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe5841593c0 con 0x7fe58406f880 2024-09-11T00:24:01.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.121+0000 7f8895c00640 1 -- 172.21.15.40:0/3863836375 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f8868005580 con 0x7f889015e100 2024-09-11T00:24:01.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.122+0000 7fe57aa00640 1 -- 172.21.15.40:0/837485444 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe56c0663a0 con 0x7fe58406f880 2024-09-11T00:24:01.123 INFO:teuthology.orchestra.run.smithi040.stdout:64424509446 2024-09-11T00:24:01.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.123+0000 7f8886a00640 1 -- 172.21.15.40:0/3863836375 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8888062c20 con 0x7f889015e100 2024-09-11T00:24:01.130 INFO:teuthology.orchestra.run.smithi040.stdout:60129542151 2024-09-11T00:24:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.126+0000 7fccd9000640 1 -- 172.21.15.40:0/1288423256 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fccac005850 con 0x7fccd415dd10 2024-09-11T00:24:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.127+0000 7fcccb400640 1 -- 172.21.15.40:0/1288423256 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcccc083c90 con 0x7fccd415dd10 2024-09-11T00:24:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.126+0000 7fe583e00640 1 -- 172.21.15.40:0/837485444 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe560077fc0 msgr2=0x7fe56007a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.126+0000 7fe583e00640 1 --2- 172.21.15.40:0/837485444 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe560077fc0 0x7fe56007a480 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe574034000 tx=0x7fe574004730 comp rx=0 tx=0).stop 2024-09-11T00:24:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.126+0000 7fe583e00640 1 -- 172.21.15.40:0/837485444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe58406f880 msgr2=0x7fe584159d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:01.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.126+0000 7fe583e00640 1 --2- 172.21.15.40:0/837485444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe58406f880 0x7fe584159d30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe56c00c500 tx=0x7fe56c00c9c0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.131 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-09-11T00:24:01.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.129+0000 7fe583e00640 1 -- 172.21.15.40:0/837485444 shutdown_connections 2024-09-11T00:24:01.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.129+0000 7fe583e00640 1 --2- 172.21.15.40:0/837485444 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe560077fc0 0x7fe56007a480 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.129+0000 7fe583e00640 1 --2- 172.21.15.40:0/837485444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5840d0290 0x7fe5840c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.129+0000 7fe583e00640 1 --2- 172.21.15.40:0/837485444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe584070260 0x7fe5840c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.129+0000 7fe583e00640 1 --2- 172.21.15.40:0/837485444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe58406f880 0x7fe584159d30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.129+0000 7fe583e00640 1 -- 172.21.15.40:0/837485444 >> 172.21.15.40:0/837485444 conn(0x7fe5840cf770 msgr2=0x7fe584073150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:01.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.129+0000 7fe583e00640 1 -- 172.21.15.40:0/837485444 shutdown_connections 2024-09-11T00:24:01.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.129+0000 7fe583e00640 1 -- 172.21.15.40:0/837485444 wait complete. 2024-09-11T00:24:01.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7f8895c00640 1 -- 172.21.15.40:0/3863836375 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8870078040 msgr2=0x7f887007a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7fccd9000640 1 -- 172.21.15.40:0/1288423256 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fccb4077f70 msgr2=0x7fccb407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7fccd9000640 1 --2- 172.21.15.40:0/1288423256 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fccb4077f70 0x7fccb407a430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fccc40058c0 tx=0x7fccc400b410 comp rx=0 tx=0).stop 2024-09-11T00:24:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7fccd9000640 1 -- 172.21.15.40:0/1288423256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccd415dd10 msgr2=0x7fccd40ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7fccd9000640 1 --2- 172.21.15.40:0/1288423256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccd415dd10 0x7fccd40ccec0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcccc009000 tx=0x7fcccc032c00 comp rx=0 tx=0).stop 2024-09-11T00:24:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7f8895c00640 1 --2- 172.21.15.40:0/3863836375 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8870078040 0x7f887007a500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f887c033000 tx=0x7f887c004730 comp rx=0 tx=0).stop 2024-09-11T00:24:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7f8895c00640 1 -- 172.21.15.40:0/3863836375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f889015e100 msgr2=0x7f88901f9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7f8895c00640 1 --2- 172.21.15.40:0/3863836375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f889015e100 0x7f88901f9ae0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f888800e940 tx=0x7f888800ee00 comp rx=0 tx=0).stop 2024-09-11T00:24:01.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7f8895c00640 1 -- 172.21.15.40:0/3863836375 shutdown_connections 2024-09-11T00:24:01.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7f8895c00640 1 --2- 172.21.15.40:0/3863836375 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8870078040 0x7f887007a500 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7f8895c00640 1 --2- 172.21.15.40:0/3863836375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f889015e100 0x7f88901f9ae0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7f8895c00640 1 --2- 172.21.15.40:0/3863836375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f889015c3b0 0x7f88900b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7f8895c00640 1 --2- 172.21.15.40:0/3863836375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88900cae90 0x7f88900c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7f8895c00640 1 -- 172.21.15.40:0/3863836375 >> 172.21.15.40:0/3863836375 conn(0x7f88900cfbb0 msgr2=0x7f88900ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:01.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7fccd9000640 1 -- 172.21.15.40:0/1288423256 shutdown_connections 2024-09-11T00:24:01.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7fccd9000640 1 --2- 172.21.15.40:0/1288423256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccd415dd10 0x7fccd40ccec0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7fccd9000640 1 --2- 172.21.15.40:0/1288423256 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fccb4077f70 0x7fccb407a430 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7fccd9000640 1 --2- 172.21.15.40:0/1288423256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccd40d09e0 0x7fccd41f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7fccd9000640 1 --2- 172.21.15.40:0/1288423256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccd40b2d20 0x7fccd415fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.131+0000 7fccd9000640 1 -- 172.21.15.40:0/1288423256 >> 172.21.15.40:0/1288423256 conn(0x7fccd40d3c20 msgr2=0x7fccd40b91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:01.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.132+0000 7f8895c00640 1 -- 172.21.15.40:0/3863836375 shutdown_connections 2024-09-11T00:24:01.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.132+0000 7fccd9000640 1 -- 172.21.15.40:0/1288423256 shutdown_connections 2024-09-11T00:24:01.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.132+0000 7fccd9000640 1 -- 172.21.15.40:0/1288423256 wait complete. 2024-09-11T00:24:01.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.132+0000 7f8895c00640 1 -- 172.21.15.40:0/3863836375 wait complete. 2024-09-11T00:24:01.138 INFO:teuthology.orchestra.run.smithi040.stdout:64424509446 2024-09-11T00:24:01.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.2 2024-09-11T00:24:01.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.135+0000 7f9342800640 1 -- 172.21.15.40:0/136178415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f933c0b56f0 con 0x7f933c06e120 2024-09-11T00:24:01.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.137+0000 7f9339600640 1 -- 172.21.15.40:0/136178415 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9330062ee0 con 0x7f933c06e120 2024-09-11T00:24:01.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.139+0000 7f53bba00640 1 -- 172.21.15.40:0/2134698515 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f53b40b5b30 con 0x7f53b406e550 2024-09-11T00:24:01.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.140+0000 7f9342800640 1 -- 172.21.15.40:0/136178415 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f931c078170 msgr2=0x7f931c07a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:01.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.140+0000 7f9342800640 1 --2- 172.21.15.40:0/136178415 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f931c078170 0x7f931c07a630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f933c0cc2a0 tx=0x7f9328004730 comp rx=0 tx=0).stop 2024-09-11T00:24:01.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.140+0000 7f9342800640 1 -- 172.21.15.40:0/136178415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f933c06e120 msgr2=0x7f933c0c1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:01.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.140+0000 7f9342800640 1 --2- 172.21.15.40:0/136178415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f933c06e120 0x7f933c0c1060 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9330005fd0 tx=0x7f933000c6a0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.140+0000 7f9342800640 1 -- 172.21.15.40:0/136178415 shutdown_connections 2024-09-11T00:24:01.142 INFO:teuthology.orchestra.run.smithi040.stdout:64424509446 2024-09-11T00:24:01.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.140+0000 7f9342800640 1 --2- 172.21.15.40:0/136178415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f933c0c9dc0 0x7f933c0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.140+0000 7f9342800640 1 --2- 172.21.15.40:0/136178415 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f931c078170 0x7f931c07a630 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f933c0cc2a0 tx=0x7f9328004730 comp rx=0 tx=0).stop 2024-09-11T00:24:01.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.140+0000 7f9342800640 1 --2- 172.21.15.40:0/136178415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933c0aed30 0x7f933c169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.140+0000 7f9342800640 1 --2- 172.21.15.40:0/136178415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f933c06e120 0x7f933c0c1060 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.140+0000 7f9342800640 1 -- 172.21.15.40:0/136178415 >> 172.21.15.40:0/136178415 conn(0x7f933c0b1280 msgr2=0x7f933c0af5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:01.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.141+0000 7f9342800640 1 -- 172.21.15.40:0/136178415 shutdown_connections 2024-09-11T00:24:01.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.141+0000 7f9342800640 1 -- 172.21.15.40:0/136178415 wait complete. 2024-09-11T00:24:01.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.140+0000 7f53b0c00640 1 -- 172.21.15.40:0/2134698515 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f53a4063240 con 0x7f53b406e550 2024-09-11T00:24:01.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.144+0000 7f53bba00640 1 -- 172.21.15.40:0/2134698515 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5398077fa0 msgr2=0x7f539807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:01.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.144+0000 7f53bba00640 1 --2- 172.21.15.40:0/2134698515 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5398077fa0 0x7f539807a460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f53a8032000 tx=0x7f53a80046c0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.144+0000 7f53bba00640 1 -- 172.21.15.40:0/2134698515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53b406e550 msgr2=0x7f53b414ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:01.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.144+0000 7f53bba00640 1 --2- 172.21.15.40:0/2134698515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53b406e550 0x7f53b414ee60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f53a400d750 tx=0x7f53a400dc10 comp rx=0 tx=0).stop 2024-09-11T00:24:01.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.144+0000 7f53bba00640 1 -- 172.21.15.40:0/2134698515 shutdown_connections 2024-09-11T00:24:01.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.144+0000 7f53bba00640 1 --2- 172.21.15.40:0/2134698515 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5398077fa0 0x7f539807a460 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.144+0000 7f53bba00640 1 --2- 172.21.15.40:0/2134698515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53b415efe0 0x7f53b40740d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.144+0000 7f53bba00640 1 --2- 172.21.15.40:0/2134698515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b406fc10 0x7f53b414c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.144+0000 7f53bba00640 1 --2- 172.21.15.40:0/2134698515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53b406e550 0x7f53b414ee60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.144+0000 7f53bba00640 1 -- 172.21.15.40:0/2134698515 >> 172.21.15.40:0/2134698515 conn(0x7f53b40cfbb0 msgr2=0x7f53b40af630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:01.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.145+0000 7f53bba00640 1 -- 172.21.15.40:0/2134698515 shutdown_connections 2024-09-11T00:24:01.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.145+0000 7f53bba00640 1 -- 172.21.15.40:0/2134698515 wait complete. 2024-09-11T00:24:01.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.145+0000 7f23df600640 1 -- 172.21.15.40:0/1173625768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f23d80b1a50 con 0x7f23d806de30 2024-09-11T00:24:01.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.146+0000 7f23d4c00640 1 -- 172.21.15.40:0/1173625768 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f23cc0663c0 con 0x7f23d806de30 2024-09-11T00:24:01.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.146+0000 7ff578e00640 1 -- 172.21.15.40:0/2069491890 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff56c04ee60 con 0x7ff56c16e3a0 2024-09-11T00:24:01.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.147+0000 7ff56a000640 1 -- 172.21.15.40:0/2069491890 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff5740ddef0 con 0x7ff56c16e3a0 2024-09-11T00:24:01.149 INFO:teuthology.orchestra.run.smithi040.stdout:64424509445 2024-09-11T00:24:01.151 INFO:teuthology.orchestra.run.smithi040.stdout:64424509446 2024-09-11T00:24:01.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.150+0000 7f23df600640 1 -- 172.21.15.40:0/1173625768 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f23b8078070 msgr2=0x7f23b807a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:01.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.150+0000 7f23df600640 1 --2- 172.21.15.40:0/1173625768 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f23b8078070 0x7f23b807a530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f23c4033000 tx=0x7f23c4004730 comp rx=0 tx=0).stop 2024-09-11T00:24:01.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.150+0000 7f23df600640 1 -- 172.21.15.40:0/1173625768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23d806de30 msgr2=0x7f23d815c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:01.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.150+0000 7f23df600640 1 --2- 172.21.15.40:0/1173625768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23d806de30 0x7f23d815c2e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00c730 tx=0x7f23cc00cb30 comp rx=0 tx=0).stop 2024-09-11T00:24:01.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.151+0000 7f23df600640 1 -- 172.21.15.40:0/1173625768 shutdown_connections 2024-09-11T00:24:01.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.151+0000 7f23df600640 1 --2- 172.21.15.40:0/1173625768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d80d1140 0x7f23d80aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.151+0000 7f23df600640 1 --2- 172.21.15.40:0/1173625768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23d8070b50 0x7f23d81565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.151+0000 7f23df600640 1 --2- 172.21.15.40:0/1173625768 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f23b8078070 0x7f23b807a530 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.151+0000 7f23df600640 1 --2- 172.21.15.40:0/1173625768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23d806de30 0x7f23d815c2e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.151+0000 7f23df600640 1 -- 172.21.15.40:0/1173625768 >> 172.21.15.40:0/1173625768 conn(0x7f23d80d1d50 msgr2=0x7f23d80b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:01.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.151+0000 7f23df600640 1 -- 172.21.15.40:0/1173625768 shutdown_connections 2024-09-11T00:24:01.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.151+0000 7f23df600640 1 -- 172.21.15.40:0/1173625768 wait complete. 2024-09-11T00:24:01.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.151+0000 7ff578e00640 1 -- 172.21.15.40:0/2069491890 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff554077fc0 msgr2=0x7ff55407a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:01.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.151+0000 7ff578e00640 1 --2- 172.21.15.40:0/2069491890 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff554077fc0 0x7ff55407a480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff564036000 tx=0x7ff5640046c0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.152+0000 7ff578e00640 1 -- 172.21.15.40:0/2069491890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff56c16e3a0 msgr2=0x7ff56c16e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:01.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.152+0000 7ff578e00640 1 --2- 172.21.15.40:0/2069491890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff56c16e3a0 0x7ff56c16e850 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff57406b260 tx=0x7ff574072690 comp rx=0 tx=0).stop 2024-09-11T00:24:01.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.152+0000 7ff578e00640 1 -- 172.21.15.40:0/2069491890 shutdown_connections 2024-09-11T00:24:01.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.152+0000 7ff578e00640 1 --2- 172.21.15.40:0/2069491890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff56c16e3a0 0x7ff56c16e850 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.152+0000 7ff578e00640 1 --2- 172.21.15.40:0/2069491890 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff554077fc0 0x7ff55407a480 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.152+0000 7ff578e00640 1 --2- 172.21.15.40:0/2069491890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56c0e5410 0x7ff56c0e5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.152+0000 7ff578e00640 1 --2- 172.21.15.40:0/2069491890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5580039b0 0x7ff56c17f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:01.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.152+0000 7ff578e00640 1 -- 172.21.15.40:0/2069491890 >> 172.21.15.40:0/2069491890 conn(0x7ff56c055530 msgr2=0x7ff56c055910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:01.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.153+0000 7ff578e00640 1 -- 172.21.15.40:0/2069491890 shutdown_connections 2024-09-11T00:24:01.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:01.153+0000 7ff578e00640 1 -- 172.21.15.40:0/2069491890 wait complete. 2024-09-11T00:24:01.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.1 2024-09-11T00:24:01.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.6 2024-09-11T00:24:01.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.0 2024-09-11T00:24:01.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.7 2024-09-11T00:24:01.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2024-09-11T00:24:01.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-09-11T00:24:01.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.5 2024-09-11T00:24:02.140 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T00:24:02.157 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T00:24:02.164 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T00:24:02.170 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T00:24:02.172 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T00:24:02.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T00:24:02.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T00:24:02.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T00:24:02.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.388+0000 7f1e4d400640 1 -- 172.21.15.40:0/3273060724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e480aebf0 msgr2=0x7f1e48161870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.388+0000 7f1e4d400640 1 --2- 172.21.15.40:0/3273060724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e480aebf0 0x7f1e48161870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1e48051470 tx=0x7f1e3802a5a0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.389+0000 7f1e4d400640 1 -- 172.21.15.40:0/3273060724 shutdown_connections 2024-09-11T00:24:02.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.389+0000 7f1e4d400640 1 --2- 172.21.15.40:0/3273060724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e480aebf0 0x7f1e48161870 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.389+0000 7f1e4d400640 1 --2- 172.21.15.40:0/3273060724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e480ce130 0x7f1e480ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.389+0000 7f1e4d400640 1 --2- 172.21.15.40:0/3273060724 >> v2:172.21.15.175:3300/0 conn(0x7f1e48154c80 0x7f1e480cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.389+0000 7f1e4d400640 1 -- 172.21.15.40:0/3273060724 >> 172.21.15.40:0/3273060724 conn(0x7f1e480cc320 msgr2=0x7f1e480cc730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:02.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.389+0000 7f1e4d400640 1 -- 172.21.15.40:0/3273060724 shutdown_connections 2024-09-11T00:24:02.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.390+0000 7f1e4d400640 1 -- 172.21.15.40:0/3273060724 wait complete. 2024-09-11T00:24:02.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.392+0000 7f1e4d400640 1 Processor -- start 2024-09-11T00:24:02.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.393+0000 7f1e4d400640 1 -- start start 2024-09-11T00:24:02.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.395+0000 7f1e4d400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e480aebf0 0x7f1e481f7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.395+0000 7f1e4d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e480ce130 0x7f1e481f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.396+0000 7f1e45e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e480ce130 0x7f1e481f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.396+0000 7f1e45e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e480ce130 0x7f1e481f7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39710/0 (socket says 172.21.15.40:39710) 2024-09-11T00:24:02.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.396+0000 7f1e46800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e480aebf0 0x7f1e481f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.396+0000 7f1e46800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e480aebf0 0x7f1e481f7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.40:38596/0 (socket says 172.21.15.40:38596) 2024-09-11T00:24:02.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.397+0000 7f1e45e00640 1 -- 172.21.15.40:0/3900358412 learned_addr learned my addr 172.21.15.40:0/3900358412 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:02.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.397+0000 7f1e4d400640 1 --2- 172.21.15.40:0/3900358412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e48154c80 0x7f1e481533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.397+0000 7f1e4d400640 1 -- 172.21.15.40:0/3900358412 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1e48161f30 con 0x7f1e480ce130 2024-09-11T00:24:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.397+0000 7f1e4d400640 1 -- 172.21.15.40:0/3900358412 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1e48161db0 con 0x7f1e48154c80 2024-09-11T00:24:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.397+0000 7f1e4d400640 1 -- 172.21.15.40:0/3900358412 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1e481620b0 con 0x7f1e480aebf0 2024-09-11T00:24:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.398+0000 7f1e47200640 1 --2- 172.21.15.40:0/3900358412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e48154c80 0x7f1e481533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.399+0000 7f1e47200640 1 -- 172.21.15.40:0/3900358412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e480aebf0 msgr2=0x7f1e481f7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.399+0000 7f1e47200640 1 --2- 172.21.15.40:0/3900358412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e480aebf0 0x7f1e481f7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.399+0000 7f1e47200640 1 -- 172.21.15.40:0/3900358412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e480ce130 msgr2=0x7f1e481f7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.399+0000 7f1e47200640 1 --2- 172.21.15.40:0/3900358412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e480ce130 0x7f1e481f7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.399+0000 7f1e47200640 1 -- 172.21.15.40:0/3900358412 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e481512e0 con 0x7f1e48154c80 2024-09-11T00:24:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.399+0000 7f1e45e00640 1 --2- 172.21.15.40:0/3900358412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e480ce130 0x7f1e481f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:24:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.400+0000 7f1e47200640 1 --2- 172.21.15.40:0/3900358412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e48154c80 0x7f1e481533d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1e4806dde0 tx=0x7f1e38005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.400+0000 7f1e3ea00640 1 -- 172.21.15.40:0/3900358412 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e38051070 con 0x7f1e48154c80 2024-09-11T00:24:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.400+0000 7f1e3ea00640 1 -- 172.21.15.40:0/3900358412 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e38031d30 con 0x7f1e48154c80 2024-09-11T00:24:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.400+0000 7f1e3ea00640 1 -- 172.21.15.40:0/3900358412 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e38004230 con 0x7f1e48154c80 2024-09-11T00:24:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.400+0000 7f1e4d400640 1 -- 172.21.15.40:0/3900358412 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e481515c0 con 0x7f1e48154c80 2024-09-11T00:24:02.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.402+0000 7f1e4d400640 1 -- 172.21.15.40:0/3900358412 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e48151b80 con 0x7f1e48154c80 2024-09-11T00:24:02.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.406+0000 7f1e3ea00640 1 -- 172.21.15.40:0/3900358412 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1e38056450 con 0x7f1e48154c80 2024-09-11T00:24:02.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.407+0000 7f1e4d400640 1 -- 172.21.15.40:0/3900358412 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e480cd020 con 0x7f1e48154c80 2024-09-11T00:24:02.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.408+0000 7f1e3ea00640 1 --2- 172.21.15.40:0/3900358412 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1e28078040 0x7f1e2807a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.408+0000 7f1e3ea00640 1 -- 172.21.15.40:0/3900358412 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1e380cc390 con 0x7f1e48154c80 2024-09-11T00:24:02.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.410+0000 7f1e46800640 1 --2- 172.21.15.40:0/3900358412 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1e28078040 0x7f1e2807a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.411+0000 7f1e46800640 1 --2- 172.21.15.40:0/3900358412 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1e28078040 0x7f1e2807a500 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1e40005fd0 tx=0x7f1e400097d0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:02.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.415+0000 7f1e3ea00640 1 -- 172.21.15.40:0/3900358412 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1e380948b0 con 0x7f1e48154c80 2024-09-11T00:24:02.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.479+0000 7f470ca00640 1 -- 172.21.15.40:0/382708297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f470815e570 msgr2=0x7f470815b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.479+0000 7f470ca00640 1 --2- 172.21.15.40:0/382708297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f470815e570 0x7f470815b720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009860 tx=0x7f46f002a510 comp rx=0 tx=0).stop 2024-09-11T00:24:02.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.481+0000 7fc71e800640 1 -- 172.21.15.40:0/1490020044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7181550b0 msgr2=0x7fc71815e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.481+0000 7fc71e800640 1 --2- 172.21.15.40:0/1490020044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7181550b0 0x7fc71815e3d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc710005fd0 tx=0x7fc71002a4a0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.481+0000 7f470ca00640 1 -- 172.21.15.40:0/382708297 shutdown_connections 2024-09-11T00:24:02.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.481+0000 7f470ca00640 1 --2- 172.21.15.40:0/382708297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f470815e570 0x7f470815b720 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.481+0000 7f470ca00640 1 -- 172.21.15.40:0/382708297 >> 172.21.15.40:0/382708297 conn(0x7f47080b1280 msgr2=0x7f47080b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.481+0000 7f470ca00640 1 -- 172.21.15.40:0/382708297 shutdown_connections 2024-09-11T00:24:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.481+0000 7f470ca00640 1 -- 172.21.15.40:0/382708297 wait complete. 2024-09-11T00:24:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.482+0000 7fc71e800640 1 -- 172.21.15.40:0/1490020044 shutdown_connections 2024-09-11T00:24:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.482+0000 7fc71e800640 1 --2- 172.21.15.40:0/1490020044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7181550b0 0x7fc71815e3d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.482+0000 7fc71e800640 1 -- 172.21.15.40:0/1490020044 >> 172.21.15.40:0/1490020044 conn(0x7fc7180cfbb0 msgr2=0x7fc7180cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.482+0000 7fc71e800640 1 -- 172.21.15.40:0/1490020044 shutdown_connections 2024-09-11T00:24:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.483+0000 7fee53e00640 1 -- 172.21.15.40:0/2424308731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee4c0d2350 msgr2=0x7fee4c0d2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.483+0000 7fee53e00640 1 --2- 172.21.15.40:0/2424308731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee4c0d2350 0x7fee4c0d2730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0cafe0 tx=0x7fee4002a3d0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.482+0000 7fc71e800640 1 -- 172.21.15.40:0/1490020044 wait complete. 2024-09-11T00:24:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.484+0000 7f470ca00640 1 Processor -- start 2024-09-11T00:24:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.484+0000 7fee53e00640 1 -- 172.21.15.40:0/2424308731 shutdown_connections 2024-09-11T00:24:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.484+0000 7fba57e00640 1 -- 172.21.15.40:0/152223805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba500e31e0 msgr2=0x7fba50035ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.484+0000 7fee53e00640 1 --2- 172.21.15.40:0/2424308731 >> v2:172.21.15.175:3300/0 conn(0x7fee4c0b2e50 0x7fee4c0d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.484+0000 7fee53e00640 1 --2- 172.21.15.40:0/2424308731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee4c0d2350 0x7fee4c0d2730 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.484+0000 7fba57e00640 1 --2- 172.21.15.40:0/152223805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba500e31e0 0x7fba50035ee0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fba44009830 tx=0x7fba4402a510 comp rx=0 tx=0).stop 2024-09-11T00:24:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.484+0000 7fee53e00640 1 -- 172.21.15.40:0/2424308731 >> 172.21.15.40:0/2424308731 conn(0x7fee4c0d3f80 msgr2=0x7fee4c0d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.484+0000 7f470ca00640 1 -- start start 2024-09-11T00:24:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.484+0000 7fee53e00640 1 -- 172.21.15.40:0/2424308731 shutdown_connections 2024-09-11T00:24:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.484+0000 7fba57e00640 1 -- 172.21.15.40:0/152223805 shutdown_connections 2024-09-11T00:24:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.484+0000 7fba57e00640 1 --2- 172.21.15.40:0/152223805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba500e31e0 0x7fba50035ee0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.484+0000 7fba57e00640 1 --2- 172.21.15.40:0/152223805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba500e2e00 0x7fba50033e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.484+0000 7fba57e00640 1 -- 172.21.15.40:0/152223805 >> 172.21.15.40:0/152223805 conn(0x7fba5001d770 msgr2=0x7fba50054560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.486+0000 7f470ca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f470815a870 0x7f47080c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.486+0000 7f470ca00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f470815bc60 0x7f470806e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.486+0000 7f470ca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f470815e570 0x7f47080b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.485+0000 7fba57e00640 1 -- 172.21.15.40:0/152223805 shutdown_connections 2024-09-11T00:24:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.485+0000 7fee53e00640 1 -- 172.21.15.40:0/2424308731 wait complete. 2024-09-11T00:24:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.486+0000 7f470ca00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f47080726c0 con 0x7f470815a870 2024-09-11T00:24:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.486+0000 7f470ca00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f470815afa0 con 0x7f470815e570 2024-09-11T00:24:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.486+0000 7f470ca00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4708072840 con 0x7f470815bc60 2024-09-11T00:24:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.487+0000 7f4705e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f470815bc60 0x7f470806e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.487+0000 7f4705e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f470815bc60 0x7f470806e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.40:38628/0 (socket says 172.21.15.40:38628) 2024-09-11T00:24:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.487+0000 7f4707200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f470815e570 0x7f47080b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.487+0000 7f4705e00640 1 -- 172.21.15.40:0/512235581 learned_addr learned my addr 172.21.15.40:0/512235581 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.485+0000 7fba57e00640 1 -- 172.21.15.40:0/152223805 wait complete. 2024-09-11T00:24:02.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.487+0000 7f4706800640 1 --2- 172.21.15.40:0/512235581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f470815a870 0x7f47080c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.487+0000 7fba57e00640 1 Processor -- start 2024-09-11T00:24:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.488+0000 7f4705e00640 1 -- 172.21.15.40:0/512235581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f470815e570 msgr2=0x7f47080b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.488+0000 7f4705e00640 1 --2- 172.21.15.40:0/512235581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f470815e570 0x7f47080b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.488+0000 7f4705e00640 1 -- 172.21.15.40:0/512235581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f470815a870 msgr2=0x7f47080c5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.488+0000 7f4705e00640 1 --2- 172.21.15.40:0/512235581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f470815a870 0x7f47080c5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.488+0000 7f4705e00640 1 -- 172.21.15.40:0/512235581 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470806ead0 con 0x7f470815bc60 2024-09-11T00:24:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.486+0000 7fc71e800640 1 Processor -- start 2024-09-11T00:24:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.487+0000 7fc71e800640 1 -- start start 2024-09-11T00:24:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.487+0000 7fee53e00640 1 Processor -- start 2024-09-11T00:24:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.487+0000 7fba57e00640 1 -- start start 2024-09-11T00:24:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.489+0000 7fee53e00640 1 -- start start 2024-09-11T00:24:02.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.489+0000 7f4706800640 1 --2- 172.21.15.40:0/512235581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f470815a870 0x7f47080c5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:24:02.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.489+0000 7fc71e800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7180aefa0 0x7fc7181f8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.489+0000 7fc71e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7180cde90 0x7fc718073b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.489+0000 7fc71e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7181550b0 0x7fc718074090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.489+0000 7f4705e00640 1 --2- 172.21.15.40:0/512235581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f470815bc60 0x7f470806e590 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f46f002ab00 tx=0x7f46f0033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:02.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.489+0000 7fba57e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba500351b0 0x7fba5004e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.489+0000 7fba57e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba500e2e00 0x7fba500d5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.490+0000 7fba57e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba500e31e0 0x7fba5004b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.490+0000 7fba56a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba500351b0 0x7fba5004e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.490+0000 7fba57e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fba50053360 con 0x7fba500351b0 2024-09-11T00:24:02.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.490+0000 7fba56a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba500351b0 0x7fba5004e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39744/0 (socket says 172.21.15.40:39744) 2024-09-11T00:24:02.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.490+0000 7fba57e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fba500531e0 con 0x7fba500e31e0 2024-09-11T00:24:02.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.490+0000 7fba56a00640 1 -- 172.21.15.40:0/3054432601 learned_addr learned my addr 172.21.15.40:0/3054432601 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:02.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.490+0000 7fba56000640 1 --2- 172.21.15.40:0/3054432601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba500e2e00 0x7fba500d5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.490+0000 7fba57e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fba500534e0 con 0x7fba500e2e00 2024-09-11T00:24:02.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.489+0000 7fc71e800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc71806ec60 con 0x7fc7181550b0 2024-09-11T00:24:02.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.489+0000 7fc71e800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc7180adc40 con 0x7fc7180cde90 2024-09-11T00:24:02.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.489+0000 7fc71e800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc71806ede0 con 0x7fc7180aefa0 2024-09-11T00:24:02.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.490+0000 7fc717400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7180aefa0 0x7fc7181f8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.490+0000 7fc716a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7180cde90 0x7fc718073b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.490+0000 7fc716a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7180cde90 0x7fc718073b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.40:45584/0 (socket says 172.21.15.40:45584) 2024-09-11T00:24:02.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.490+0000 7fc716a00640 1 -- 172.21.15.40:0/3305257093 learned_addr learned my addr 172.21.15.40:0/3305257093 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:02.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.490+0000 7fba57400640 1 --2- 172.21.15.40:0/3054432601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba500e31e0 0x7fba5004b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.491+0000 7f46fea00640 1 -- 172.21.15.40:0/512235581 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0031d60 con 0x7f470815bc60 2024-09-11T00:24:02.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.491+0000 7f46fea00640 1 -- 172.21.15.40:0/512235581 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46f0033e10 con 0x7f470815bc60 2024-09-11T00:24:02.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.491+0000 7f46fea00640 1 -- 172.21.15.40:0/512235581 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0005280 con 0x7f470815bc60 2024-09-11T00:24:02.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.491+0000 7f470ca00640 1 -- 172.21.15.40:0/512235581 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47081fc350 con 0x7f470815bc60 2024-09-11T00:24:02.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.491+0000 7f470ca00640 1 -- 172.21.15.40:0/512235581 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f47081fc8f0 con 0x7f470815bc60 2024-09-11T00:24:02.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.491+0000 7fba56a00640 1 -- 172.21.15.40:0/3054432601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba500e2e00 msgr2=0x7fba500d5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.491+0000 7fba56a00640 1 --2- 172.21.15.40:0/3054432601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba500e2e00 0x7fba500d5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.491+0000 7fba56a00640 1 -- 172.21.15.40:0/3054432601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba500e31e0 msgr2=0x7fba5004b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.491+0000 7fba56a00640 1 --2- 172.21.15.40:0/3054432601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba500e31e0 0x7fba5004b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.491+0000 7fba56a00640 1 -- 172.21.15.40:0/3054432601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5004dd50 con 0x7fba500351b0 2024-09-11T00:24:02.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.492+0000 7fba57400640 1 --2- 172.21.15.40:0/3054432601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba500e31e0 0x7fba5004b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:02.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.491+0000 7fc716a00640 1 -- 172.21.15.40:0/3305257093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7180aefa0 msgr2=0x7fc7181f8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.491+0000 7fc716a00640 1 --2- 172.21.15.40:0/3305257093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7180aefa0 0x7fc7181f8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.491+0000 7fc716a00640 1 -- 172.21.15.40:0/3305257093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7181550b0 msgr2=0x7fc718074090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.491+0000 7fc716a00640 1 --2- 172.21.15.40:0/3305257093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7181550b0 0x7fc718074090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.491+0000 7fc716a00640 1 -- 172.21.15.40:0/3305257093 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7181fc8e0 con 0x7fc7180cde90 2024-09-11T00:24:02.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.492+0000 7fc716a00640 1 --2- 172.21.15.40:0/3305257093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7180cde90 0x7fc718073b50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc70800ba50 tx=0x7fc70800bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:02.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.492+0000 7fee53e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee4c0b2e50 0x7fee4c156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.492+0000 7fee53e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee4c0d2350 0x7fee4c2056d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.492+0000 7fee53e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee4c0d4aa0 0x7fee4c205c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.492+0000 7fee53e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c0b3670 con 0x7fee4c0b2e50 2024-09-11T00:24:02.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.492+0000 7fee53e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c0b34f0 con 0x7fee4c0d2350 2024-09-11T00:24:02.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.492+0000 7fee53e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fee4c15e0d0 con 0x7fee4c0d4aa0 2024-09-11T00:24:02.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.493+0000 7fee51400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee4c0b2e50 0x7fee4c156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.493+0000 7fee51400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee4c0b2e50 0x7fee4c156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39750/0 (socket says 172.21.15.40:39750) 2024-09-11T00:24:02.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.493+0000 7fee51400640 1 -- 172.21.15.40:0/3169317781 learned_addr learned my addr 172.21.15.40:0/3169317781 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:02.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.493+0000 7fee51e00640 1 --2- 172.21.15.40:0/3169317781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee4c0d4aa0 0x7fee4c205c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.493+0000 7fee50a00640 1 --2- 172.21.15.40:0/3169317781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee4c0d2350 0x7fee4c2056d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.493+0000 7f470ca00640 1 -- 172.21.15.40:0/512235581 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47080cf2b0 con 0x7f470815bc60 2024-09-11T00:24:02.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.492+0000 7fc70f400640 1 -- 172.21.15.40:0/3305257093 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708019070 con 0x7fc7180cde90 2024-09-11T00:24:02.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.493+0000 7fc70f400640 1 -- 172.21.15.40:0/3305257093 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc70800cd00 con 0x7fc7180cde90 2024-09-11T00:24:02.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.493+0000 7fc70f400640 1 -- 172.21.15.40:0/3305257093 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708019070 con 0x7fc7180cde90 2024-09-11T00:24:02.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.493+0000 7fc71e800640 1 -- 172.21.15.40:0/3305257093 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7181fcbc0 con 0x7fc7180cde90 2024-09-11T00:24:02.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.493+0000 7fc71e800640 1 -- 172.21.15.40:0/3305257093 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7181fd180 con 0x7fc7180cde90 2024-09-11T00:24:02.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.493+0000 7f2341400640 1 -- 172.21.15.40:0/1553194860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c0b2d20 msgr2=0x7f233c161c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.493+0000 7f2341400640 1 --2- 172.21.15.40:0/1553194860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c0b2d20 0x7f233c161c60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2324009830 tx=0x7f232402a480 comp rx=0 tx=0).stop 2024-09-11T00:24:02.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.494+0000 7fee51e00640 1 -- 172.21.15.40:0/3169317781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee4c0d2350 msgr2=0x7fee4c2056d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.494+0000 7fee51e00640 1 --2- 172.21.15.40:0/3169317781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee4c0d2350 0x7fee4c2056d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.494+0000 7fee51e00640 1 -- 172.21.15.40:0/3169317781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee4c0b2e50 msgr2=0x7fee4c156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.494+0000 7fee51e00640 1 --2- 172.21.15.40:0/3169317781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee4c0b2e50 0x7fee4c156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.494+0000 7fee51e00640 1 -- 172.21.15.40:0/3169317781 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee4c157480 con 0x7fee4c0d4aa0 2024-09-11T00:24:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.494+0000 7f2341400640 1 -- 172.21.15.40:0/1553194860 shutdown_connections 2024-09-11T00:24:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.494+0000 7f2341400640 1 --2- 172.21.15.40:0/1553194860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c0b2d20 0x7f233c161c60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.494+0000 7f2341400640 1 --2- 172.21.15.40:0/1553194860 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f233c161880 0x7f233c0d4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.494+0000 7fee51e00640 1 --2- 172.21.15.40:0/3169317781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee4c0d4aa0 0x7fee4c205c10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fee4400ea80 tx=0x7fee4400ef40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:02.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.494+0000 7f2341400640 1 -- 172.21.15.40:0/1553194860 >> 172.21.15.40:0/1553194860 conn(0x7f233c0d3c20 msgr2=0x7f233c0d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:02.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.494+0000 7fba56a00640 1 --2- 172.21.15.40:0/3054432601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba500351b0 0x7fba5004e510 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fba4800e9f0 tx=0x7fba4800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:02.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.495+0000 7fba4ea00640 1 -- 172.21.15.40:0/3054432601 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4800ccc0 con 0x7fba500351b0 2024-09-11T00:24:02.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.495+0000 7f2341400640 1 -- 172.21.15.40:0/1553194860 shutdown_connections 2024-09-11T00:24:02.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.495+0000 7f2341400640 1 -- 172.21.15.40:0/1553194860 wait complete. 2024-09-11T00:24:02.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.495+0000 7fba4ea00640 1 -- 172.21.15.40:0/3054432601 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba48010430 con 0x7fba500351b0 2024-09-11T00:24:02.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.495+0000 7fba4ea00640 1 -- 172.21.15.40:0/3054432601 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba48010840 con 0x7fba500351b0 2024-09-11T00:24:02.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.495+0000 7fc71e800640 1 -- 172.21.15.40:0/3305257093 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc71806f300 con 0x7fc7180cde90 2024-09-11T00:24:02.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.495+0000 7fba57e00640 1 -- 172.21.15.40:0/3054432601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba500e1b30 con 0x7fba500351b0 2024-09-11T00:24:02.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.495+0000 7fba57e00640 1 -- 172.21.15.40:0/3054432601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba5004dff0 con 0x7fba500351b0 2024-09-11T00:24:02.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.497+0000 7fba57e00640 1 -- 172.21.15.40:0/3054432601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba50033e50 con 0x7fba500351b0 2024-09-11T00:24:02.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.496+0000 7f46fea00640 1 -- 172.21.15.40:0/512235581 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f46f0005420 con 0x7f470815bc60 2024-09-11T00:24:02.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.497+0000 7f46fea00640 1 --2- 172.21.15.40:0/512235581 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f46e4078070 0x7f46e407a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.497+0000 7f46fea00640 1 -- 172.21.15.40:0/512235581 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f46f00bb270 con 0x7f470815bc60 2024-09-11T00:24:02.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.498+0000 7f2341400640 1 Processor -- start 2024-09-11T00:24:02.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.498+0000 7f2341400640 1 -- start start 2024-09-11T00:24:02.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.498+0000 7f4706800640 1 --2- 172.21.15.40:0/512235581 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f46e4078070 0x7f46e407a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.498+0000 7fc70f400640 1 -- 172.21.15.40:0/3305257093 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc70803aac0 con 0x7fc7180cde90 2024-09-11T00:24:02.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.498+0000 7fc70f400640 1 --2- 172.21.15.40:0/3305257093 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc6f4078170 0x7fc6f407a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.499+0000 7fc70f400640 1 -- 172.21.15.40:0/3305257093 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc708099a00 con 0x7fc7180cde90 2024-09-11T00:24:02.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.499+0000 7fee49600640 1 -- 172.21.15.40:0/3169317781 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4400cea0 con 0x7fee4c0d4aa0 2024-09-11T00:24:02.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.499+0000 7fee53e00640 1 -- 172.21.15.40:0/3169317781 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee4c201e90 con 0x7fee4c0d4aa0 2024-09-11T00:24:02.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.499+0000 7fee53e00640 1 -- 172.21.15.40:0/3169317781 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fee4c202450 con 0x7fee4c0d4aa0 2024-09-11T00:24:02.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.499+0000 7fee49600640 1 -- 172.21.15.40:0/3169317781 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee44004c10 con 0x7fee4c0d4aa0 2024-09-11T00:24:02.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.499+0000 7fee49600640 1 -- 172.21.15.40:0/3169317781 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee44005020 con 0x7fee4c0d4aa0 2024-09-11T00:24:02.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.500+0000 7f2341400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f233c0b2d20 0x7f233c1570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.500+0000 7f2341400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f233c15d850 0x7f233c1578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.500+0000 7f2341400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c161880 0x7f233c160510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.500+0000 7f2341400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f233c15dd00 con 0x7f233c15d850 2024-09-11T00:24:02.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.500+0000 7f2341400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f233c15de80 con 0x7f233c161880 2024-09-11T00:24:02.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.500+0000 7f2341400640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f233c15e000 con 0x7f233c0b2d20 2024-09-11T00:24:02.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.499+0000 7fc717400640 1 --2- 172.21.15.40:0/3305257093 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc6f4078170 0x7fc6f407a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.500+0000 7fba4ea00640 1 -- 172.21.15.40:0/3054432601 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fba48029080 con 0x7fba500351b0 2024-09-11T00:24:02.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.500+0000 7f233b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f233c15d850 0x7f233c1578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.500+0000 7f15fb200640 1 -- 172.21.15.40:0/707092974 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15f40705e0 msgr2=0x7f15f415ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.500+0000 7f15fb200640 1 --2- 172.21.15.40:0/707092974 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15f40705e0 0x7f15f415ad80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009860 tx=0x7f15e402a580 comp rx=0 tx=0).stop 2024-09-11T00:24:02.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.500+0000 7f15fb200640 1 -- 172.21.15.40:0/707092974 shutdown_connections 2024-09-11T00:24:02.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.500+0000 7f15fb200640 1 --2- 172.21.15.40:0/707092974 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15f40705e0 0x7f15f415ad80 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009860 tx=0x7f15e402a580 comp rx=0 tx=0).stop 2024-09-11T00:24:02.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.500+0000 7f15fb200640 1 -- 172.21.15.40:0/707092974 >> 172.21.15.40:0/707092974 conn(0x7f15f40cfbb0 msgr2=0x7f15f40cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:02.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.501+0000 7f233b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f233c15d850 0x7f233c1578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39754/0 (socket says 172.21.15.40:39754) 2024-09-11T00:24:02.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.501+0000 7f233b400640 1 -- 172.21.15.40:0/2337187189 learned_addr learned my addr 172.21.15.40:0/2337187189 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:02.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.501+0000 7fee53e00640 1 -- 172.21.15.40:0/3169317781 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee4c201c80 con 0x7fee4c0d4aa0 2024-09-11T00:24:02.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.501+0000 7f15fb200640 1 -- 172.21.15.40:0/707092974 shutdown_connections 2024-09-11T00:24:02.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.501+0000 7fc717400640 1 --2- 172.21.15.40:0/3305257093 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc6f4078170 0x7fc6f407a630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc710033000 tx=0x7fc710004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:02.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.501+0000 7f46fea00640 1 -- 172.21.15.40:0/512235581 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f47080cf2b0 con 0x7f470815bc60 2024-09-11T00:24:02.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.501+0000 7f15fb200640 1 -- 172.21.15.40:0/707092974 wait complete. 2024-09-11T00:24:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.501+0000 7f233b400640 1 -- 172.21.15.40:0/2337187189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f233c0b2d20 msgr2=0x7f233c1570f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:24:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.501+0000 7f233b400640 1 --2- 172.21.15.40:0/2337187189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f233c0b2d20 0x7f233c1570f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.501+0000 7f233b400640 1 -- 172.21.15.40:0/2337187189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c161880 msgr2=0x7f233c160510 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:24:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.501+0000 7f233b400640 1 --2- 172.21.15.40:0/2337187189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c161880 0x7f233c160510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.501+0000 7f233b400640 1 -- 172.21.15.40:0/2337187189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f233c0c7d00 con 0x7f233c15d850 2024-09-11T00:24:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.502+0000 7f233b400640 1 --2- 172.21.15.40:0/2337187189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f233c15d850 0x7f233c1578f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2324000c00 tx=0x7f2324032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:02.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.502+0000 7fba4ea00640 1 --2- 172.21.15.40:0/3054432601 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fba38077f70 0x7fba3807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.502+0000 7fba4ea00640 1 -- 172.21.15.40:0/3054432601 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fba4809ad70 con 0x7fba500351b0 2024-09-11T00:24:02.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.503+0000 7f4706800640 1 --2- 172.21.15.40:0/512235581 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f46e4078070 0x7f46e407a530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4700001840 tx=0x7f47000017d0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:02.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.503+0000 7fc70f400640 1 -- 172.21.15.40:0/3305257093 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc708061ea0 con 0x7fc7180cde90 2024-09-11T00:24:02.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.503+0000 7fba56000640 1 --2- 172.21.15.40:0/3054432601 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fba38077f70 0x7fba3807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.503+0000 7f15fb200640 1 Processor -- start 2024-09-11T00:24:02.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.504+0000 7fba56000640 1 --2- 172.21.15.40:0/3054432601 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fba38077f70 0x7fba3807a430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba44034000 tx=0x7fba44004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:02.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.504+0000 7f15fb200640 1 -- start start 2024-09-11T00:24:02.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.504+0000 7fee49600640 1 -- 172.21.15.40:0/3169317781 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fee44020030 con 0x7fee4c0d4aa0 2024-09-11T00:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.505+0000 7f15fb200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15f40ca200 0x7f15f40c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.505+0000 7f15fb200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15f41545c0 0x7f15f41fc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.505+0000 7f15fb200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f41fcdd0 0x7f15f414ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.505+0000 7f15fb200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f15f406ec60 con 0x7f15f41fcdd0 2024-09-11T00:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.505+0000 7f15fb200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f15f40cf320 con 0x7f15f40ca200 2024-09-11T00:24:02.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.505+0000 7f15fb200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f15f406ede0 con 0x7f15f41545c0 2024-09-11T00:24:02.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.505+0000 7f15f3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15f40ca200 0x7f15f40c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.505+0000 7f15f3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15f40ca200 0x7f15f40c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.40:45614/0 (socket says 172.21.15.40:45614) 2024-09-11T00:24:02.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.505+0000 7f15f3e00640 1 -- 172.21.15.40:0/1852504741 learned_addr learned my addr 172.21.15.40:0/1852504741 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:02.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.506+0000 7fee49600640 1 --2- 172.21.15.40:0/3169317781 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fee2c077f70 0x7fee2c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.506+0000 7f15f3400640 1 --2- 172.21.15.40:0/1852504741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15f41545c0 0x7f15f41fc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.506+0000 7fee49600640 1 -- 172.21.15.40:0/3169317781 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fee4409a800 con 0x7fee4c0d4aa0 2024-09-11T00:24:02.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.506+0000 7f15f3e00640 1 -- 172.21.15.40:0/1852504741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15f41545c0 msgr2=0x7f15f41fc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.506+0000 7f15f3e00640 1 --2- 172.21.15.40:0/1852504741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15f41545c0 0x7f15f41fc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.506+0000 7f15f3e00640 1 -- 172.21.15.40:0/1852504741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f41fcdd0 msgr2=0x7f15f414ec60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:24:02.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.506+0000 7f15f9200640 1 --2- 172.21.15.40:0/1852504741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f41fcdd0 0x7f15f414ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.506+0000 7f15f3e00640 1 --2- 172.21.15.40:0/1852504741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f41fcdd0 0x7f15f414ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.506+0000 7f15f3e00640 1 -- 172.21.15.40:0/1852504741 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f40c4df0 con 0x7f15f40ca200 2024-09-11T00:24:02.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.506+0000 7fee51400640 1 --2- 172.21.15.40:0/3169317781 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fee2c077f70 0x7fee2c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.506+0000 7f15f9200640 1 --2- 172.21.15.40:0/1852504741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f41fcdd0 0x7f15f414ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:02.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.507+0000 7f15f3e00640 1 --2- 172.21.15.40:0/1852504741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15f40ca200 0x7f15f40c5e30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f15e4000c00 tx=0x7f15e4032b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:02.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.507+0000 7f2333e00640 1 -- 172.21.15.40:0/2337187189 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2324040070 con 0x7f233c15d850 2024-09-11T00:24:02.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.507+0000 7f15ebe00640 1 -- 172.21.15.40:0/1852504741 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e4041030 con 0x7f15f40ca200 2024-09-11T00:24:02.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.507+0000 7fee51400640 1 --2- 172.21.15.40:0/3169317781 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fee2c077f70 0x7fee2c07a430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fee400096c0 tx=0x7fee40004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:02.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.507+0000 7f15ebe00640 1 -- 172.21.15.40:0/1852504741 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15e40036e0 con 0x7f15f40ca200 2024-09-11T00:24:02.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.507+0000 7f15ebe00640 1 -- 172.21.15.40:0/1852504741 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e4003b30 con 0x7f15f40ca200 2024-09-11T00:24:02.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.507+0000 7f2333e00640 1 -- 172.21.15.40:0/2337187189 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2324003af0 con 0x7f233c15d850 2024-09-11T00:24:02.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.507+0000 7f2333e00640 1 -- 172.21.15.40:0/2337187189 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2324032e40 con 0x7f233c15d850 2024-09-11T00:24:02.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.507+0000 7f2341400640 1 -- 172.21.15.40:0/2337187189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f233c0c7fe0 con 0x7f233c15d850 2024-09-11T00:24:02.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.508+0000 7ff312200640 1 -- 172.21.15.40:0/955500031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30c161150 msgr2=0x7ff30c0d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.508+0000 7ff312200640 1 --2- 172.21.15.40:0/955500031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30c161150 0x7ff30c0d0390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80097a0 tx=0x7ff2f802a3b0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.508+0000 7f2341400640 1 -- 172.21.15.40:0/2337187189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f233c0c85a0 con 0x7f233c15d850 2024-09-11T00:24:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.508+0000 7f15fb200640 1 -- 172.21.15.40:0/1852504741 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f40c5070 con 0x7f15f40ca200 2024-09-11T00:24:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.508+0000 7f15fb200640 1 -- 172.21.15.40:0/1852504741 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f40c5630 con 0x7f15f40ca200 2024-09-11T00:24:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.509+0000 7fba4ea00640 1 -- 172.21.15.40:0/3054432601 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fba48063200 con 0x7fba500351b0 2024-09-11T00:24:02.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.509+0000 7ff312200640 1 -- 172.21.15.40:0/955500031 shutdown_connections 2024-09-11T00:24:02.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.509+0000 7ff312200640 1 --2- 172.21.15.40:0/955500031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30c161150 0x7ff30c0d0390 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.509+0000 7ff312200640 1 -- 172.21.15.40:0/955500031 >> 172.21.15.40:0/955500031 conn(0x7ff30c0d3c50 msgr2=0x7ff30c0d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:02.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.510+0000 7ff312200640 1 -- 172.21.15.40:0/955500031 shutdown_connections 2024-09-11T00:24:02.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.510+0000 7ff312200640 1 -- 172.21.15.40:0/955500031 wait complete. 2024-09-11T00:24:02.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.510+0000 7f2341400640 1 -- 172.21.15.40:0/2337187189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f233c161c60 con 0x7f233c15d850 2024-09-11T00:24:02.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.511+0000 7f15fb200640 1 -- 172.21.15.40:0/1852504741 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15f415ad80 con 0x7f15f40ca200 2024-09-11T00:24:02.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.511+0000 7fee49600640 1 -- 172.21.15.40:0/3169317781 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fee440632f0 con 0x7fee4c0d4aa0 2024-09-11T00:24:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.512+0000 7ff312200640 1 Processor -- start 2024-09-11T00:24:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.512+0000 7ff312200640 1 -- start start 2024-09-11T00:24:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.513+0000 7ff312200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30c0b51f0 0x7ff30c1f4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.513+0000 7ff312200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff30c0b7b40 0x7ff30c09d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.513+0000 7ff312200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30c161150 0x7ff30c15ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.513+0000 7ff312200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c0cf470 con 0x7ff30c161150 2024-09-11T00:24:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.513+0000 7ff312200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c0cf2f0 con 0x7ff30c0b7b40 2024-09-11T00:24:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.513+0000 7ff312200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff30c0cf5f0 con 0x7ff30c0b51f0 2024-09-11T00:24:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.513+0000 7ff30b400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30c0b51f0 0x7ff30c1f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.513+0000 7ff30b400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30c0b51f0 0x7ff30c1f4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.40:38678/0 (socket says 172.21.15.40:38678) 2024-09-11T00:24:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.513+0000 7ff30b400640 1 -- 172.21.15.40:0/2582659894 learned_addr learned my addr 172.21.15.40:0/2582659894 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.512+0000 7f2333e00640 1 -- 172.21.15.40:0/2337187189 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2324045460 con 0x7f233c15d850 2024-09-11T00:24:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.513+0000 7f2333e00640 1 --2- 172.21.15.40:0/2337187189 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2318077f70 0x7f231807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.514+0000 7f2333e00640 1 -- 172.21.15.40:0/2337187189 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f23240bb500 con 0x7f233c15d850 2024-09-11T00:24:02.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.514+0000 7ff30be00640 1 --2- 172.21.15.40:0/2582659894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30c161150 0x7ff30c15ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.514+0000 7ff30aa00640 1 --2- 172.21.15.40:0/2582659894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff30c0b7b40 0x7ff30c09d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.514+0000 7f233be00640 1 --2- 172.21.15.40:0/2337187189 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2318077f70 0x7f231807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.515+0000 7ff30b400640 1 -- 172.21.15.40:0/2582659894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff30c0b7b40 msgr2=0x7ff30c09d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.515+0000 7ff30b400640 1 --2- 172.21.15.40:0/2582659894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff30c0b7b40 0x7ff30c09d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.515+0000 7ff30b400640 1 -- 172.21.15.40:0/2582659894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30c161150 msgr2=0x7ff30c15ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.515+0000 7ff30b400640 1 --2- 172.21.15.40:0/2582659894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30c161150 0x7ff30c15ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.515+0000 7f233be00640 1 --2- 172.21.15.40:0/2337187189 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2318077f70 0x7f231807a430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f233c15cdb0 tx=0x7f232c01a510 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:02.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.515+0000 7ff30b400640 1 -- 172.21.15.40:0/2582659894 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c1f4c70 con 0x7ff30c0b51f0 2024-09-11T00:24:02.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.515+0000 7ff30b400640 1 --2- 172.21.15.40:0/2582659894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30c0b51f0 0x7ff30c1f4690 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff2f802a9a0 tx=0x7ff2f8004a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:02.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.515+0000 7ff30be00640 1 --2- 172.21.15.40:0/2582659894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30c161150 0x7ff30c15ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:02.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.515+0000 7ff30aa00640 1 --2- 172.21.15.40:0/2582659894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff30c0b7b40 0x7ff30c09d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:02.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.513+0000 7f15ebe00640 1 -- 172.21.15.40:0/1852504741 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f15e4003cd0 con 0x7f15f40ca200 2024-09-11T00:24:02.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.515+0000 7f15ebe00640 1 --2- 172.21.15.40:0/1852504741 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f15d4077fc0 0x7f15d407a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.515+0000 7f15ebe00640 1 -- 172.21.15.40:0/1852504741 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f15e40ba9a0 con 0x7f15f40ca200 2024-09-11T00:24:02.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.517+0000 7f15f3400640 1 --2- 172.21.15.40:0/1852504741 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f15d4077fc0 0x7f15d407a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.517+0000 7f15f3400640 1 --2- 172.21.15.40:0/1852504741 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f15d4077fc0 0x7f15d407a480 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f15f415c7f0 tx=0x7f15ec009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:02.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.520+0000 7ff303400640 1 -- 172.21.15.40:0/2582659894 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8037030 con 0x7ff30c0b51f0 2024-09-11T00:24:02.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.520+0000 7ff303400640 1 -- 172.21.15.40:0/2582659894 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2f8041070 con 0x7ff30c0b51f0 2024-09-11T00:24:02.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.520+0000 7ff303400640 1 -- 172.21.15.40:0/2582659894 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8004e50 con 0x7ff30c0b51f0 2024-09-11T00:24:02.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.520+0000 7f15ebe00640 1 -- 172.21.15.40:0/1852504741 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f15e404b070 con 0x7f15f40ca200 2024-09-11T00:24:02.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.521+0000 7ff312200640 1 -- 172.21.15.40:0/2582659894 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30c1f4f50 con 0x7ff30c0b51f0 2024-09-11T00:24:02.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.522+0000 7ff312200640 1 -- 172.21.15.40:0/2582659894 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff30c1f5510 con 0x7ff30c0b51f0 2024-09-11T00:24:02.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.522+0000 7f2333e00640 1 -- 172.21.15.40:0/2337187189 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2324084010 con 0x7f233c15d850 2024-09-11T00:24:02.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.525+0000 7ff303400640 1 -- 172.21.15.40:0/2582659894 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff2f80035f0 con 0x7ff30c0b51f0 2024-09-11T00:24:02.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.527+0000 7ff303400640 1 --2- 172.21.15.40:0/2582659894 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff2ec078160 0x7ff2ec07a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:02.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.527+0000 7ff303400640 1 -- 172.21.15.40:0/2582659894 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff2f80ba160 con 0x7ff30c0b51f0 2024-09-11T00:24:02.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.528+0000 7ff312200640 1 -- 172.21.15.40:0/2582659894 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff30c0cfa30 con 0x7ff30c0b51f0 2024-09-11T00:24:02.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.530+0000 7ff30aa00640 1 --2- 172.21.15.40:0/2582659894 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff2ec078160 0x7ff2ec07a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:02.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.530+0000 7ff30aa00640 1 --2- 172.21.15.40:0/2582659894 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff2ec078160 0x7ff2ec07a620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff30c06db90 tx=0x7ff304009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:02.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.534+0000 7ff303400640 1 -- 172.21.15.40:0/2582659894 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff2f8082cb0 con 0x7ff30c0b51f0 2024-09-11T00:24:02.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.847+0000 7f1e4d400640 1 -- 172.21.15.40:0/3900358412 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1e480739b0 con 0x7f1e48154c80 2024-09-11T00:24:02.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.848+0000 7f1e3ea00640 1 -- 172.21.15.40:0/3900358412 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1e380992e0 con 0x7f1e48154c80 2024-09-11T00:24:02.851 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-09-11T00:24:02.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.853+0000 7f1e4d400640 1 -- 172.21.15.40:0/3900358412 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1e28078040 msgr2=0x7f1e2807a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.853+0000 7f1e4d400640 1 --2- 172.21.15.40:0/3900358412 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1e28078040 0x7f1e2807a500 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1e40005fd0 tx=0x7f1e400097d0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.853+0000 7f1e4d400640 1 -- 172.21.15.40:0/3900358412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e48154c80 msgr2=0x7f1e481533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.853+0000 7f1e4d400640 1 --2- 172.21.15.40:0/3900358412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e48154c80 0x7f1e481533d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1e4806dde0 tx=0x7f1e38005a20 comp rx=0 tx=0).stop 2024-09-11T00:24:02.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.854+0000 7f1e4d400640 1 -- 172.21.15.40:0/3900358412 shutdown_connections 2024-09-11T00:24:02.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.854+0000 7f1e4d400640 1 --2- 172.21.15.40:0/3900358412 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1e28078040 0x7f1e2807a500 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.854+0000 7f1e4d400640 1 --2- 172.21.15.40:0/3900358412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e48154c80 0x7f1e481533d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.854+0000 7f1e4d400640 1 --2- 172.21.15.40:0/3900358412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e480ce130 0x7f1e481f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.854+0000 7f1e4d400640 1 --2- 172.21.15.40:0/3900358412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e480aebf0 0x7f1e481f7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.854+0000 7f1e4d400640 1 -- 172.21.15.40:0/3900358412 >> 172.21.15.40:0/3900358412 conn(0x7f1e480cc320 msgr2=0x7f1e480afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:02.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.855+0000 7f1e4d400640 1 -- 172.21.15.40:0/3900358412 shutdown_connections 2024-09-11T00:24:02.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.855+0000 7f1e4d400640 1 -- 172.21.15.40:0/3900358412 wait complete. 2024-09-11T00:24:02.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-09-11T00:24:02.884 DEBUG:teuthology.parallel:result is None 2024-09-11T00:24:02.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.917+0000 7f15fb200640 1 -- 172.21.15.40:0/1852504741 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f15f406fb80 con 0x7f15f40ca200 2024-09-11T00:24:02.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.918+0000 7f15ebe00640 1 -- 172.21.15.40:0/1852504741 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f15f40c4df0 con 0x7f15f40ca200 2024-09-11T00:24:02.919 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-09-11T00:24:02.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.920+0000 7f15fb200640 1 -- 172.21.15.40:0/1852504741 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f15d4077fc0 msgr2=0x7f15d407a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.920+0000 7f15fb200640 1 --2- 172.21.15.40:0/1852504741 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f15d4077fc0 0x7f15d407a480 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f15f415c7f0 tx=0x7f15ec009040 comp rx=0 tx=0).stop 2024-09-11T00:24:02.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.920+0000 7f15fb200640 1 -- 172.21.15.40:0/1852504741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15f40ca200 msgr2=0x7f15f40c5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.920+0000 7f15fb200640 1 --2- 172.21.15.40:0/1852504741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15f40ca200 0x7f15f40c5e30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f15e4000c00 tx=0x7f15e4032b90 comp rx=0 tx=0).stop 2024-09-11T00:24:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.920+0000 7f15fb200640 1 -- 172.21.15.40:0/1852504741 shutdown_connections 2024-09-11T00:24:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.920+0000 7f15fb200640 1 --2- 172.21.15.40:0/1852504741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15f41fcdd0 0x7f15f414ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.920+0000 7f15fb200640 1 --2- 172.21.15.40:0/1852504741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15f41545c0 0x7f15f41fc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.920+0000 7f15fb200640 1 --2- 172.21.15.40:0/1852504741 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f15d4077fc0 0x7f15d407a480 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.920+0000 7f15fb200640 1 --2- 172.21.15.40:0/1852504741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15f40ca200 0x7f15f40c5e30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.920+0000 7f15fb200640 1 -- 172.21.15.40:0/1852504741 >> 172.21.15.40:0/1852504741 conn(0x7f15f40cfbb0 msgr2=0x7f15f415bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.920+0000 7f15fb200640 1 -- 172.21.15.40:0/1852504741 shutdown_connections 2024-09-11T00:24:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.920+0000 7f15fb200640 1 -- 172.21.15.40:0/1852504741 wait complete. 2024-09-11T00:24:02.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2024-09-11T00:24:02.938 DEBUG:teuthology.parallel:result is None 2024-09-11T00:24:02.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.954+0000 7fc71e800640 1 -- 172.21.15.40:0/3305257093 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc7180b5b30 con 0x7fc7180cde90 2024-09-11T00:24:02.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.954+0000 7fc70f400640 1 -- 172.21.15.40:0/3305257093 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc7180b5b30 con 0x7fc7180cde90 2024-09-11T00:24:02.956 INFO:teuthology.orchestra.run.smithi040.stdout:64424509448 2024-09-11T00:24:02.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.958+0000 7fc71e800640 1 -- 172.21.15.40:0/3305257093 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc6f4078170 msgr2=0x7fc6f407a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.958+0000 7fc71e800640 1 --2- 172.21.15.40:0/3305257093 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc6f4078170 0x7fc6f407a630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc710033000 tx=0x7fc710004730 comp rx=0 tx=0).stop 2024-09-11T00:24:02.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.958+0000 7fc71e800640 1 -- 172.21.15.40:0/3305257093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7180cde90 msgr2=0x7fc718073b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.958+0000 7fc71e800640 1 --2- 172.21.15.40:0/3305257093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7180cde90 0x7fc718073b50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc70800ba50 tx=0x7fc70800bf10 comp rx=0 tx=0).stop 2024-09-11T00:24:02.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.958+0000 7fc71e800640 1 -- 172.21.15.40:0/3305257093 shutdown_connections 2024-09-11T00:24:02.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.958+0000 7fba57e00640 1 -- 172.21.15.40:0/3054432601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fba50051480 con 0x7fba500351b0 2024-09-11T00:24:02.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.958+0000 7fc71e800640 1 --2- 172.21.15.40:0/3305257093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7181550b0 0x7fc718074090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.958+0000 7fc71e800640 1 --2- 172.21.15.40:0/3305257093 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc6f4078170 0x7fc6f407a630 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.958+0000 7fc71e800640 1 --2- 172.21.15.40:0/3305257093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7180cde90 0x7fc718073b50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.958+0000 7fc71e800640 1 --2- 172.21.15.40:0/3305257093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7180aefa0 0x7fc7181f8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.958+0000 7fc71e800640 1 -- 172.21.15.40:0/3305257093 >> 172.21.15.40:0/3305257093 conn(0x7fc7180cfbb0 msgr2=0x7fc7180729b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:02.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.958+0000 7fc71e800640 1 -- 172.21.15.40:0/3305257093 shutdown_connections 2024-09-11T00:24:02.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.959+0000 7fba4ea00640 1 -- 172.21.15.40:0/3054432601 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fba48067c30 con 0x7fba500351b0 2024-09-11T00:24:02.961 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-09-11T00:24:02.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.959+0000 7f470ca00640 1 -- 172.21.15.40:0/512235581 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f470815b720 con 0x7f470815bc60 2024-09-11T00:24:02.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.959+0000 7fc71e800640 1 -- 172.21.15.40:0/3305257093 wait complete. 2024-09-11T00:24:02.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.960+0000 7f46fea00640 1 -- 172.21.15.40:0/512235581 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f46f003f030 con 0x7f470815bc60 2024-09-11T00:24:02.962 INFO:teuthology.orchestra.run.smithi040.stdout:60129542153 2024-09-11T00:24:02.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.961+0000 7fba57e00640 1 -- 172.21.15.40:0/3054432601 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fba38077f70 msgr2=0x7fba3807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.961+0000 7fba57e00640 1 --2- 172.21.15.40:0/3054432601 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fba38077f70 0x7fba3807a430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba44034000 tx=0x7fba44004730 comp rx=0 tx=0).stop 2024-09-11T00:24:02.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.962+0000 7fba57e00640 1 -- 172.21.15.40:0/3054432601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba500351b0 msgr2=0x7fba5004e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.962+0000 7fba57e00640 1 --2- 172.21.15.40:0/3054432601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba500351b0 0x7fba5004e510 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fba4800e9f0 tx=0x7fba4800eeb0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.962+0000 7fba57e00640 1 -- 172.21.15.40:0/3054432601 shutdown_connections 2024-09-11T00:24:02.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.962+0000 7fba57e00640 1 --2- 172.21.15.40:0/3054432601 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fba38077f70 0x7fba3807a430 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.962+0000 7fba57e00640 1 --2- 172.21.15.40:0/3054432601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba500e31e0 0x7fba5004b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.962+0000 7fba57e00640 1 --2- 172.21.15.40:0/3054432601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba500e2e00 0x7fba500d5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.962+0000 7fba57e00640 1 --2- 172.21.15.40:0/3054432601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba500351b0 0x7fba5004e510 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.962+0000 7fba57e00640 1 -- 172.21.15.40:0/3054432601 >> 172.21.15.40:0/3054432601 conn(0x7fba5001d770 msgr2=0x7fba50005dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:02.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.962+0000 7fba57e00640 1 -- 172.21.15.40:0/3054432601 shutdown_connections 2024-09-11T00:24:02.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.962+0000 7fba57e00640 1 -- 172.21.15.40:0/3054432601 wait complete. 2024-09-11T00:24:02.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.964+0000 7f470ca00640 1 -- 172.21.15.40:0/512235581 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f46e4078070 msgr2=0x7f46e407a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.964+0000 7f470ca00640 1 --2- 172.21.15.40:0/512235581 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f46e4078070 0x7f46e407a530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4700001840 tx=0x7f47000017d0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.964+0000 7f470ca00640 1 -- 172.21.15.40:0/512235581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f470815bc60 msgr2=0x7f470806e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.964+0000 7f470ca00640 1 --2- 172.21.15.40:0/512235581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f470815bc60 0x7f470806e590 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f46f002ab00 tx=0x7f46f0033c20 comp rx=0 tx=0).stop 2024-09-11T00:24:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.964+0000 7f470ca00640 1 -- 172.21.15.40:0/512235581 shutdown_connections 2024-09-11T00:24:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.964+0000 7f470ca00640 1 --2- 172.21.15.40:0/512235581 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f46e4078070 0x7f46e407a530 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.964+0000 7f470ca00640 1 --2- 172.21.15.40:0/512235581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f470815e570 0x7f47080b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.964+0000 7f470ca00640 1 --2- 172.21.15.40:0/512235581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f470815bc60 0x7f470806e590 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f46f002ab00 tx=0x7f46f0033c20 comp rx=0 tx=0).stop 2024-09-11T00:24:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.964+0000 7f470ca00640 1 --2- 172.21.15.40:0/512235581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f470815a870 0x7f47080c5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.964+0000 7f470ca00640 1 -- 172.21.15.40:0/512235581 >> 172.21.15.40:0/512235581 conn(0x7f47080b1280 msgr2=0x7f47080cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:02.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.966+0000 7f470ca00640 1 -- 172.21.15.40:0/512235581 shutdown_connections 2024-09-11T00:24:02.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.966+0000 7f470ca00640 1 -- 172.21.15.40:0/512235581 wait complete. 2024-09-11T00:24:02.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.971+0000 7fee53e00640 1 -- 172.21.15.40:0/3169317781 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fee4c0d1680 con 0x7fee4c0d4aa0 2024-09-11T00:24:02.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.971+0000 7f2341400640 1 -- 172.21.15.40:0/2337187189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f233c073fc0 con 0x7f233c15d850 2024-09-11T00:24:02.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.971+0000 7fee49600640 1 -- 172.21.15.40:0/3169317781 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fee44062bf0 con 0x7fee4c0d4aa0 2024-09-11T00:24:02.974 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-09-11T00:24:02.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.972+0000 7f2333e00640 1 -- 172.21.15.40:0/2337187189 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2324083910 con 0x7f233c15d850 2024-09-11T00:24:02.974 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-09-11T00:24:02.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.972+0000 7ff312200640 1 -- 172.21.15.40:0/2582659894 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff30c0d4240 con 0x7ff30c0b51f0 2024-09-11T00:24:02.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.973+0000 7ff303400640 1 -- 172.21.15.40:0/2582659894 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff2f80825b0 con 0x7ff30c0b51f0 2024-09-11T00:24:02.975 INFO:teuthology.orchestra.run.smithi040.stdout:64424509446 2024-09-11T00:24:02.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7ff312200640 1 -- 172.21.15.40:0/2582659894 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff2ec078160 msgr2=0x7ff2ec07a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7ff312200640 1 --2- 172.21.15.40:0/2582659894 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff2ec078160 0x7ff2ec07a620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff30c06db90 tx=0x7ff304009040 comp rx=0 tx=0).stop 2024-09-11T00:24:02.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7ff312200640 1 -- 172.21.15.40:0/2582659894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30c0b51f0 msgr2=0x7ff30c1f4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7ff312200640 1 --2- 172.21.15.40:0/2582659894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30c0b51f0 0x7ff30c1f4690 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff2f802a9a0 tx=0x7ff2f8004a50 comp rx=0 tx=0).stop 2024-09-11T00:24:02.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7fee53e00640 1 -- 172.21.15.40:0/3169317781 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fee2c077f70 msgr2=0x7fee2c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7fee53e00640 1 --2- 172.21.15.40:0/3169317781 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fee2c077f70 0x7fee2c07a430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fee400096c0 tx=0x7fee40004730 comp rx=0 tx=0).stop 2024-09-11T00:24:02.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7fee53e00640 1 -- 172.21.15.40:0/3169317781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee4c0d4aa0 msgr2=0x7fee4c205c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7fee53e00640 1 --2- 172.21.15.40:0/3169317781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee4c0d4aa0 0x7fee4c205c10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fee4400ea80 tx=0x7fee4400ef40 comp rx=0 tx=0).stop 2024-09-11T00:24:02.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7f2341400640 1 -- 172.21.15.40:0/2337187189 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2318077f70 msgr2=0x7f231807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7f2341400640 1 --2- 172.21.15.40:0/2337187189 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2318077f70 0x7f231807a430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f233c15cdb0 tx=0x7f232c01a510 comp rx=0 tx=0).stop 2024-09-11T00:24:02.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7f2341400640 1 -- 172.21.15.40:0/2337187189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f233c15d850 msgr2=0x7f233c1578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:02.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7f2341400640 1 --2- 172.21.15.40:0/2337187189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f233c15d850 0x7f233c1578f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2324000c00 tx=0x7f2324032b90 comp rx=0 tx=0).stop 2024-09-11T00:24:02.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7fee53e00640 1 -- 172.21.15.40:0/3169317781 shutdown_connections 2024-09-11T00:24:02.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7fee53e00640 1 --2- 172.21.15.40:0/3169317781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee4c0d4aa0 0x7fee4c205c10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7fee53e00640 1 --2- 172.21.15.40:0/3169317781 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fee2c077f70 0x7fee2c07a430 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7fee53e00640 1 --2- 172.21.15.40:0/3169317781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee4c0d2350 0x7fee4c2056d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7fee53e00640 1 --2- 172.21.15.40:0/3169317781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee4c0b2e50 0x7fee4c156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7fee53e00640 1 -- 172.21.15.40:0/3169317781 >> 172.21.15.40:0/3169317781 conn(0x7fee4c0d3f80 msgr2=0x7fee4c0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:02.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7ff312200640 1 -- 172.21.15.40:0/2582659894 shutdown_connections 2024-09-11T00:24:02.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7ff312200640 1 --2- 172.21.15.40:0/2582659894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30c161150 0x7ff30c15ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7ff312200640 1 --2- 172.21.15.40:0/2582659894 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff2ec078160 0x7ff2ec07a620 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7ff312200640 1 --2- 172.21.15.40:0/2582659894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff30c0b7b40 0x7ff30c09d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7ff312200640 1 --2- 172.21.15.40:0/2582659894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30c0b51f0 0x7ff30c1f4690 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7ff312200640 1 -- 172.21.15.40:0/2582659894 >> 172.21.15.40:0/2582659894 conn(0x7ff30c0d3c50 msgr2=0x7ff30c0d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:02.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7f2341400640 1 -- 172.21.15.40:0/2337187189 shutdown_connections 2024-09-11T00:24:02.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7f2341400640 1 --2- 172.21.15.40:0/2337187189 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2318077f70 0x7f231807a430 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7f2341400640 1 --2- 172.21.15.40:0/2337187189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f233c161880 0x7f233c160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7f2341400640 1 --2- 172.21.15.40:0/2337187189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f233c15d850 0x7f233c1578f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7ff312200640 1 -- 172.21.15.40:0/2582659894 shutdown_connections 2024-09-11T00:24:02.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7f2341400640 1 --2- 172.21.15.40:0/2337187189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f233c0b2d20 0x7f233c1570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:02.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7f2341400640 1 -- 172.21.15.40:0/2337187189 >> 172.21.15.40:0/2337187189 conn(0x7f233c0d3c20 msgr2=0x7f233c0d0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:02.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7ff312200640 1 -- 172.21.15.40:0/2582659894 wait complete. 2024-09-11T00:24:02.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7f2341400640 1 -- 172.21.15.40:0/2337187189 shutdown_connections 2024-09-11T00:24:02.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7f2341400640 1 -- 172.21.15.40:0/2337187189 wait complete. 2024-09-11T00:24:02.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.976+0000 7fee53e00640 1 -- 172.21.15.40:0/3169317781 shutdown_connections 2024-09-11T00:24:02.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:02.977+0000 7fee53e00640 1 -- 172.21.15.40:0/3169317781 wait complete. 2024-09-11T00:24:02.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.6 2024-09-11T00:24:02.985 DEBUG:teuthology.parallel:result is None 2024-09-11T00:24:02.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.7 2024-09-11T00:24:02.986 DEBUG:teuthology.parallel:result is None 2024-09-11T00:24:02.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542153 for osd.0 2024-09-11T00:24:02.994 DEBUG:teuthology.parallel:result is None 2024-09-11T00:24:02.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.4 2024-09-11T00:24:02.997 DEBUG:teuthology.parallel:result is None 2024-09-11T00:24:03.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-09-11T00:24:03.003 DEBUG:teuthology.parallel:result is None 2024-09-11T00:24:03.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2024-09-11T00:24:03.006 DEBUG:teuthology.parallel:result is None 2024-09-11T00:24:03.006 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T00:24:03.006 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:24:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.204+0000 7f2a1cc00640 1 -- 172.21.15.40:0/3305500134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a180cba70 msgr2=0x7f2a180cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.204+0000 7f2a1cc00640 1 --2- 172.21.15.40:0/3305500134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a180cba70 0x7f2a180cbec0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009830 tx=0x7f2a0002a560 comp rx=0 tx=0).stop 2024-09-11T00:24:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.204+0000 7f2a1cc00640 1 -- 172.21.15.40:0/3305500134 shutdown_connections 2024-09-11T00:24:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.204+0000 7f2a1cc00640 1 --2- 172.21.15.40:0/3305500134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a180cba70 0x7f2a180cbec0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.204+0000 7f2a1cc00640 1 --2- 172.21.15.40:0/3305500134 >> v2:172.21.15.175:3300/0 conn(0x7f2a1815bcc0 0x7f2a180cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.204+0000 7f2a1cc00640 1 -- 172.21.15.40:0/3305500134 >> 172.21.15.40:0/3305500134 conn(0x7f2a180cfbb0 msgr2=0x7f2a180cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.204+0000 7f2a1cc00640 1 -- 172.21.15.40:0/3305500134 shutdown_connections 2024-09-11T00:24:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.204+0000 7f2a1cc00640 1 -- 172.21.15.40:0/3305500134 wait complete. 2024-09-11T00:24:03.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.206+0000 7f2a1cc00640 1 Processor -- start 2024-09-11T00:24:03.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.206+0000 7f2a1cc00640 1 -- start start 2024-09-11T00:24:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.207+0000 7f2a1cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a180ca200 0x7f2a1815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.207+0000 7f2a1cc00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a180cba70 0x7f2a18152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.207+0000 7f2a1cc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a1815bcc0 0x7f2a181f4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.207+0000 7f2a1cc00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1815f940 con 0x7f2a1815bcc0 2024-09-11T00:24:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.207+0000 7f2a1cc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1815f7c0 con 0x7f2a180ca200 2024-09-11T00:24:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.207+0000 7f2a1cc00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2a180cad60 con 0x7f2a180cba70 2024-09-11T00:24:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.207+0000 7f2a16800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a1815bcc0 0x7f2a181f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:03.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.207+0000 7f2a16800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a1815bcc0 0x7f2a181f4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39786/0 (socket says 172.21.15.40:39786) 2024-09-11T00:24:03.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.207+0000 7f2a16800640 1 -- 172.21.15.40:0/3746015109 learned_addr learned my addr 172.21.15.40:0/3746015109 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:03.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.207+0000 7f2a15e00640 1 --2- 172.21.15.40:0/3746015109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a180ca200 0x7f2a1815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:03.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.207+0000 7f2a0d400640 1 --2- 172.21.15.40:0/3746015109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a180cba70 0x7f2a18152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:03.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.208+0000 7f2a16800640 1 -- 172.21.15.40:0/3746015109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a180cba70 msgr2=0x7f2a18152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:03.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.208+0000 7f2a16800640 1 --2- 172.21.15.40:0/3746015109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a180cba70 0x7f2a18152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:03.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.208+0000 7f2a16800640 1 -- 172.21.15.40:0/3746015109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a180ca200 msgr2=0x7f2a1815eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:03.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.208+0000 7f2a16800640 1 --2- 172.21.15.40:0/3746015109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a180ca200 0x7f2a1815eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:03.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.208+0000 7f2a16800640 1 -- 172.21.15.40:0/3746015109 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a181f5430 con 0x7f2a1815bcc0 2024-09-11T00:24:03.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.208+0000 7f2a16800640 1 --2- 172.21.15.40:0/3746015109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a1815bcc0 0x7f2a181f4590 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000cbf0 tx=0x7f2a1000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:03.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.208+0000 7f2a0ea00640 1 -- 172.21.15.40:0/3746015109 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a10016020 con 0x7f2a1815bcc0 2024-09-11T00:24:03.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.208+0000 7f2a0ea00640 1 -- 172.21.15.40:0/3746015109 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a1000acf0 con 0x7f2a1815bcc0 2024-09-11T00:24:03.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.208+0000 7f2a0ea00640 1 -- 172.21.15.40:0/3746015109 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a10012680 con 0x7f2a1815bcc0 2024-09-11T00:24:03.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.208+0000 7f2a1cc00640 1 -- 172.21.15.40:0/3746015109 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a181f4e70 con 0x7f2a1815bcc0 2024-09-11T00:24:03.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.208+0000 7f2a1cc00640 1 -- 172.21.15.40:0/3746015109 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a181f5740 con 0x7f2a1815bcc0 2024-09-11T00:24:03.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.209+0000 7f2a1cc00640 1 -- 172.21.15.40:0/3746015109 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a180cbec0 con 0x7f2a1815bcc0 2024-09-11T00:24:03.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.210+0000 7f2a0ea00640 1 -- 172.21.15.40:0/3746015109 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2a10012820 con 0x7f2a1815bcc0 2024-09-11T00:24:03.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.211+0000 7f2a0ea00640 1 --2- 172.21.15.40:0/3746015109 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f29f4077f70 0x7f29f407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:03.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.211+0000 7f2a0ea00640 1 -- 172.21.15.40:0/3746015109 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2a1009a360 con 0x7f2a1815bcc0 2024-09-11T00:24:03.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.212+0000 7f2a15e00640 1 --2- 172.21.15.40:0/3746015109 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f29f4077f70 0x7f29f407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:03.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.212+0000 7f2a15e00640 1 --2- 172.21.15.40:0/3746015109 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f29f4077f70 0x7f29f407a430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009b30 tx=0x7f2a08005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:03.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.215+0000 7f2a0ea00640 1 -- 172.21.15.40:0/3746015109 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2a10020030 con 0x7f2a1815bcc0 2024-09-11T00:24:03.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.407+0000 7f2a1cc00640 1 -- 172.21.15.40:0/3746015109 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2a18074060 con 0x7f29f4077f70 2024-09-11T00:24:03.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.412+0000 7f2a0ea00640 1 -- 172.21.15.40:0/3746015109 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f2a18074060 con 0x7f29f4077f70 2024-09-11T00:24:03.417 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:03.418 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T00:24:03.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.416+0000 7f2a1cc00640 1 -- 172.21.15.40:0/3746015109 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f29f4077f70 msgr2=0x7f29f407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:03.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.416+0000 7f2a1cc00640 1 --2- 172.21.15.40:0/3746015109 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f29f4077f70 0x7f29f407a430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009b30 tx=0x7f2a08005f90 comp rx=0 tx=0).stop 2024-09-11T00:24:03.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.416+0000 7f2a1cc00640 1 -- 172.21.15.40:0/3746015109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a1815bcc0 msgr2=0x7f2a181f4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:03.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.416+0000 7f2a1cc00640 1 --2- 172.21.15.40:0/3746015109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a1815bcc0 0x7f2a181f4590 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000cbf0 tx=0x7f2a1000a430 comp rx=0 tx=0).stop 2024-09-11T00:24:03.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.416+0000 7f2a1cc00640 1 -- 172.21.15.40:0/3746015109 shutdown_connections 2024-09-11T00:24:03.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.416+0000 7f2a1cc00640 1 --2- 172.21.15.40:0/3746015109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a1815bcc0 0x7f2a181f4590 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:03.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.416+0000 7f2a1cc00640 1 --2- 172.21.15.40:0/3746015109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a180cba70 0x7f2a18152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:03.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.416+0000 7f2a1cc00640 1 --2- 172.21.15.40:0/3746015109 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f29f4077f70 0x7f29f407a430 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:03.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.416+0000 7f2a1cc00640 1 --2- 172.21.15.40:0/3746015109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a180ca200 0x7f2a1815eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:03.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.416+0000 7f2a1cc00640 1 -- 172.21.15.40:0/3746015109 >> 172.21.15.40:0/3746015109 conn(0x7f2a180cfbb0 msgr2=0x7f2a180ae750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:03.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.417+0000 7f2a1cc00640 1 -- 172.21.15.40:0/3746015109 shutdown_connections 2024-09-11T00:24:03.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.417+0000 7f2a1cc00640 1 -- 172.21.15.40:0/3746015109 wait complete. 2024-09-11T00:24:03.434 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-11T00:24:01.778820+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219184,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755536,"statfs":{"total":773094113280,"available":772869668864,"internally_reserved":0,"allocated":3022848,"data_stored":1795828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.847770"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.872004+0000","last_change":"2024-09-11T00:23:48.948893+0000","last_active":"2024-09-11T00:23:50.872004+0000","last_peered":"2024-09-11T00:23:50.872004+0000","last_clean":"2024-09-11T00:23:50.872004+0000","last_became_active":"2024-09-11T00:23:48.948539+0000","last_became_peered":"2024-09-11T00:23:48.948539+0000","last_unstale":"2024-09-11T00:23:50.872004+0000","last_undegraded":"2024-09-11T00:23:50.872004+0000","last_fullsized":"2024-09-11T00:23:50.872004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:16.991662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934001+0000","last_change":"2024-09-11T00:23:48.937342+0000","last_active":"2024-09-11T00:23:49.934001+0000","last_peered":"2024-09-11T00:23:49.934001+0000","last_clean":"2024-09-11T00:23:49.934001+0000","last_became_active":"2024-09-11T00:23:48.936595+0000","last_became_peered":"2024-09-11T00:23:48.936595+0000","last_unstale":"2024-09-11T00:23:49.934001+0000","last_undegraded":"2024-09-11T00:23:49.934001+0000","last_fullsized":"2024-09-11T00:23:49.934001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:32.096363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526446+0000","last_change":"2024-09-11T00:23:48.937798+0000","last_active":"2024-09-11T00:23:50.526446+0000","last_peered":"2024-09-11T00:23:50.526446+0000","last_clean":"2024-09-11T00:23:50.526446+0000","last_became_active":"2024-09-11T00:23:48.937479+0000","last_became_peered":"2024-09-11T00:23:48.937479+0000","last_unstale":"2024-09-11T00:23:50.526446+0000","last_undegraded":"2024-09-11T00:23:50.526446+0000","last_fullsized":"2024-09-11T00:23:50.526446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:27.574913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935177+0000","last_change":"2024-09-11T00:23:48.931523+0000","last_active":"2024-09-11T00:23:49.935177+0000","last_peered":"2024-09-11T00:23:49.935177+0000","last_clean":"2024-09-11T00:23:49.935177+0000","last_became_active":"2024-09-11T00:23:48.930038+0000","last_became_peered":"2024-09-11T00:23:48.930038+0000","last_unstale":"2024-09-11T00:23:49.935177+0000","last_undegraded":"2024-09-11T00:23:49.935177+0000","last_fullsized":"2024-09-11T00:23:49.935177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:37.999694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871474+0000","last_change":"2024-09-11T00:23:48.936786+0000","last_active":"2024-09-11T00:23:50.871474+0000","last_peered":"2024-09-11T00:23:50.871474+0000","last_clean":"2024-09-11T00:23:50.871474+0000","last_became_active":"2024-09-11T00:23:48.936512+0000","last_became_peered":"2024-09-11T00:23:48.936512+0000","last_unstale":"2024-09-11T00:23:50.871474+0000","last_undegraded":"2024-09-11T00:23:50.871474+0000","last_fullsized":"2024-09-11T00:23:50.871474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:20.441191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934971+0000","last_change":"2024-09-11T00:23:48.935843+0000","last_active":"2024-09-11T00:23:49.934971+0000","last_peered":"2024-09-11T00:23:49.934971+0000","last_clean":"2024-09-11T00:23:49.934971+0000","last_became_active":"2024-09-11T00:23:48.935591+0000","last_became_peered":"2024-09-11T00:23:48.935591+0000","last_unstale":"2024-09-11T00:23:49.934971+0000","last_undegraded":"2024-09-11T00:23:49.934971+0000","last_fullsized":"2024-09-11T00:23:49.934971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:25.619010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870938+0000","last_change":"2024-09-11T00:23:48.939799+0000","last_active":"2024-09-11T00:23:50.870938+0000","last_peered":"2024-09-11T00:23:50.870938+0000","last_clean":"2024-09-11T00:23:50.870938+0000","last_became_active":"2024-09-11T00:23:48.939495+0000","last_became_peered":"2024-09-11T00:23:48.939495+0000","last_unstale":"2024-09-11T00:23:50.870938+0000","last_undegraded":"2024-09-11T00:23:50.870938+0000","last_fullsized":"2024-09-11T00:23:50.870938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:13.522317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869563+0000","last_change":"2024-09-11T00:23:48.933813+0000","last_active":"2024-09-11T00:23:50.869563+0000","last_peered":"2024-09-11T00:23:50.869563+0000","last_clean":"2024-09-11T00:23:50.869563+0000","last_became_active":"2024-09-11T00:23:48.932681+0000","last_became_peered":"2024-09-11T00:23:48.932681+0000","last_unstale":"2024-09-11T00:23:50.869563+0000","last_undegraded":"2024-09-11T00:23:50.869563+0000","last_fullsized":"2024-09-11T00:23:50.869563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:49.141326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.872030+0000","last_change":"2024-09-11T00:23:48.943035+0000","last_active":"2024-09-11T00:23:50.872030+0000","last_peered":"2024-09-11T00:23:50.872030+0000","last_clean":"2024-09-11T00:23:50.872030+0000","last_became_active":"2024-09-11T00:23:48.942299+0000","last_became_peered":"2024-09-11T00:23:48.942299+0000","last_unstale":"2024-09-11T00:23:50.872030+0000","last_undegraded":"2024-09-11T00:23:50.872030+0000","last_fullsized":"2024-09-11T00:23:50.872030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:04.169658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870722+0000","last_change":"2024-09-11T00:23:48.923914+0000","last_active":"2024-09-11T00:23:50.870722+0000","last_peered":"2024-09-11T00:23:50.870722+0000","last_clean":"2024-09-11T00:23:50.870722+0000","last_became_active":"2024-09-11T00:23:48.923637+0000","last_became_peered":"2024-09-11T00:23:48.923637+0000","last_unstale":"2024-09-11T00:23:50.870722+0000","last_undegraded":"2024-09-11T00:23:50.870722+0000","last_fullsized":"2024-09-11T00:23:50.870722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:08:27.071042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870678+0000","last_change":"2024-09-11T00:23:48.924320+0000","last_active":"2024-09-11T00:23:50.870678+0000","last_peered":"2024-09-11T00:23:50.870678+0000","last_clean":"2024-09-11T00:23:50.870678+0000","last_became_active":"2024-09-11T00:23:48.923963+0000","last_became_peered":"2024-09-11T00:23:48.923963+0000","last_unstale":"2024-09-11T00:23:50.870678+0000","last_undegraded":"2024-09-11T00:23:50.870678+0000","last_fullsized":"2024-09-11T00:23:50.870678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:57.017486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936400+0000","last_change":"2024-09-11T00:23:48.926315+0000","last_active":"2024-09-11T00:23:49.936400+0000","last_peered":"2024-09-11T00:23:49.936400+0000","last_clean":"2024-09-11T00:23:49.936400+0000","last_became_active":"2024-09-11T00:23:48.926023+0000","last_became_peered":"2024-09-11T00:23:48.926023+0000","last_unstale":"2024-09-11T00:23:49.936400+0000","last_undegraded":"2024-09-11T00:23:49.936400+0000","last_fullsized":"2024-09-11T00:23:49.936400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:53:00.946208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869742+0000","last_change":"2024-09-11T00:23:48.940397+0000","last_active":"2024-09-11T00:23:50.869742+0000","last_peered":"2024-09-11T00:23:50.869742+0000","last_clean":"2024-09-11T00:23:50.869742+0000","last_became_active":"2024-09-11T00:23:48.940131+0000","last_became_peered":"2024-09-11T00:23:48.940131+0000","last_unstale":"2024-09-11T00:23:50.869742+0000","last_undegraded":"2024-09-11T00:23:50.869742+0000","last_fullsized":"2024-09-11T00:23:50.869742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:08:27.071042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526136+0000","last_change":"2024-09-11T00:23:48.934059+0000","last_active":"2024-09-11T00:23:50.526136+0000","last_peered":"2024-09-11T00:23:50.526136+0000","last_clean":"2024-09-11T00:23:50.526136+0000","last_became_active":"2024-09-11T00:23:48.931545+0000","last_became_peered":"2024-09-11T00:23:48.931545+0000","last_unstale":"2024-09-11T00:23:50.526136+0000","last_undegraded":"2024-09-11T00:23:50.526136+0000","last_fullsized":"2024-09-11T00:23:50.526136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:22.406899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933205+0000","last_change":"2024-09-11T00:23:48.917392+0000","last_active":"2024-09-11T00:23:49.933205+0000","last_peered":"2024-09-11T00:23:49.933205+0000","last_clean":"2024-09-11T00:23:49.933205+0000","last_became_active":"2024-09-11T00:23:48.917076+0000","last_became_peered":"2024-09-11T00:23:48.917076+0000","last_unstale":"2024-09-11T00:23:49.933205+0000","last_undegraded":"2024-09-11T00:23:49.933205+0000","last_fullsized":"2024-09-11T00:23:49.933205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:33.143595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934240+0000","last_change":"2024-09-11T00:23:48.926949+0000","last_active":"2024-09-11T00:23:49.934240+0000","last_peered":"2024-09-11T00:23:49.934240+0000","last_clean":"2024-09-11T00:23:49.934240+0000","last_became_active":"2024-09-11T00:23:48.926624+0000","last_became_peered":"2024-09-11T00:23:48.926624+0000","last_unstale":"2024-09-11T00:23:49.934240+0000","last_undegraded":"2024-09-11T00:23:49.934240+0000","last_fullsized":"2024-09-11T00:23:49.934240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:40.283499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.937130+0000","last_change":"2024-09-11T00:23:48.927831+0000","last_active":"2024-09-11T00:23:49.937130+0000","last_peered":"2024-09-11T00:23:49.937130+0000","last_clean":"2024-09-11T00:23:49.937130+0000","last_became_active":"2024-09-11T00:23:48.927396+0000","last_became_peered":"2024-09-11T00:23:48.927396+0000","last_unstale":"2024-09-11T00:23:49.937130+0000","last_undegraded":"2024-09-11T00:23:49.937130+0000","last_fullsized":"2024-09-11T00:23:49.937130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:43.076990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713863+0000","last_change":"2024-09-11T00:23:48.925368+0000","last_active":"2024-09-11T00:23:50.713863+0000","last_peered":"2024-09-11T00:23:50.713863+0000","last_clean":"2024-09-11T00:23:50.713863+0000","last_became_active":"2024-09-11T00:23:48.925051+0000","last_became_peered":"2024-09-11T00:23:48.925051+0000","last_unstale":"2024-09-11T00:23:50.713863+0000","last_undegraded":"2024-09-11T00:23:50.713863+0000","last_fullsized":"2024-09-11T00:23:50.713863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:03.081754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871196+0000","last_change":"2024-09-11T00:23:48.945468+0000","last_active":"2024-09-11T00:23:50.871196+0000","last_peered":"2024-09-11T00:23:50.871196+0000","last_clean":"2024-09-11T00:23:50.871196+0000","last_became_active":"2024-09-11T00:23:48.944945+0000","last_became_peered":"2024-09-11T00:23:48.944945+0000","last_unstale":"2024-09-11T00:23:50.871196+0000","last_undegraded":"2024-09-11T00:23:50.871196+0000","last_fullsized":"2024-09-11T00:23:50.871196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:06.656916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870452+0000","last_change":"2024-09-11T00:23:48.921544+0000","last_active":"2024-09-11T00:23:50.870452+0000","last_peered":"2024-09-11T00:23:50.870452+0000","last_clean":"2024-09-11T00:23:50.870452+0000","last_became_active":"2024-09-11T00:23:48.921253+0000","last_became_peered":"2024-09-11T00:23:48.921253+0000","last_unstale":"2024-09-11T00:23:50.870452+0000","last_undegraded":"2024-09-11T00:23:50.870452+0000","last_fullsized":"2024-09-11T00:23:50.870452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:10.533107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526203+0000","last_change":"2024-09-11T00:23:48.942961+0000","last_active":"2024-09-11T00:23:50.526203+0000","last_peered":"2024-09-11T00:23:50.526203+0000","last_clean":"2024-09-11T00:23:50.526203+0000","last_became_active":"2024-09-11T00:23:48.941533+0000","last_became_peered":"2024-09-11T00:23:48.941533+0000","last_unstale":"2024-09-11T00:23:50.526203+0000","last_undegraded":"2024-09-11T00:23:50.526203+0000","last_fullsized":"2024-09-11T00:23:50.526203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:52.956083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935633+0000","last_change":"2024-09-11T00:23:48.935142+0000","last_active":"2024-09-11T00:23:49.935633+0000","last_peered":"2024-09-11T00:23:49.935633+0000","last_clean":"2024-09-11T00:23:49.935633+0000","last_became_active":"2024-09-11T00:23:48.933148+0000","last_became_peered":"2024-09-11T00:23:48.933148+0000","last_unstale":"2024-09-11T00:23:49.935633+0000","last_undegraded":"2024-09-11T00:23:49.935633+0000","last_fullsized":"2024-09-11T00:23:49.935633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:18:47.960332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869723+0000","last_change":"2024-09-11T00:23:48.929778+0000","last_active":"2024-09-11T00:23:50.869723+0000","last_peered":"2024-09-11T00:23:50.869723+0000","last_clean":"2024-09-11T00:23:50.869723+0000","last_became_active":"2024-09-11T00:23:48.928138+0000","last_became_peered":"2024-09-11T00:23:48.928138+0000","last_unstale":"2024-09-11T00:23:50.869723+0000","last_undegraded":"2024-09-11T00:23:50.869723+0000","last_fullsized":"2024-09-11T00:23:50.869723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:23.709720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934308+0000","last_change":"2024-09-11T00:23:48.947725+0000","last_active":"2024-09-11T00:23:49.934308+0000","last_peered":"2024-09-11T00:23:49.934308+0000","last_clean":"2024-09-11T00:23:49.934308+0000","last_became_active":"2024-09-11T00:23:48.947361+0000","last_became_peered":"2024-09-11T00:23:48.947361+0000","last_unstale":"2024-09-11T00:23:49.934308+0000","last_undegraded":"2024-09-11T00:23:49.934308+0000","last_fullsized":"2024-09-11T00:23:49.934308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:31.087205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870205+0000","last_change":"2024-09-11T00:23:48.944855+0000","last_active":"2024-09-11T00:23:50.870205+0000","last_peered":"2024-09-11T00:23:50.870205+0000","last_clean":"2024-09-11T00:23:50.870205+0000","last_became_active":"2024-09-11T00:23:48.944551+0000","last_became_peered":"2024-09-11T00:23:48.944551+0000","last_unstale":"2024-09-11T00:23:50.870205+0000","last_undegraded":"2024-09-11T00:23:50.870205+0000","last_fullsized":"2024-09-11T00:23:50.870205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:53.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870796+0000","last_change":"2024-09-11T00:23:48.937626+0000","last_active":"2024-09-11T00:23:50.870796+0000","last_peered":"2024-09-11T00:23:50.870796+0000","last_clean":"2024-09-11T00:23:50.870796+0000","last_became_active":"2024-09-11T00:23:48.937263+0000","last_became_peered":"2024-09-11T00:23:48.937263+0000","last_unstale":"2024-09-11T00:23:50.870796+0000","last_undegraded":"2024-09-11T00:23:50.870796+0000","last_fullsized":"2024-09-11T00:23:50.870796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:50.142533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933798+0000","last_change":"2024-09-11T00:23:48.928952+0000","last_active":"2024-09-11T00:23:49.933798+0000","last_peered":"2024-09-11T00:23:49.933798+0000","last_clean":"2024-09-11T00:23:49.933798+0000","last_became_active":"2024-09-11T00:23:48.928683+0000","last_became_peered":"2024-09-11T00:23:48.928683+0000","last_unstale":"2024-09-11T00:23:49.933798+0000","last_undegraded":"2024-09-11T00:23:49.933798+0000","last_fullsized":"2024-09-11T00:23:49.933798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:50.142533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870161+0000","last_change":"2024-09-11T00:23:48.929575+0000","last_active":"2024-09-11T00:23:50.870161+0000","last_peered":"2024-09-11T00:23:50.870161+0000","last_clean":"2024-09-11T00:23:50.870161+0000","last_became_active":"2024-09-11T00:23:48.928625+0000","last_became_peered":"2024-09-11T00:23:48.928625+0000","last_unstale":"2024-09-11T00:23:50.870161+0000","last_undegraded":"2024-09-11T00:23:50.870161+0000","last_fullsized":"2024-09-11T00:23:50.870161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:13.522317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526474+0000","last_change":"2024-09-11T00:23:48.947976+0000","last_active":"2024-09-11T00:23:50.526474+0000","last_peered":"2024-09-11T00:23:50.526474+0000","last_clean":"2024-09-11T00:23:50.526474+0000","last_became_active":"2024-09-11T00:23:48.947725+0000","last_became_peered":"2024-09-11T00:23:48.947725+0000","last_unstale":"2024-09-11T00:23:50.526474+0000","last_undegraded":"2024-09-11T00:23:50.526474+0000","last_fullsized":"2024-09-11T00:23:50.526474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:09:52.162272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935202+0000","last_change":"2024-09-11T00:23:48.930538+0000","last_active":"2024-09-11T00:23:49.935202+0000","last_peered":"2024-09-11T00:23:49.935202+0000","last_clean":"2024-09-11T00:23:49.935202+0000","last_became_active":"2024-09-11T00:23:48.930224+0000","last_became_peered":"2024-09-11T00:23:48.930224+0000","last_unstale":"2024-09-11T00:23:49.935202+0000","last_undegraded":"2024-09-11T00:23:49.935202+0000","last_fullsized":"2024-09-11T00:23:49.935202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:18.427715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713776+0000","last_change":"2024-09-11T00:23:48.927566+0000","last_active":"2024-09-11T00:23:50.713776+0000","last_peered":"2024-09-11T00:23:50.713776+0000","last_clean":"2024-09-11T00:23:50.713776+0000","last_became_active":"2024-09-11T00:23:48.927306+0000","last_became_peered":"2024-09-11T00:23:48.927306+0000","last_unstale":"2024-09-11T00:23:50.713776+0000","last_undegraded":"2024-09-11T00:23:50.713776+0000","last_fullsized":"2024-09-11T00:23:50.713776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:35.800616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870322+0000","last_change":"2024-09-11T00:23:48.926632+0000","last_active":"2024-09-11T00:23:50.870322+0000","last_peered":"2024-09-11T00:23:50.870322+0000","last_clean":"2024-09-11T00:23:50.870322+0000","last_became_active":"2024-09-11T00:23:48.926014+0000","last_became_peered":"2024-09-11T00:23:48.926014+0000","last_unstale":"2024-09-11T00:23:50.870322+0000","last_undegraded":"2024-09-11T00:23:50.870322+0000","last_fullsized":"2024-09-11T00:23:50.870322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:49.141326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936248+0000","last_change":"2024-09-11T00:23:48.925940+0000","last_active":"2024-09-11T00:23:49.936248+0000","last_peered":"2024-09-11T00:23:49.936248+0000","last_clean":"2024-09-11T00:23:49.936248+0000","last_became_active":"2024-09-11T00:23:48.925589+0000","last_became_peered":"2024-09-11T00:23:48.925589+0000","last_unstale":"2024-09-11T00:23:49.936248+0000","last_undegraded":"2024-09-11T00:23:49.936248+0000","last_fullsized":"2024-09-11T00:23:49.936248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:41.419916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869814+0000","last_change":"2024-09-11T00:23:47.934229+0000","last_active":"2024-09-11T00:23:50.869814+0000","last_peered":"2024-09-11T00:23:50.869814+0000","last_clean":"2024-09-11T00:23:50.869814+0000","last_became_active":"2024-09-11T00:23:47.933880+0000","last_became_peered":"2024-09-11T00:23:47.933880+0000","last_unstale":"2024-09-11T00:23:50.869814+0000","last_undegraded":"2024-09-11T00:23:50.869814+0000","last_fullsized":"2024-09-11T00:23:50.869814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:30.892853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526491+0000","last_change":"2024-09-11T00:23:48.934481+0000","last_active":"2024-09-11T00:23:50.526491+0000","last_peered":"2024-09-11T00:23:50.526491+0000","last_clean":"2024-09-11T00:23:50.526491+0000","last_became_active":"2024-09-11T00:23:48.931082+0000","last_became_peered":"2024-09-11T00:23:48.931082+0000","last_unstale":"2024-09-11T00:23:50.526491+0000","last_undegraded":"2024-09-11T00:23:50.526491+0000","last_fullsized":"2024-09-11T00:23:50.526491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:04.133148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870136+0000","last_change":"2024-09-11T00:23:47.933078+0000","last_active":"2024-09-11T00:23:50.870136+0000","last_peered":"2024-09-11T00:23:50.870136+0000","last_clean":"2024-09-11T00:23:50.870136+0000","last_became_active":"2024-09-11T00:23:47.932815+0000","last_became_peered":"2024-09-11T00:23:47.932815+0000","last_unstale":"2024-09-11T00:23:50.870136+0000","last_undegraded":"2024-09-11T00:23:50.870136+0000","last_fullsized":"2024-09-11T00:23:50.870136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:00.103061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869652+0000","last_change":"2024-09-11T00:23:47.927116+0000","last_active":"2024-09-11T00:23:50.869652+0000","last_peered":"2024-09-11T00:23:50.869652+0000","last_clean":"2024-09-11T00:23:50.869652+0000","last_became_active":"2024-09-11T00:23:47.926760+0000","last_became_peered":"2024-09-11T00:23:47.926760+0000","last_unstale":"2024-09-11T00:23:50.869652+0000","last_undegraded":"2024-09-11T00:23:50.869652+0000","last_fullsized":"2024-09-11T00:23:50.869652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:14:45.347474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869585+0000","last_change":"2024-09-11T00:23:48.947208+0000","last_active":"2024-09-11T00:23:50.869585+0000","last_peered":"2024-09-11T00:23:50.869585+0000","last_clean":"2024-09-11T00:23:50.869585+0000","last_became_active":"2024-09-11T00:23:48.946963+0000","last_became_peered":"2024-09-11T00:23:48.946963+0000","last_unstale":"2024-09-11T00:23:50.869585+0000","last_undegraded":"2024-09-11T00:23:50.869585+0000","last_fullsized":"2024-09-11T00:23:50.869585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:10.533107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934435+0000","last_change":"2024-09-11T00:23:47.924168+0000","last_active":"2024-09-11T00:23:49.934435+0000","last_peered":"2024-09-11T00:23:49.934435+0000","last_clean":"2024-09-11T00:23:49.934435+0000","last_became_active":"2024-09-11T00:23:47.923810+0000","last_became_peered":"2024-09-11T00:23:47.923810+0000","last_unstale":"2024-09-11T00:23:49.934435+0000","last_undegraded":"2024-09-11T00:23:49.934435+0000","last_fullsized":"2024-09-11T00:23:49.934435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:09.057962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933208+0000","last_change":"2024-09-11T00:23:48.932214+0000","last_active":"2024-09-11T00:23:49.933208+0000","last_peered":"2024-09-11T00:23:49.933208+0000","last_clean":"2024-09-11T00:23:49.933208+0000","last_became_active":"2024-09-11T00:23:48.931946+0000","last_became_peered":"2024-09-11T00:23:48.931946+0000","last_unstale":"2024-09-11T00:23:49.933208+0000","last_undegraded":"2024-09-11T00:23:49.933208+0000","last_fullsized":"2024-09-11T00:23:49.933208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:10.533107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871004+0000","last_change":"2024-09-11T00:23:47.929315+0000","last_active":"2024-09-11T00:23:50.871004+0000","last_peered":"2024-09-11T00:23:50.871004+0000","last_clean":"2024-09-11T00:23:50.871004+0000","last_became_active":"2024-09-11T00:23:47.928873+0000","last_became_peered":"2024-09-11T00:23:47.928873+0000","last_unstale":"2024-09-11T00:23:50.871004+0000","last_undegraded":"2024-09-11T00:23:50.871004+0000","last_fullsized":"2024-09-11T00:23:50.871004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:27.835276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935414+0000","last_change":"2024-09-11T00:23:48.933958+0000","last_active":"2024-09-11T00:23:49.935414+0000","last_peered":"2024-09-11T00:23:49.935414+0000","last_clean":"2024-09-11T00:23:49.935414+0000","last_became_active":"2024-09-11T00:23:48.933311+0000","last_became_peered":"2024-09-11T00:23:48.933311+0000","last_unstale":"2024-09-11T00:23:49.935414+0000","last_undegraded":"2024-09-11T00:23:49.935414+0000","last_fullsized":"2024-09-11T00:23:49.935414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:48.420430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936215+0000","last_change":"2024-09-11T00:23:47.936415+0000","last_active":"2024-09-11T00:23:49.936215+0000","last_peered":"2024-09-11T00:23:49.936215+0000","last_clean":"2024-09-11T00:23:49.936215+0000","last_became_active":"2024-09-11T00:23:47.935508+0000","last_became_peered":"2024-09-11T00:23:47.935508+0000","last_unstale":"2024-09-11T00:23:49.936215+0000","last_undegraded":"2024-09-11T00:23:49.936215+0000","last_fullsized":"2024-09-11T00:23:49.936215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:14:04.971648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526665+0000","last_change":"2024-09-11T00:23:48.925280+0000","last_active":"2024-09-11T00:23:50.526665+0000","last_peered":"2024-09-11T00:23:50.526665+0000","last_clean":"2024-09-11T00:23:50.526665+0000","last_became_active":"2024-09-11T00:23:48.923558+0000","last_became_peered":"2024-09-11T00:23:48.923558+0000","last_unstale":"2024-09-11T00:23:50.526665+0000","last_undegraded":"2024-09-11T00:23:50.526665+0000","last_fullsized":"2024-09-11T00:23:50.526665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:51.437783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933648+0000","last_change":"2024-09-11T00:23:47.917495+0000","last_active":"2024-09-11T00:23:49.933648+0000","last_peered":"2024-09-11T00:23:49.933648+0000","last_clean":"2024-09-11T00:23:49.933648+0000","last_became_active":"2024-09-11T00:23:47.917190+0000","last_became_peered":"2024-09-11T00:23:47.917190+0000","last_unstale":"2024-09-11T00:23:49.933648+0000","last_undegraded":"2024-09-11T00:23:49.933648+0000","last_fullsized":"2024-09-11T00:23:49.933648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:40.413211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936314+0000","last_change":"2024-09-11T00:23:48.931464+0000","last_active":"2024-09-11T00:23:49.936314+0000","last_peered":"2024-09-11T00:23:49.936314+0000","last_clean":"2024-09-11T00:23:49.936314+0000","last_became_active":"2024-09-11T00:23:48.929780+0000","last_became_peered":"2024-09-11T00:23:48.929780+0000","last_unstale":"2024-09-11T00:23:49.936314+0000","last_undegraded":"2024-09-11T00:23:49.936314+0000","last_fullsized":"2024-09-11T00:23:49.936314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:06.878857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870468+0000","last_change":"2024-09-11T00:23:47.929964+0000","last_active":"2024-09-11T00:23:50.870468+0000","last_peered":"2024-09-11T00:23:50.870468+0000","last_clean":"2024-09-11T00:23:50.870468+0000","last_became_active":"2024-09-11T00:23:47.929635+0000","last_became_peered":"2024-09-11T00:23:47.929635+0000","last_unstale":"2024-09-11T00:23:50.870468+0000","last_undegraded":"2024-09-11T00:23:50.870468+0000","last_fullsized":"2024-09-11T00:23:50.870468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:05.769710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870963+0000","last_change":"2024-09-11T00:23:48.946941+0000","last_active":"2024-09-11T00:23:50.870963+0000","last_peered":"2024-09-11T00:23:50.870963+0000","last_clean":"2024-09-11T00:23:50.870963+0000","last_became_active":"2024-09-11T00:23:48.946690+0000","last_became_peered":"2024-09-11T00:23:48.946690+0000","last_unstale":"2024-09-11T00:23:50.870963+0000","last_undegraded":"2024-09-11T00:23:50.870963+0000","last_fullsized":"2024-09-11T00:23:50.870963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:18.427715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526613+0000","last_change":"2024-09-11T00:23:47.931967+0000","last_active":"2024-09-11T00:23:50.526613+0000","last_peered":"2024-09-11T00:23:50.526613+0000","last_clean":"2024-09-11T00:23:50.526613+0000","last_became_active":"2024-09-11T00:23:47.929613+0000","last_became_peered":"2024-09-11T00:23:47.929613+0000","last_unstale":"2024-09-11T00:23:50.526613+0000","last_undegraded":"2024-09-11T00:23:50.526613+0000","last_fullsized":"2024-09-11T00:23:50.526613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:07.537335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526168+0000","last_change":"2024-09-11T00:23:48.942082+0000","last_active":"2024-09-11T00:23:50.526168+0000","last_peered":"2024-09-11T00:23:50.526168+0000","last_clean":"2024-09-11T00:23:50.526168+0000","last_became_active":"2024-09-11T00:23:48.941719+0000","last_became_peered":"2024-09-11T00:23:48.941719+0000","last_unstale":"2024-09-11T00:23:50.526168+0000","last_undegraded":"2024-09-11T00:23:50.526168+0000","last_fullsized":"2024-09-11T00:23:50.526168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:12.862149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935272+0000","last_change":"2024-09-11T00:23:47.923106+0000","last_active":"2024-09-11T00:23:49.935272+0000","last_peered":"2024-09-11T00:23:49.935272+0000","last_clean":"2024-09-11T00:23:49.935272+0000","last_became_active":"2024-09-11T00:23:47.922184+0000","last_became_peered":"2024-09-11T00:23:47.922184+0000","last_unstale":"2024-09-11T00:23:49.935272+0000","last_undegraded":"2024-09-11T00:23:49.935272+0000","last_fullsized":"2024-09-11T00:23:49.935272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:25.625230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871459+0000","last_change":"2024-09-11T00:23:48.944533+0000","last_active":"2024-09-11T00:23:50.871459+0000","last_peered":"2024-09-11T00:23:50.871459+0000","last_clean":"2024-09-11T00:23:50.871459+0000","last_became_active":"2024-09-11T00:23:48.943682+0000","last_became_peered":"2024-09-11T00:23:48.943682+0000","last_unstale":"2024-09-11T00:23:50.871459+0000","last_undegraded":"2024-09-11T00:23:50.871459+0000","last_fullsized":"2024-09-11T00:23:50.871459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:30.501339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870124+0000","last_change":"2024-09-11T00:23:47.927380+0000","last_active":"2024-09-11T00:23:50.870124+0000","last_peered":"2024-09-11T00:23:50.870124+0000","last_clean":"2024-09-11T00:23:50.870124+0000","last_became_active":"2024-09-11T00:23:47.926325+0000","last_became_peered":"2024-09-11T00:23:47.926325+0000","last_unstale":"2024-09-11T00:23:50.870124+0000","last_undegraded":"2024-09-11T00:23:50.870124+0000","last_fullsized":"2024-09-11T00:23:50.870124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:17.848252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871625+0000","last_change":"2024-09-11T00:23:48.926985+0000","last_active":"2024-09-11T00:23:50.871625+0000","last_peered":"2024-09-11T00:23:50.871625+0000","last_clean":"2024-09-11T00:23:50.871625+0000","last_became_active":"2024-09-11T00:23:48.926337+0000","last_became_peered":"2024-09-11T00:23:48.926337+0000","last_unstale":"2024-09-11T00:23:50.871625+0000","last_undegraded":"2024-09-11T00:23:50.871625+0000","last_fullsized":"2024-09-11T00:23:50.871625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:32.096363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713565+0000","last_change":"2024-09-11T00:23:47.923036+0000","last_active":"2024-09-11T00:23:50.713565+0000","last_peered":"2024-09-11T00:23:50.713565+0000","last_clean":"2024-09-11T00:23:50.713565+0000","last_became_active":"2024-09-11T00:23:47.921195+0000","last_became_peered":"2024-09-11T00:23:47.921195+0000","last_unstale":"2024-09-11T00:23:50.713565+0000","last_undegraded":"2024-09-11T00:23:50.713565+0000","last_fullsized":"2024-09-11T00:23:50.713565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:14:45.347474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871089+0000","last_change":"2024-09-11T00:23:48.943396+0000","last_active":"2024-09-11T00:23:50.871089+0000","last_peered":"2024-09-11T00:23:50.871089+0000","last_clean":"2024-09-11T00:23:50.871089+0000","last_became_active":"2024-09-11T00:23:48.943075+0000","last_became_peered":"2024-09-11T00:23:48.943075+0000","last_unstale":"2024-09-11T00:23:50.871089+0000","last_undegraded":"2024-09-11T00:23:50.871089+0000","last_fullsized":"2024-09-11T00:23:50.871089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:52.627600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936327+0000","last_change":"2024-09-11T00:23:47.927064+0000","last_active":"2024-09-11T00:23:49.936327+0000","last_peered":"2024-09-11T00:23:49.936327+0000","last_clean":"2024-09-11T00:23:49.936327+0000","last_became_active":"2024-09-11T00:23:47.926712+0000","last_became_peered":"2024-09-11T00:23:47.926712+0000","last_unstale":"2024-09-11T00:23:49.936327+0000","last_undegraded":"2024-09-11T00:23:49.936327+0000","last_fullsized":"2024-09-11T00:23:49.936327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:04.442035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871836+0000","last_change":"2024-09-11T00:23:48.944697+0000","last_active":"2024-09-11T00:23:50.871836+0000","last_peered":"2024-09-11T00:23:50.871836+0000","last_clean":"2024-09-11T00:23:50.871836+0000","last_became_active":"2024-09-11T00:23:48.944401+0000","last_became_peered":"2024-09-11T00:23:48.944401+0000","last_unstale":"2024-09-11T00:23:50.871836+0000","last_undegraded":"2024-09-11T00:23:50.871836+0000","last_fullsized":"2024-09-11T00:23:50.871836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:37.819167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713804+0000","last_change":"2024-09-11T00:23:47.925285+0000","last_active":"2024-09-11T00:23:50.713804+0000","last_peered":"2024-09-11T00:23:50.713804+0000","last_clean":"2024-09-11T00:23:50.713804+0000","last_became_active":"2024-09-11T00:23:47.923814+0000","last_became_peered":"2024-09-11T00:23:47.923814+0000","last_unstale":"2024-09-11T00:23:50.713804+0000","last_undegraded":"2024-09-11T00:23:50.713804+0000","last_fullsized":"2024-09-11T00:23:50.713804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:05.769710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.872231+0000","last_change":"2024-09-11T00:23:48.943572+0000","last_active":"2024-09-11T00:23:50.872231+0000","last_peered":"2024-09-11T00:23:50.872231+0000","last_clean":"2024-09-11T00:23:50.872231+0000","last_became_active":"2024-09-11T00:23:48.943332+0000","last_became_peered":"2024-09-11T00:23:48.943332+0000","last_unstale":"2024-09-11T00:23:50.872231+0000","last_undegraded":"2024-09-11T00:23:50.872231+0000","last_fullsized":"2024-09-11T00:23:50.872231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:27.017230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933857+0000","last_change":"2024-09-11T00:23:47.916785+0000","last_active":"2024-09-11T00:23:49.933857+0000","last_peered":"2024-09-11T00:23:49.933857+0000","last_clean":"2024-09-11T00:23:49.933857+0000","last_became_active":"2024-09-11T00:23:47.916497+0000","last_became_peered":"2024-09-11T00:23:47.916497+0000","last_unstale":"2024-09-11T00:23:49.933857+0000","last_undegraded":"2024-09-11T00:23:49.933857+0000","last_fullsized":"2024-09-11T00:23:49.933857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:05.872152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935575+0000","last_change":"2024-09-11T00:23:48.930287+0000","last_active":"2024-09-11T00:23:49.935575+0000","last_peered":"2024-09-11T00:23:49.935575+0000","last_clean":"2024-09-11T00:23:49.935575+0000","last_became_active":"2024-09-11T00:23:48.929725+0000","last_became_peered":"2024-09-11T00:23:48.929725+0000","last_unstale":"2024-09-11T00:23:49.935575+0000","last_undegraded":"2024-09-11T00:23:49.935575+0000","last_fullsized":"2024-09-11T00:23:49.935575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:27.758680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713703+0000","last_change":"2024-09-11T00:23:47.921536+0000","last_active":"2024-09-11T00:23:50.713703+0000","last_peered":"2024-09-11T00:23:50.713703+0000","last_clean":"2024-09-11T00:23:50.713703+0000","last_became_active":"2024-09-11T00:23:47.921189+0000","last_became_peered":"2024-09-11T00:23:47.921189+0000","last_unstale":"2024-09-11T00:23:50.713703+0000","last_undegraded":"2024-09-11T00:23:50.713703+0000","last_fullsized":"2024-09-11T00:23:50.713703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:00.103061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870954+0000","last_change":"2024-09-11T00:23:48.938303+0000","last_active":"2024-09-11T00:23:50.870954+0000","last_peered":"2024-09-11T00:23:50.870954+0000","last_clean":"2024-09-11T00:23:50.870954+0000","last_became_active":"2024-09-11T00:23:48.938020+0000","last_became_peered":"2024-09-11T00:23:48.938020+0000","last_unstale":"2024-09-11T00:23:50.870954+0000","last_undegraded":"2024-09-11T00:23:50.870954+0000","last_fullsized":"2024-09-11T00:23:50.870954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:27:37.871843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870713+0000","last_change":"2024-09-11T00:23:38.923873+0000","last_active":"2024-09-11T00:23:50.870713+0000","last_peered":"2024-09-11T00:23:50.870713+0000","last_clean":"2024-09-11T00:23:50.870713+0000","last_became_active":"2024-09-11T00:23:38.920629+0000","last_became_peered":"2024-09-11T00:23:38.920629+0000","last_unstale":"2024-09-11T00:23:50.870713+0000","last_undegraded":"2024-09-11T00:23:50.870713+0000","last_fullsized":"2024-09-11T00:23:50.870713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_clean_scrub_stamp":"2024-09-11T00:23:37.844553+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.533941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934753+0000","last_change":"2024-09-11T00:23:47.922903+0000","last_active":"2024-09-11T00:23:49.934753+0000","last_peered":"2024-09-11T00:23:49.934753+0000","last_clean":"2024-09-11T00:23:49.934753+0000","last_became_active":"2024-09-11T00:23:47.921860+0000","last_became_peered":"2024-09-11T00:23:47.921860+0000","last_unstale":"2024-09-11T00:23:49.934753+0000","last_undegraded":"2024-09-11T00:23:49.934753+0000","last_fullsized":"2024-09-11T00:23:49.934753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:36.398079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869697+0000","last_change":"2024-09-11T00:23:48.943469+0000","last_active":"2024-09-11T00:23:50.869697+0000","last_peered":"2024-09-11T00:23:50.869697+0000","last_clean":"2024-09-11T00:23:50.869697+0000","last_became_active":"2024-09-11T00:23:48.939041+0000","last_became_peered":"2024-09-11T00:23:48.939041+0000","last_unstale":"2024-09-11T00:23:50.869697+0000","last_undegraded":"2024-09-11T00:23:50.869697+0000","last_fullsized":"2024-09-11T00:23:50.869697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:57.017486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870591+0000","last_change":"2024-09-11T00:23:47.938200+0000","last_active":"2024-09-11T00:23:50.870591+0000","last_peered":"2024-09-11T00:23:50.870591+0000","last_clean":"2024-09-11T00:23:50.870591+0000","last_became_active":"2024-09-11T00:23:47.937671+0000","last_became_peered":"2024-09-11T00:23:47.937671+0000","last_unstale":"2024-09-11T00:23:50.870591+0000","last_undegraded":"2024-09-11T00:23:50.870591+0000","last_fullsized":"2024-09-11T00:23:50.870591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:21.182195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526116+0000","last_change":"2024-09-11T00:23:48.933693+0000","last_active":"2024-09-11T00:23:50.526116+0000","last_peered":"2024-09-11T00:23:50.526116+0000","last_clean":"2024-09-11T00:23:50.526116+0000","last_became_active":"2024-09-11T00:23:48.933355+0000","last_became_peered":"2024-09-11T00:23:48.933355+0000","last_unstale":"2024-09-11T00:23:50.526116+0000","last_undegraded":"2024-09-11T00:23:50.526116+0000","last_fullsized":"2024-09-11T00:23:50.526116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:26.797108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713671+0000","last_change":"2024-09-11T00:23:47.929198+0000","last_active":"2024-09-11T00:23:50.713671+0000","last_peered":"2024-09-11T00:23:50.713671+0000","last_clean":"2024-09-11T00:23:50.713671+0000","last_became_active":"2024-09-11T00:23:47.928882+0000","last_became_peered":"2024-09-11T00:23:47.928882+0000","last_unstale":"2024-09-11T00:23:50.713671+0000","last_undegraded":"2024-09-11T00:23:50.713671+0000","last_fullsized":"2024-09-11T00:23:50.713671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:17.848252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933279+0000","last_change":"2024-09-11T00:23:48.932829+0000","last_active":"2024-09-11T00:23:49.933279+0000","last_peered":"2024-09-11T00:23:49.933279+0000","last_clean":"2024-09-11T00:23:49.933279+0000","last_became_active":"2024-09-11T00:23:48.932546+0000","last_became_peered":"2024-09-11T00:23:48.932546+0000","last_unstale":"2024-09-11T00:23:49.933279+0000","last_undegraded":"2024-09-11T00:23:49.933279+0000","last_fullsized":"2024-09-11T00:23:49.933279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:23.709720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935373+0000","last_change":"2024-09-11T00:23:47.917787+0000","last_active":"2024-09-11T00:23:49.935373+0000","last_peered":"2024-09-11T00:23:49.935373+0000","last_clean":"2024-09-11T00:23:49.935373+0000","last_became_active":"2024-09-11T00:23:47.916390+0000","last_became_peered":"2024-09-11T00:23:47.916390+0000","last_unstale":"2024-09-11T00:23:49.935373+0000","last_undegraded":"2024-09-11T00:23:49.935373+0000","last_fullsized":"2024-09-11T00:23:49.935373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:21.182195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935541+0000","last_change":"2024-09-11T00:23:48.936767+0000","last_active":"2024-09-11T00:23:49.935541+0000","last_peered":"2024-09-11T00:23:49.935541+0000","last_clean":"2024-09-11T00:23:49.935541+0000","last_became_active":"2024-09-11T00:23:48.936263+0000","last_became_peered":"2024-09-11T00:23:48.936263+0000","last_unstale":"2024-09-11T00:23:49.935541+0000","last_undegraded":"2024-09-11T00:23:49.935541+0000","last_fullsized":"2024-09-11T00:23:49.935541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:28.841981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933635+0000","last_change":"2024-09-11T00:23:47.930283+0000","last_active":"2024-09-11T00:23:49.933635+0000","last_peered":"2024-09-11T00:23:49.933635+0000","last_clean":"2024-09-11T00:23:49.933635+0000","last_became_active":"2024-09-11T00:23:47.930008+0000","last_became_peered":"2024-09-11T00:23:47.930008+0000","last_unstale":"2024-09-11T00:23:49.933635+0000","last_undegraded":"2024-09-11T00:23:49.933635+0000","last_fullsized":"2024-09-11T00:23:49.933635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:27.835276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935676+0000","last_change":"2024-09-11T00:23:48.929269+0000","last_active":"2024-09-11T00:23:49.935676+0000","last_peered":"2024-09-11T00:23:49.935676+0000","last_clean":"2024-09-11T00:23:49.935676+0000","last_became_active":"2024-09-11T00:23:48.928947+0000","last_became_peered":"2024-09-11T00:23:48.928947+0000","last_unstale":"2024-09-11T00:23:49.935676+0000","last_undegraded":"2024-09-11T00:23:49.935676+0000","last_fullsized":"2024-09-11T00:23:49.935676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:31.745356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871434+0000","last_change":"2024-09-11T00:23:47.940851+0000","last_active":"2024-09-11T00:23:50.871434+0000","last_peered":"2024-09-11T00:23:50.871434+0000","last_clean":"2024-09-11T00:23:50.871434+0000","last_became_active":"2024-09-11T00:23:47.940667+0000","last_became_peered":"2024-09-11T00:23:47.940667+0000","last_unstale":"2024-09-11T00:23:50.871434+0000","last_undegraded":"2024-09-11T00:23:50.871434+0000","last_fullsized":"2024-09-11T00:23:50.871434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:06.334712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933539+0000","last_change":"2024-09-11T00:23:48.928214+0000","last_active":"2024-09-11T00:23:49.933539+0000","last_peered":"2024-09-11T00:23:49.933539+0000","last_clean":"2024-09-11T00:23:49.933539+0000","last_became_active":"2024-09-11T00:23:48.927947+0000","last_became_peered":"2024-09-11T00:23:48.927947+0000","last_unstale":"2024-09-11T00:23:49.933539+0000","last_undegraded":"2024-09-11T00:23:49.933539+0000","last_fullsized":"2024-09-11T00:23:49.933539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:08:27.071042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934052+0000","last_change":"2024-09-11T00:23:47.935782+0000","last_active":"2024-09-11T00:23:49.934052+0000","last_peered":"2024-09-11T00:23:49.934052+0000","last_clean":"2024-09-11T00:23:49.934052+0000","last_became_active":"2024-09-11T00:23:47.935518+0000","last_became_peered":"2024-09-11T00:23:47.935518+0000","last_unstale":"2024-09-11T00:23:49.934052+0000","last_undegraded":"2024-09-11T00:23:49.934052+0000","last_fullsized":"2024-09-11T00:23:49.934052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:59.939503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870137+0000","last_change":"2024-09-11T00:23:48.942240+0000","last_active":"2024-09-11T00:23:50.870137+0000","last_peered":"2024-09-11T00:23:50.870137+0000","last_clean":"2024-09-11T00:23:50.870137+0000","last_became_active":"2024-09-11T00:23:48.941950+0000","last_became_peered":"2024-09-11T00:23:48.941950+0000","last_unstale":"2024-09-11T00:23:50.870137+0000","last_undegraded":"2024-09-11T00:23:50.870137+0000","last_fullsized":"2024-09-11T00:23:50.870137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:05.378796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871100+0000","last_change":"2024-09-11T00:23:47.940231+0000","last_active":"2024-09-11T00:23:50.871100+0000","last_peered":"2024-09-11T00:23:50.871100+0000","last_clean":"2024-09-11T00:23:50.871100+0000","last_became_active":"2024-09-11T00:23:47.939887+0000","last_became_peered":"2024-09-11T00:23:47.939887+0000","last_unstale":"2024-09-11T00:23:50.871100+0000","last_undegraded":"2024-09-11T00:23:50.871100+0000","last_fullsized":"2024-09-11T00:23:50.871100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:40.413211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526432+0000","last_change":"2024-09-11T00:23:48.948747+0000","last_active":"2024-09-11T00:23:50.526432+0000","last_peered":"2024-09-11T00:23:50.526432+0000","last_clean":"2024-09-11T00:23:50.526432+0000","last_became_active":"2024-09-11T00:23:48.948439+0000","last_became_peered":"2024-09-11T00:23:48.948439+0000","last_unstale":"2024-09-11T00:23:50.526432+0000","last_undegraded":"2024-09-11T00:23:50.526432+0000","last_fullsized":"2024-09-11T00:23:50.526432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:59.951812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870404+0000","last_change":"2024-09-11T00:23:47.938518+0000","last_active":"2024-09-11T00:23:50.870404+0000","last_peered":"2024-09-11T00:23:50.870404+0000","last_clean":"2024-09-11T00:23:50.870404+0000","last_became_active":"2024-09-11T00:23:47.937928+0000","last_became_peered":"2024-09-11T00:23:47.937928+0000","last_unstale":"2024-09-11T00:23:50.870404+0000","last_undegraded":"2024-09-11T00:23:50.870404+0000","last_fullsized":"2024-09-11T00:23:50.870404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:25.625230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934570+0000","last_change":"2024-09-11T00:23:48.929011+0000","last_active":"2024-09-11T00:23:49.934570+0000","last_peered":"2024-09-11T00:23:49.934570+0000","last_clean":"2024-09-11T00:23:49.934570+0000","last_became_active":"2024-09-11T00:23:48.927838+0000","last_became_peered":"2024-09-11T00:23:48.927838+0000","last_unstale":"2024-09-11T00:23:49.934570+0000","last_undegraded":"2024-09-11T00:23:49.934570+0000","last_fullsized":"2024-09-11T00:23:49.934570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:01.109766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933263+0000","last_change":"2024-09-11T00:23:47.930702+0000","last_active":"2024-09-11T00:23:49.933263+0000","last_peered":"2024-09-11T00:23:49.933263+0000","last_clean":"2024-09-11T00:23:49.933263+0000","last_became_active":"2024-09-11T00:23:47.930044+0000","last_became_peered":"2024-09-11T00:23:47.930044+0000","last_unstale":"2024-09-11T00:23:49.933263+0000","last_undegraded":"2024-09-11T00:23:49.933263+0000","last_fullsized":"2024-09-11T00:23:49.933263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:05.769710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869927+0000","last_change":"2024-09-11T00:23:48.932964+0000","last_active":"2024-09-11T00:23:50.869927+0000","last_peered":"2024-09-11T00:23:50.869927+0000","last_clean":"2024-09-11T00:23:50.869927+0000","last_became_active":"2024-09-11T00:23:48.932262+0000","last_became_peered":"2024-09-11T00:23:48.932262+0000","last_unstale":"2024-09-11T00:23:50.869927+0000","last_undegraded":"2024-09-11T00:23:50.869927+0000","last_fullsized":"2024-09-11T00:23:50.869927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:50.142533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933446+0000","last_change":"2024-09-11T00:23:47.924671+0000","last_active":"2024-09-11T00:23:49.933446+0000","last_peered":"2024-09-11T00:23:49.933446+0000","last_clean":"2024-09-11T00:23:49.933446+0000","last_became_active":"2024-09-11T00:23:47.924383+0000","last_became_peered":"2024-09-11T00:23:47.924383+0000","last_unstale":"2024-09-11T00:23:49.933446+0000","last_undegraded":"2024-09-11T00:23:49.933446+0000","last_fullsized":"2024-09-11T00:23:49.933446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:00.103061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869954+0000","last_change":"2024-09-11T00:23:48.949725+0000","last_active":"2024-09-11T00:23:50.869954+0000","last_peered":"2024-09-11T00:23:50.869954+0000","last_clean":"2024-09-11T00:23:50.869954+0000","last_became_active":"2024-09-11T00:23:48.949445+0000","last_became_peered":"2024-09-11T00:23:48.949445+0000","last_unstale":"2024-09-11T00:23:50.869954+0000","last_undegraded":"2024-09-11T00:23:50.869954+0000","last_fullsized":"2024-09-11T00:23:50.869954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:32.096363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871560+0000","last_change":"2024-09-11T00:23:47.940381+0000","last_active":"2024-09-11T00:23:50.871560+0000","last_peered":"2024-09-11T00:23:50.871560+0000","last_clean":"2024-09-11T00:23:50.871560+0000","last_became_active":"2024-09-11T00:23:47.940030+0000","last_became_peered":"2024-09-11T00:23:47.940030+0000","last_unstale":"2024-09-11T00:23:50.871560+0000","last_undegraded":"2024-09-11T00:23:50.871560+0000","last_fullsized":"2024-09-11T00:23:50.871560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:49.214733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870694+0000","last_change":"2024-09-11T00:23:48.934776+0000","last_active":"2024-09-11T00:23:50.870694+0000","last_peered":"2024-09-11T00:23:50.870694+0000","last_clean":"2024-09-11T00:23:50.870694+0000","last_became_active":"2024-09-11T00:23:48.925601+0000","last_became_peered":"2024-09-11T00:23:48.925601+0000","last_unstale":"2024-09-11T00:23:50.870694+0000","last_undegraded":"2024-09-11T00:23:50.870694+0000","last_fullsized":"2024-09-11T00:23:50.870694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:23.709720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935472+0000","last_change":"2024-09-11T00:23:48.921538+0000","last_active":"2024-09-11T00:23:49.935472+0000","last_peered":"2024-09-11T00:23:49.935472+0000","last_clean":"2024-09-11T00:23:49.935472+0000","last_became_active":"2024-09-11T00:23:48.921162+0000","last_became_peered":"2024-09-11T00:23:48.921162+0000","last_unstale":"2024-09-11T00:23:49.935472+0000","last_undegraded":"2024-09-11T00:23:49.935472+0000","last_fullsized":"2024-09-11T00:23:49.935472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:14:08.841886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871337+0000","last_change":"2024-09-11T00:23:47.938661+0000","last_active":"2024-09-11T00:23:50.871337+0000","last_peered":"2024-09-11T00:23:50.871337+0000","last_clean":"2024-09-11T00:23:50.871337+0000","last_became_active":"2024-09-11T00:23:47.937858+0000","last_became_peered":"2024-09-11T00:23:47.937858+0000","last_unstale":"2024-09-11T00:23:50.871337+0000","last_undegraded":"2024-09-11T00:23:50.871337+0000","last_fullsized":"2024-09-11T00:23:50.871337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:34.793911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935205+0000","last_change":"2024-09-11T00:23:48.916507+0000","last_active":"2024-09-11T00:23:49.935205+0000","last_peered":"2024-09-11T00:23:49.935205+0000","last_clean":"2024-09-11T00:23:49.935205+0000","last_became_active":"2024-09-11T00:23:48.916168+0000","last_became_peered":"2024-09-11T00:23:48.916168+0000","last_unstale":"2024-09-11T00:23:49.935205+0000","last_undegraded":"2024-09-11T00:23:49.935205+0000","last_fullsized":"2024-09-11T00:23:49.935205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:53.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871007+0000","last_change":"2024-09-11T00:23:47.941406+0000","last_active":"2024-09-11T00:23:50.871007+0000","last_peered":"2024-09-11T00:23:50.871007+0000","last_clean":"2024-09-11T00:23:50.871007+0000","last_became_active":"2024-09-11T00:23:47.940051+0000","last_became_peered":"2024-09-11T00:23:47.940051+0000","last_unstale":"2024-09-11T00:23:50.871007+0000","last_undegraded":"2024-09-11T00:23:50.871007+0000","last_fullsized":"2024-09-11T00:23:50.871007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:02.075049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526442+0000","last_change":"2024-09-11T00:23:48.925648+0000","last_active":"2024-09-11T00:23:50.526442+0000","last_peered":"2024-09-11T00:23:50.526442+0000","last_clean":"2024-09-11T00:23:50.526442+0000","last_became_active":"2024-09-11T00:23:48.924442+0000","last_became_peered":"2024-09-11T00:23:48.924442+0000","last_unstale":"2024-09-11T00:23:50.526442+0000","last_undegraded":"2024-09-11T00:23:50.526442+0000","last_fullsized":"2024-09-11T00:23:50.526442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:54.299102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870045+0000","last_change":"2024-09-11T00:23:47.932359+0000","last_active":"2024-09-11T00:23:50.870045+0000","last_peered":"2024-09-11T00:23:50.870045+0000","last_clean":"2024-09-11T00:23:50.870045+0000","last_became_active":"2024-09-11T00:23:47.932075+0000","last_became_peered":"2024-09-11T00:23:47.932075+0000","last_unstale":"2024-09-11T00:23:50.870045+0000","last_undegraded":"2024-09-11T00:23:50.870045+0000","last_fullsized":"2024-09-11T00:23:50.870045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:17.848252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870089+0000","last_change":"2024-09-11T00:23:48.939724+0000","last_active":"2024-09-11T00:23:50.870089+0000","last_peered":"2024-09-11T00:23:50.870089+0000","last_clean":"2024-09-11T00:23:50.870089+0000","last_became_active":"2024-09-11T00:23:48.939505+0000","last_became_peered":"2024-09-11T00:23:48.939505+0000","last_unstale":"2024-09-11T00:23:50.870089+0000","last_undegraded":"2024-09-11T00:23:50.870089+0000","last_fullsized":"2024-09-11T00:23:50.870089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:19.018125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526569+0000","last_change":"2024-09-11T00:23:47.940123+0000","last_active":"2024-09-11T00:23:50.526569+0000","last_peered":"2024-09-11T00:23:50.526569+0000","last_clean":"2024-09-11T00:23:50.526569+0000","last_became_active":"2024-09-11T00:23:47.939901+0000","last_became_peered":"2024-09-11T00:23:47.939901+0000","last_unstale":"2024-09-11T00:23:50.526569+0000","last_undegraded":"2024-09-11T00:23:50.526569+0000","last_fullsized":"2024-09-11T00:23:50.526569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:45.637790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":667234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":76410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":667290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:24:03.438 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:24:03.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.633+0000 7fb070000640 1 -- 172.21.15.40:0/496288226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0680cd780 msgr2=0x7fb0680cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:03.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.633+0000 7fb070000640 1 --2- 172.21.15.40:0/496288226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0680cd780 0x7fb0680cdbb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb060005fd0 tx=0x7fb06002aa90 comp rx=0 tx=0).stop 2024-09-11T00:24:03.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.633+0000 7fb070000640 1 -- 172.21.15.40:0/496288226 shutdown_connections 2024-09-11T00:24:03.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.633+0000 7fb070000640 1 --2- 172.21.15.40:0/496288226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0680cd780 0x7fb0680cdbb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:03.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.633+0000 7fb070000640 1 --2- 172.21.15.40:0/496288226 >> v2:172.21.15.175:3300/0 conn(0x7fb06815ec70 0x7fb06815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:03.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.633+0000 7fb070000640 1 -- 172.21.15.40:0/496288226 >> 172.21.15.40:0/496288226 conn(0x7fb0680cfbb0 msgr2=0x7fb0680cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:03.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.633+0000 7fb070000640 1 -- 172.21.15.40:0/496288226 shutdown_connections 2024-09-11T00:24:03.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.633+0000 7fb070000640 1 -- 172.21.15.40:0/496288226 wait complete. 2024-09-11T00:24:03.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.635+0000 7fb070000640 1 Processor -- start 2024-09-11T00:24:03.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.635+0000 7fb070000640 1 -- start start 2024-09-11T00:24:03.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.636+0000 7fb070000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0680cd780 0x7fb0680aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:03.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.636+0000 7fb070000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb06815ec70 0x7fb068157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:03.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.636+0000 7fb070000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06815f050 0x7fb068157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:03.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.636+0000 7fb070000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb0681681d0 con 0x7fb06815f050 2024-09-11T00:24:03.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.636+0000 7fb070000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb068168050 con 0x7fb06815ec70 2024-09-11T00:24:03.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.636+0000 7fb070000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb068168350 con 0x7fb0680cd780 2024-09-11T00:24:03.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.636+0000 7fb06e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06815f050 0x7fb068157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:03.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.636+0000 7fb06e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06815f050 0x7fb068157e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39792/0 (socket says 172.21.15.40:39792) 2024-09-11T00:24:03.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.636+0000 7fb06e000640 1 -- 172.21.15.40:0/2952144778 learned_addr learned my addr 172.21.15.40:0/2952144778 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:03.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.636+0000 7fb06cc00640 1 --2- 172.21.15.40:0/2952144778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb06815ec70 0x7fb068157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:03.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.636+0000 7fb06d600640 1 --2- 172.21.15.40:0/2952144778 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0680cd780 0x7fb0680aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:03.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.637+0000 7fb06e000640 1 -- 172.21.15.40:0/2952144778 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0680cd780 msgr2=0x7fb0680aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:03.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.637+0000 7fb06e000640 1 --2- 172.21.15.40:0/2952144778 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0680cd780 0x7fb0680aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:03.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.637+0000 7fb06e000640 1 -- 172.21.15.40:0/2952144778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb06815ec70 msgr2=0x7fb068157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:03.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.637+0000 7fb06e000640 1 --2- 172.21.15.40:0/2952144778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb06815ec70 0x7fb068157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:03.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.637+0000 7fb06e000640 1 -- 172.21.15.40:0/2952144778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0681583c0 con 0x7fb06815f050 2024-09-11T00:24:03.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.637+0000 7fb06e000640 1 --2- 172.21.15.40:0/2952144778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06815f050 0x7fb068157e80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb060006010 tx=0x7fb060003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:03.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.637+0000 7fb065600640 1 -- 172.21.15.40:0/2952144778 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060046070 con 0x7fb06815f050 2024-09-11T00:24:03.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.637+0000 7fb065600640 1 -- 172.21.15.40:0/2952144778 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb060004040 con 0x7fb06815f050 2024-09-11T00:24:03.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.637+0000 7fb070000640 1 -- 172.21.15.40:0/2952144778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0680b04e0 con 0x7fb06815f050 2024-09-11T00:24:03.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.637+0000 7fb065600640 1 -- 172.21.15.40:0/2952144778 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060004430 con 0x7fb06815f050 2024-09-11T00:24:03.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.637+0000 7fb070000640 1 -- 172.21.15.40:0/2952144778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb068156b20 con 0x7fb06815f050 2024-09-11T00:24:03.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.639+0000 7fb070000640 1 -- 172.21.15.40:0/2952144778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0680cdbb0 con 0x7fb06815f050 2024-09-11T00:24:03.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.640+0000 7fb065600640 1 -- 172.21.15.40:0/2952144778 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb0600045d0 con 0x7fb06815f050 2024-09-11T00:24:03.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.640+0000 7fb065600640 1 --2- 172.21.15.40:0/2952144778 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb048077f70 0x7fb04807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:03.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.641+0000 7fb065600640 1 -- 172.21.15.40:0/2952144778 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb0600bae20 con 0x7fb06815f050 2024-09-11T00:24:03.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.641+0000 7fb06d600640 1 --2- 172.21.15.40:0/2952144778 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb048077f70 0x7fb04807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:03.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.642+0000 7fb06d600640 1 --2- 172.21.15.40:0/2952144778 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb048077f70 0x7fb04807a430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009bd0 tx=0x7fb05c005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:03.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.644+0000 7fb065600640 1 -- 172.21.15.40:0/2952144778 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb060032030 con 0x7fb06815f050 2024-09-11T00:24:03.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.835+0000 7fb070000640 1 -- 172.21.15.40:0/2952144778 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb0680b5b30 con 0x7fb048077f70 2024-09-11T00:24:03.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.840+0000 7fb065600640 1 -- 172.21.15.40:0/2952144778 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7fb0680b5b30 con 0x7fb048077f70 2024-09-11T00:24:03.844 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:03.845 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T00:24:03.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.844+0000 7fb070000640 1 -- 172.21.15.40:0/2952144778 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb048077f70 msgr2=0x7fb04807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:03.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.844+0000 7fb070000640 1 --2- 172.21.15.40:0/2952144778 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb048077f70 0x7fb04807a430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009bd0 tx=0x7fb05c005f90 comp rx=0 tx=0).stop 2024-09-11T00:24:03.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.844+0000 7fb070000640 1 -- 172.21.15.40:0/2952144778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06815f050 msgr2=0x7fb068157e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:03.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.844+0000 7fb070000640 1 --2- 172.21.15.40:0/2952144778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06815f050 0x7fb068157e80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb060006010 tx=0x7fb060003ce0 comp rx=0 tx=0).stop 2024-09-11T00:24:03.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.844+0000 7fb070000640 1 -- 172.21.15.40:0/2952144778 shutdown_connections 2024-09-11T00:24:03.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.844+0000 7fb070000640 1 --2- 172.21.15.40:0/2952144778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06815f050 0x7fb068157e80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:03.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.844+0000 7fb070000640 1 --2- 172.21.15.40:0/2952144778 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb048077f70 0x7fb04807a430 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:03.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.844+0000 7fb070000640 1 --2- 172.21.15.40:0/2952144778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb06815ec70 0x7fb068157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:03.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.844+0000 7fb070000640 1 --2- 172.21.15.40:0/2952144778 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0680cd780 0x7fb0680aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:03.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.844+0000 7fb070000640 1 -- 172.21.15.40:0/2952144778 >> 172.21.15.40:0/2952144778 conn(0x7fb0680cfbb0 msgr2=0x7fb06806f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:03.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.844+0000 7fb070000640 1 -- 172.21.15.40:0/2952144778 shutdown_connections 2024-09-11T00:24:03.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:03.844+0000 7fb070000640 1 -- 172.21.15.40:0/2952144778 wait complete. 2024-09-11T00:24:03.861 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-11T00:24:03.779561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219184,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755536,"statfs":{"total":773094113280,"available":772869668864,"internally_reserved":0,"allocated":3022848,"data_stored":1795828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003571"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.872004+0000","last_change":"2024-09-11T00:23:48.948893+0000","last_active":"2024-09-11T00:23:50.872004+0000","last_peered":"2024-09-11T00:23:50.872004+0000","last_clean":"2024-09-11T00:23:50.872004+0000","last_became_active":"2024-09-11T00:23:48.948539+0000","last_became_peered":"2024-09-11T00:23:48.948539+0000","last_unstale":"2024-09-11T00:23:50.872004+0000","last_undegraded":"2024-09-11T00:23:50.872004+0000","last_fullsized":"2024-09-11T00:23:50.872004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:16.991662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934001+0000","last_change":"2024-09-11T00:23:48.937342+0000","last_active":"2024-09-11T00:23:49.934001+0000","last_peered":"2024-09-11T00:23:49.934001+0000","last_clean":"2024-09-11T00:23:49.934001+0000","last_became_active":"2024-09-11T00:23:48.936595+0000","last_became_peered":"2024-09-11T00:23:48.936595+0000","last_unstale":"2024-09-11T00:23:49.934001+0000","last_undegraded":"2024-09-11T00:23:49.934001+0000","last_fullsized":"2024-09-11T00:23:49.934001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:32.096363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526446+0000","last_change":"2024-09-11T00:23:48.937798+0000","last_active":"2024-09-11T00:23:50.526446+0000","last_peered":"2024-09-11T00:23:50.526446+0000","last_clean":"2024-09-11T00:23:50.526446+0000","last_became_active":"2024-09-11T00:23:48.937479+0000","last_became_peered":"2024-09-11T00:23:48.937479+0000","last_unstale":"2024-09-11T00:23:50.526446+0000","last_undegraded":"2024-09-11T00:23:50.526446+0000","last_fullsized":"2024-09-11T00:23:50.526446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:27.574913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935177+0000","last_change":"2024-09-11T00:23:48.931523+0000","last_active":"2024-09-11T00:23:49.935177+0000","last_peered":"2024-09-11T00:23:49.935177+0000","last_clean":"2024-09-11T00:23:49.935177+0000","last_became_active":"2024-09-11T00:23:48.930038+0000","last_became_peered":"2024-09-11T00:23:48.930038+0000","last_unstale":"2024-09-11T00:23:49.935177+0000","last_undegraded":"2024-09-11T00:23:49.935177+0000","last_fullsized":"2024-09-11T00:23:49.935177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:37.999694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871474+0000","last_change":"2024-09-11T00:23:48.936786+0000","last_active":"2024-09-11T00:23:50.871474+0000","last_peered":"2024-09-11T00:23:50.871474+0000","last_clean":"2024-09-11T00:23:50.871474+0000","last_became_active":"2024-09-11T00:23:48.936512+0000","last_became_peered":"2024-09-11T00:23:48.936512+0000","last_unstale":"2024-09-11T00:23:50.871474+0000","last_undegraded":"2024-09-11T00:23:50.871474+0000","last_fullsized":"2024-09-11T00:23:50.871474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:20.441191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934971+0000","last_change":"2024-09-11T00:23:48.935843+0000","last_active":"2024-09-11T00:23:49.934971+0000","last_peered":"2024-09-11T00:23:49.934971+0000","last_clean":"2024-09-11T00:23:49.934971+0000","last_became_active":"2024-09-11T00:23:48.935591+0000","last_became_peered":"2024-09-11T00:23:48.935591+0000","last_unstale":"2024-09-11T00:23:49.934971+0000","last_undegraded":"2024-09-11T00:23:49.934971+0000","last_fullsized":"2024-09-11T00:23:49.934971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:25.619010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870938+0000","last_change":"2024-09-11T00:23:48.939799+0000","last_active":"2024-09-11T00:23:50.870938+0000","last_peered":"2024-09-11T00:23:50.870938+0000","last_clean":"2024-09-11T00:23:50.870938+0000","last_became_active":"2024-09-11T00:23:48.939495+0000","last_became_peered":"2024-09-11T00:23:48.939495+0000","last_unstale":"2024-09-11T00:23:50.870938+0000","last_undegraded":"2024-09-11T00:23:50.870938+0000","last_fullsized":"2024-09-11T00:23:50.870938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:13.522317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869563+0000","last_change":"2024-09-11T00:23:48.933813+0000","last_active":"2024-09-11T00:23:50.869563+0000","last_peered":"2024-09-11T00:23:50.869563+0000","last_clean":"2024-09-11T00:23:50.869563+0000","last_became_active":"2024-09-11T00:23:48.932681+0000","last_became_peered":"2024-09-11T00:23:48.932681+0000","last_unstale":"2024-09-11T00:23:50.869563+0000","last_undegraded":"2024-09-11T00:23:50.869563+0000","last_fullsized":"2024-09-11T00:23:50.869563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:49.141326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.872030+0000","last_change":"2024-09-11T00:23:48.943035+0000","last_active":"2024-09-11T00:23:50.872030+0000","last_peered":"2024-09-11T00:23:50.872030+0000","last_clean":"2024-09-11T00:23:50.872030+0000","last_became_active":"2024-09-11T00:23:48.942299+0000","last_became_peered":"2024-09-11T00:23:48.942299+0000","last_unstale":"2024-09-11T00:23:50.872030+0000","last_undegraded":"2024-09-11T00:23:50.872030+0000","last_fullsized":"2024-09-11T00:23:50.872030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:04.169658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870722+0000","last_change":"2024-09-11T00:23:48.923914+0000","last_active":"2024-09-11T00:23:50.870722+0000","last_peered":"2024-09-11T00:23:50.870722+0000","last_clean":"2024-09-11T00:23:50.870722+0000","last_became_active":"2024-09-11T00:23:48.923637+0000","last_became_peered":"2024-09-11T00:23:48.923637+0000","last_unstale":"2024-09-11T00:23:50.870722+0000","last_undegraded":"2024-09-11T00:23:50.870722+0000","last_fullsized":"2024-09-11T00:23:50.870722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:08:27.071042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870678+0000","last_change":"2024-09-11T00:23:48.924320+0000","last_active":"2024-09-11T00:23:50.870678+0000","last_peered":"2024-09-11T00:23:50.870678+0000","last_clean":"2024-09-11T00:23:50.870678+0000","last_became_active":"2024-09-11T00:23:48.923963+0000","last_became_peered":"2024-09-11T00:23:48.923963+0000","last_unstale":"2024-09-11T00:23:50.870678+0000","last_undegraded":"2024-09-11T00:23:50.870678+0000","last_fullsized":"2024-09-11T00:23:50.870678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:57.017486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936400+0000","last_change":"2024-09-11T00:23:48.926315+0000","last_active":"2024-09-11T00:23:49.936400+0000","last_peered":"2024-09-11T00:23:49.936400+0000","last_clean":"2024-09-11T00:23:49.936400+0000","last_became_active":"2024-09-11T00:23:48.926023+0000","last_became_peered":"2024-09-11T00:23:48.926023+0000","last_unstale":"2024-09-11T00:23:49.936400+0000","last_undegraded":"2024-09-11T00:23:49.936400+0000","last_fullsized":"2024-09-11T00:23:49.936400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:53:00.946208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869742+0000","last_change":"2024-09-11T00:23:48.940397+0000","last_active":"2024-09-11T00:23:50.869742+0000","last_peered":"2024-09-11T00:23:50.869742+0000","last_clean":"2024-09-11T00:23:50.869742+0000","last_became_active":"2024-09-11T00:23:48.940131+0000","last_became_peered":"2024-09-11T00:23:48.940131+0000","last_unstale":"2024-09-11T00:23:50.869742+0000","last_undegraded":"2024-09-11T00:23:50.869742+0000","last_fullsized":"2024-09-11T00:23:50.869742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:08:27.071042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526136+0000","last_change":"2024-09-11T00:23:48.934059+0000","last_active":"2024-09-11T00:23:50.526136+0000","last_peered":"2024-09-11T00:23:50.526136+0000","last_clean":"2024-09-11T00:23:50.526136+0000","last_became_active":"2024-09-11T00:23:48.931545+0000","last_became_peered":"2024-09-11T00:23:48.931545+0000","last_unstale":"2024-09-11T00:23:50.526136+0000","last_undegraded":"2024-09-11T00:23:50.526136+0000","last_fullsized":"2024-09-11T00:23:50.526136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:22.406899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933205+0000","last_change":"2024-09-11T00:23:48.917392+0000","last_active":"2024-09-11T00:23:49.933205+0000","last_peered":"2024-09-11T00:23:49.933205+0000","last_clean":"2024-09-11T00:23:49.933205+0000","last_became_active":"2024-09-11T00:23:48.917076+0000","last_became_peered":"2024-09-11T00:23:48.917076+0000","last_unstale":"2024-09-11T00:23:49.933205+0000","last_undegraded":"2024-09-11T00:23:49.933205+0000","last_fullsized":"2024-09-11T00:23:49.933205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:33.143595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934240+0000","last_change":"2024-09-11T00:23:48.926949+0000","last_active":"2024-09-11T00:23:49.934240+0000","last_peered":"2024-09-11T00:23:49.934240+0000","last_clean":"2024-09-11T00:23:49.934240+0000","last_became_active":"2024-09-11T00:23:48.926624+0000","last_became_peered":"2024-09-11T00:23:48.926624+0000","last_unstale":"2024-09-11T00:23:49.934240+0000","last_undegraded":"2024-09-11T00:23:49.934240+0000","last_fullsized":"2024-09-11T00:23:49.934240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:40.283499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.937130+0000","last_change":"2024-09-11T00:23:48.927831+0000","last_active":"2024-09-11T00:23:49.937130+0000","last_peered":"2024-09-11T00:23:49.937130+0000","last_clean":"2024-09-11T00:23:49.937130+0000","last_became_active":"2024-09-11T00:23:48.927396+0000","last_became_peered":"2024-09-11T00:23:48.927396+0000","last_unstale":"2024-09-11T00:23:49.937130+0000","last_undegraded":"2024-09-11T00:23:49.937130+0000","last_fullsized":"2024-09-11T00:23:49.937130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:43.076990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713863+0000","last_change":"2024-09-11T00:23:48.925368+0000","last_active":"2024-09-11T00:23:50.713863+0000","last_peered":"2024-09-11T00:23:50.713863+0000","last_clean":"2024-09-11T00:23:50.713863+0000","last_became_active":"2024-09-11T00:23:48.925051+0000","last_became_peered":"2024-09-11T00:23:48.925051+0000","last_unstale":"2024-09-11T00:23:50.713863+0000","last_undegraded":"2024-09-11T00:23:50.713863+0000","last_fullsized":"2024-09-11T00:23:50.713863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:03.081754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871196+0000","last_change":"2024-09-11T00:23:48.945468+0000","last_active":"2024-09-11T00:23:50.871196+0000","last_peered":"2024-09-11T00:23:50.871196+0000","last_clean":"2024-09-11T00:23:50.871196+0000","last_became_active":"2024-09-11T00:23:48.944945+0000","last_became_peered":"2024-09-11T00:23:48.944945+0000","last_unstale":"2024-09-11T00:23:50.871196+0000","last_undegraded":"2024-09-11T00:23:50.871196+0000","last_fullsized":"2024-09-11T00:23:50.871196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:06.656916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870452+0000","last_change":"2024-09-11T00:23:48.921544+0000","last_active":"2024-09-11T00:23:50.870452+0000","last_peered":"2024-09-11T00:23:50.870452+0000","last_clean":"2024-09-11T00:23:50.870452+0000","last_became_active":"2024-09-11T00:23:48.921253+0000","last_became_peered":"2024-09-11T00:23:48.921253+0000","last_unstale":"2024-09-11T00:23:50.870452+0000","last_undegraded":"2024-09-11T00:23:50.870452+0000","last_fullsized":"2024-09-11T00:23:50.870452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:10.533107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526203+0000","last_change":"2024-09-11T00:23:48.942961+0000","last_active":"2024-09-11T00:23:50.526203+0000","last_peered":"2024-09-11T00:23:50.526203+0000","last_clean":"2024-09-11T00:23:50.526203+0000","last_became_active":"2024-09-11T00:23:48.941533+0000","last_became_peered":"2024-09-11T00:23:48.941533+0000","last_unstale":"2024-09-11T00:23:50.526203+0000","last_undegraded":"2024-09-11T00:23:50.526203+0000","last_fullsized":"2024-09-11T00:23:50.526203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:52.956083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935633+0000","last_change":"2024-09-11T00:23:48.935142+0000","last_active":"2024-09-11T00:23:49.935633+0000","last_peered":"2024-09-11T00:23:49.935633+0000","last_clean":"2024-09-11T00:23:49.935633+0000","last_became_active":"2024-09-11T00:23:48.933148+0000","last_became_peered":"2024-09-11T00:23:48.933148+0000","last_unstale":"2024-09-11T00:23:49.935633+0000","last_undegraded":"2024-09-11T00:23:49.935633+0000","last_fullsized":"2024-09-11T00:23:49.935633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:18:47.960332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869723+0000","last_change":"2024-09-11T00:23:48.929778+0000","last_active":"2024-09-11T00:23:50.869723+0000","last_peered":"2024-09-11T00:23:50.869723+0000","last_clean":"2024-09-11T00:23:50.869723+0000","last_became_active":"2024-09-11T00:23:48.928138+0000","last_became_peered":"2024-09-11T00:23:48.928138+0000","last_unstale":"2024-09-11T00:23:50.869723+0000","last_undegraded":"2024-09-11T00:23:50.869723+0000","last_fullsized":"2024-09-11T00:23:50.869723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:23.709720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934308+0000","last_change":"2024-09-11T00:23:48.947725+0000","last_active":"2024-09-11T00:23:49.934308+0000","last_peered":"2024-09-11T00:23:49.934308+0000","last_clean":"2024-09-11T00:23:49.934308+0000","last_became_active":"2024-09-11T00:23:48.947361+0000","last_became_peered":"2024-09-11T00:23:48.947361+0000","last_unstale":"2024-09-11T00:23:49.934308+0000","last_undegraded":"2024-09-11T00:23:49.934308+0000","last_fullsized":"2024-09-11T00:23:49.934308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:31.087205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870205+0000","last_change":"2024-09-11T00:23:48.944855+0000","last_active":"2024-09-11T00:23:50.870205+0000","last_peered":"2024-09-11T00:23:50.870205+0000","last_clean":"2024-09-11T00:23:50.870205+0000","last_became_active":"2024-09-11T00:23:48.944551+0000","last_became_peered":"2024-09-11T00:23:48.944551+0000","last_unstale":"2024-09-11T00:23:50.870205+0000","last_undegraded":"2024-09-11T00:23:50.870205+0000","last_fullsized":"2024-09-11T00:23:50.870205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:53.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870796+0000","last_change":"2024-09-11T00:23:48.937626+0000","last_active":"2024-09-11T00:23:50.870796+0000","last_peered":"2024-09-11T00:23:50.870796+0000","last_clean":"2024-09-11T00:23:50.870796+0000","last_became_active":"2024-09-11T00:23:48.937263+0000","last_became_peered":"2024-09-11T00:23:48.937263+0000","last_unstale":"2024-09-11T00:23:50.870796+0000","last_undegraded":"2024-09-11T00:23:50.870796+0000","last_fullsized":"2024-09-11T00:23:50.870796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:50.142533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933798+0000","last_change":"2024-09-11T00:23:48.928952+0000","last_active":"2024-09-11T00:23:49.933798+0000","last_peered":"2024-09-11T00:23:49.933798+0000","last_clean":"2024-09-11T00:23:49.933798+0000","last_became_active":"2024-09-11T00:23:48.928683+0000","last_became_peered":"2024-09-11T00:23:48.928683+0000","last_unstale":"2024-09-11T00:23:49.933798+0000","last_undegraded":"2024-09-11T00:23:49.933798+0000","last_fullsized":"2024-09-11T00:23:49.933798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:50.142533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870161+0000","last_change":"2024-09-11T00:23:48.929575+0000","last_active":"2024-09-11T00:23:50.870161+0000","last_peered":"2024-09-11T00:23:50.870161+0000","last_clean":"2024-09-11T00:23:50.870161+0000","last_became_active":"2024-09-11T00:23:48.928625+0000","last_became_peered":"2024-09-11T00:23:48.928625+0000","last_unstale":"2024-09-11T00:23:50.870161+0000","last_undegraded":"2024-09-11T00:23:50.870161+0000","last_fullsized":"2024-09-11T00:23:50.870161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:13.522317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526474+0000","last_change":"2024-09-11T00:23:48.947976+0000","last_active":"2024-09-11T00:23:50.526474+0000","last_peered":"2024-09-11T00:23:50.526474+0000","last_clean":"2024-09-11T00:23:50.526474+0000","last_became_active":"2024-09-11T00:23:48.947725+0000","last_became_peered":"2024-09-11T00:23:48.947725+0000","last_unstale":"2024-09-11T00:23:50.526474+0000","last_undegraded":"2024-09-11T00:23:50.526474+0000","last_fullsized":"2024-09-11T00:23:50.526474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:09:52.162272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935202+0000","last_change":"2024-09-11T00:23:48.930538+0000","last_active":"2024-09-11T00:23:49.935202+0000","last_peered":"2024-09-11T00:23:49.935202+0000","last_clean":"2024-09-11T00:23:49.935202+0000","last_became_active":"2024-09-11T00:23:48.930224+0000","last_became_peered":"2024-09-11T00:23:48.930224+0000","last_unstale":"2024-09-11T00:23:49.935202+0000","last_undegraded":"2024-09-11T00:23:49.935202+0000","last_fullsized":"2024-09-11T00:23:49.935202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:18.427715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713776+0000","last_change":"2024-09-11T00:23:48.927566+0000","last_active":"2024-09-11T00:23:50.713776+0000","last_peered":"2024-09-11T00:23:50.713776+0000","last_clean":"2024-09-11T00:23:50.713776+0000","last_became_active":"2024-09-11T00:23:48.927306+0000","last_became_peered":"2024-09-11T00:23:48.927306+0000","last_unstale":"2024-09-11T00:23:50.713776+0000","last_undegraded":"2024-09-11T00:23:50.713776+0000","last_fullsized":"2024-09-11T00:23:50.713776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:35.800616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870322+0000","last_change":"2024-09-11T00:23:48.926632+0000","last_active":"2024-09-11T00:23:50.870322+0000","last_peered":"2024-09-11T00:23:50.870322+0000","last_clean":"2024-09-11T00:23:50.870322+0000","last_became_active":"2024-09-11T00:23:48.926014+0000","last_became_peered":"2024-09-11T00:23:48.926014+0000","last_unstale":"2024-09-11T00:23:50.870322+0000","last_undegraded":"2024-09-11T00:23:50.870322+0000","last_fullsized":"2024-09-11T00:23:50.870322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:49.141326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936248+0000","last_change":"2024-09-11T00:23:48.925940+0000","last_active":"2024-09-11T00:23:49.936248+0000","last_peered":"2024-09-11T00:23:49.936248+0000","last_clean":"2024-09-11T00:23:49.936248+0000","last_became_active":"2024-09-11T00:23:48.925589+0000","last_became_peered":"2024-09-11T00:23:48.925589+0000","last_unstale":"2024-09-11T00:23:49.936248+0000","last_undegraded":"2024-09-11T00:23:49.936248+0000","last_fullsized":"2024-09-11T00:23:49.936248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:41.419916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869814+0000","last_change":"2024-09-11T00:23:47.934229+0000","last_active":"2024-09-11T00:23:50.869814+0000","last_peered":"2024-09-11T00:23:50.869814+0000","last_clean":"2024-09-11T00:23:50.869814+0000","last_became_active":"2024-09-11T00:23:47.933880+0000","last_became_peered":"2024-09-11T00:23:47.933880+0000","last_unstale":"2024-09-11T00:23:50.869814+0000","last_undegraded":"2024-09-11T00:23:50.869814+0000","last_fullsized":"2024-09-11T00:23:50.869814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:30.892853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526491+0000","last_change":"2024-09-11T00:23:48.934481+0000","last_active":"2024-09-11T00:23:50.526491+0000","last_peered":"2024-09-11T00:23:50.526491+0000","last_clean":"2024-09-11T00:23:50.526491+0000","last_became_active":"2024-09-11T00:23:48.931082+0000","last_became_peered":"2024-09-11T00:23:48.931082+0000","last_unstale":"2024-09-11T00:23:50.526491+0000","last_undegraded":"2024-09-11T00:23:50.526491+0000","last_fullsized":"2024-09-11T00:23:50.526491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:04.133148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870136+0000","last_change":"2024-09-11T00:23:47.933078+0000","last_active":"2024-09-11T00:23:50.870136+0000","last_peered":"2024-09-11T00:23:50.870136+0000","last_clean":"2024-09-11T00:23:50.870136+0000","last_became_active":"2024-09-11T00:23:47.932815+0000","last_became_peered":"2024-09-11T00:23:47.932815+0000","last_unstale":"2024-09-11T00:23:50.870136+0000","last_undegraded":"2024-09-11T00:23:50.870136+0000","last_fullsized":"2024-09-11T00:23:50.870136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:00.103061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869652+0000","last_change":"2024-09-11T00:23:47.927116+0000","last_active":"2024-09-11T00:23:50.869652+0000","last_peered":"2024-09-11T00:23:50.869652+0000","last_clean":"2024-09-11T00:23:50.869652+0000","last_became_active":"2024-09-11T00:23:47.926760+0000","last_became_peered":"2024-09-11T00:23:47.926760+0000","last_unstale":"2024-09-11T00:23:50.869652+0000","last_undegraded":"2024-09-11T00:23:50.869652+0000","last_fullsized":"2024-09-11T00:23:50.869652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:14:45.347474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869585+0000","last_change":"2024-09-11T00:23:48.947208+0000","last_active":"2024-09-11T00:23:50.869585+0000","last_peered":"2024-09-11T00:23:50.869585+0000","last_clean":"2024-09-11T00:23:50.869585+0000","last_became_active":"2024-09-11T00:23:48.946963+0000","last_became_peered":"2024-09-11T00:23:48.946963+0000","last_unstale":"2024-09-11T00:23:50.869585+0000","last_undegraded":"2024-09-11T00:23:50.869585+0000","last_fullsized":"2024-09-11T00:23:50.869585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:10.533107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934435+0000","last_change":"2024-09-11T00:23:47.924168+0000","last_active":"2024-09-11T00:23:49.934435+0000","last_peered":"2024-09-11T00:23:49.934435+0000","last_clean":"2024-09-11T00:23:49.934435+0000","last_became_active":"2024-09-11T00:23:47.923810+0000","last_became_peered":"2024-09-11T00:23:47.923810+0000","last_unstale":"2024-09-11T00:23:49.934435+0000","last_undegraded":"2024-09-11T00:23:49.934435+0000","last_fullsized":"2024-09-11T00:23:49.934435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:09.057962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933208+0000","last_change":"2024-09-11T00:23:48.932214+0000","last_active":"2024-09-11T00:23:49.933208+0000","last_peered":"2024-09-11T00:23:49.933208+0000","last_clean":"2024-09-11T00:23:49.933208+0000","last_became_active":"2024-09-11T00:23:48.931946+0000","last_became_peered":"2024-09-11T00:23:48.931946+0000","last_unstale":"2024-09-11T00:23:49.933208+0000","last_undegraded":"2024-09-11T00:23:49.933208+0000","last_fullsized":"2024-09-11T00:23:49.933208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:10.533107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871004+0000","last_change":"2024-09-11T00:23:47.929315+0000","last_active":"2024-09-11T00:23:50.871004+0000","last_peered":"2024-09-11T00:23:50.871004+0000","last_clean":"2024-09-11T00:23:50.871004+0000","last_became_active":"2024-09-11T00:23:47.928873+0000","last_became_peered":"2024-09-11T00:23:47.928873+0000","last_unstale":"2024-09-11T00:23:50.871004+0000","last_undegraded":"2024-09-11T00:23:50.871004+0000","last_fullsized":"2024-09-11T00:23:50.871004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:27.835276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935414+0000","last_change":"2024-09-11T00:23:48.933958+0000","last_active":"2024-09-11T00:23:49.935414+0000","last_peered":"2024-09-11T00:23:49.935414+0000","last_clean":"2024-09-11T00:23:49.935414+0000","last_became_active":"2024-09-11T00:23:48.933311+0000","last_became_peered":"2024-09-11T00:23:48.933311+0000","last_unstale":"2024-09-11T00:23:49.935414+0000","last_undegraded":"2024-09-11T00:23:49.935414+0000","last_fullsized":"2024-09-11T00:23:49.935414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:48.420430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936215+0000","last_change":"2024-09-11T00:23:47.936415+0000","last_active":"2024-09-11T00:23:49.936215+0000","last_peered":"2024-09-11T00:23:49.936215+0000","last_clean":"2024-09-11T00:23:49.936215+0000","last_became_active":"2024-09-11T00:23:47.935508+0000","last_became_peered":"2024-09-11T00:23:47.935508+0000","last_unstale":"2024-09-11T00:23:49.936215+0000","last_undegraded":"2024-09-11T00:23:49.936215+0000","last_fullsized":"2024-09-11T00:23:49.936215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:14:04.971648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526665+0000","last_change":"2024-09-11T00:23:48.925280+0000","last_active":"2024-09-11T00:23:50.526665+0000","last_peered":"2024-09-11T00:23:50.526665+0000","last_clean":"2024-09-11T00:23:50.526665+0000","last_became_active":"2024-09-11T00:23:48.923558+0000","last_became_peered":"2024-09-11T00:23:48.923558+0000","last_unstale":"2024-09-11T00:23:50.526665+0000","last_undegraded":"2024-09-11T00:23:50.526665+0000","last_fullsized":"2024-09-11T00:23:50.526665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:51.437783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933648+0000","last_change":"2024-09-11T00:23:47.917495+0000","last_active":"2024-09-11T00:23:49.933648+0000","last_peered":"2024-09-11T00:23:49.933648+0000","last_clean":"2024-09-11T00:23:49.933648+0000","last_became_active":"2024-09-11T00:23:47.917190+0000","last_became_peered":"2024-09-11T00:23:47.917190+0000","last_unstale":"2024-09-11T00:23:49.933648+0000","last_undegraded":"2024-09-11T00:23:49.933648+0000","last_fullsized":"2024-09-11T00:23:49.933648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:40.413211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936314+0000","last_change":"2024-09-11T00:23:48.931464+0000","last_active":"2024-09-11T00:23:49.936314+0000","last_peered":"2024-09-11T00:23:49.936314+0000","last_clean":"2024-09-11T00:23:49.936314+0000","last_became_active":"2024-09-11T00:23:48.929780+0000","last_became_peered":"2024-09-11T00:23:48.929780+0000","last_unstale":"2024-09-11T00:23:49.936314+0000","last_undegraded":"2024-09-11T00:23:49.936314+0000","last_fullsized":"2024-09-11T00:23:49.936314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:06.878857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870468+0000","last_change":"2024-09-11T00:23:47.929964+0000","last_active":"2024-09-11T00:23:50.870468+0000","last_peered":"2024-09-11T00:23:50.870468+0000","last_clean":"2024-09-11T00:23:50.870468+0000","last_became_active":"2024-09-11T00:23:47.929635+0000","last_became_peered":"2024-09-11T00:23:47.929635+0000","last_unstale":"2024-09-11T00:23:50.870468+0000","last_undegraded":"2024-09-11T00:23:50.870468+0000","last_fullsized":"2024-09-11T00:23:50.870468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:05.769710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870963+0000","last_change":"2024-09-11T00:23:48.946941+0000","last_active":"2024-09-11T00:23:50.870963+0000","last_peered":"2024-09-11T00:23:50.870963+0000","last_clean":"2024-09-11T00:23:50.870963+0000","last_became_active":"2024-09-11T00:23:48.946690+0000","last_became_peered":"2024-09-11T00:23:48.946690+0000","last_unstale":"2024-09-11T00:23:50.870963+0000","last_undegraded":"2024-09-11T00:23:50.870963+0000","last_fullsized":"2024-09-11T00:23:50.870963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:18.427715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526613+0000","last_change":"2024-09-11T00:23:47.931967+0000","last_active":"2024-09-11T00:23:50.526613+0000","last_peered":"2024-09-11T00:23:50.526613+0000","last_clean":"2024-09-11T00:23:50.526613+0000","last_became_active":"2024-09-11T00:23:47.929613+0000","last_became_peered":"2024-09-11T00:23:47.929613+0000","last_unstale":"2024-09-11T00:23:50.526613+0000","last_undegraded":"2024-09-11T00:23:50.526613+0000","last_fullsized":"2024-09-11T00:23:50.526613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:07.537335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526168+0000","last_change":"2024-09-11T00:23:48.942082+0000","last_active":"2024-09-11T00:23:50.526168+0000","last_peered":"2024-09-11T00:23:50.526168+0000","last_clean":"2024-09-11T00:23:50.526168+0000","last_became_active":"2024-09-11T00:23:48.941719+0000","last_became_peered":"2024-09-11T00:23:48.941719+0000","last_unstale":"2024-09-11T00:23:50.526168+0000","last_undegraded":"2024-09-11T00:23:50.526168+0000","last_fullsized":"2024-09-11T00:23:50.526168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:12.862149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935272+0000","last_change":"2024-09-11T00:23:47.923106+0000","last_active":"2024-09-11T00:23:49.935272+0000","last_peered":"2024-09-11T00:23:49.935272+0000","last_clean":"2024-09-11T00:23:49.935272+0000","last_became_active":"2024-09-11T00:23:47.922184+0000","last_became_peered":"2024-09-11T00:23:47.922184+0000","last_unstale":"2024-09-11T00:23:49.935272+0000","last_undegraded":"2024-09-11T00:23:49.935272+0000","last_fullsized":"2024-09-11T00:23:49.935272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:25.625230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871459+0000","last_change":"2024-09-11T00:23:48.944533+0000","last_active":"2024-09-11T00:23:50.871459+0000","last_peered":"2024-09-11T00:23:50.871459+0000","last_clean":"2024-09-11T00:23:50.871459+0000","last_became_active":"2024-09-11T00:23:48.943682+0000","last_became_peered":"2024-09-11T00:23:48.943682+0000","last_unstale":"2024-09-11T00:23:50.871459+0000","last_undegraded":"2024-09-11T00:23:50.871459+0000","last_fullsized":"2024-09-11T00:23:50.871459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:30.501339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870124+0000","last_change":"2024-09-11T00:23:47.927380+0000","last_active":"2024-09-11T00:23:50.870124+0000","last_peered":"2024-09-11T00:23:50.870124+0000","last_clean":"2024-09-11T00:23:50.870124+0000","last_became_active":"2024-09-11T00:23:47.926325+0000","last_became_peered":"2024-09-11T00:23:47.926325+0000","last_unstale":"2024-09-11T00:23:50.870124+0000","last_undegraded":"2024-09-11T00:23:50.870124+0000","last_fullsized":"2024-09-11T00:23:50.870124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:17.848252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871625+0000","last_change":"2024-09-11T00:23:48.926985+0000","last_active":"2024-09-11T00:23:50.871625+0000","last_peered":"2024-09-11T00:23:50.871625+0000","last_clean":"2024-09-11T00:23:50.871625+0000","last_became_active":"2024-09-11T00:23:48.926337+0000","last_became_peered":"2024-09-11T00:23:48.926337+0000","last_unstale":"2024-09-11T00:23:50.871625+0000","last_undegraded":"2024-09-11T00:23:50.871625+0000","last_fullsized":"2024-09-11T00:23:50.871625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:32.096363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713565+0000","last_change":"2024-09-11T00:23:47.923036+0000","last_active":"2024-09-11T00:23:50.713565+0000","last_peered":"2024-09-11T00:23:50.713565+0000","last_clean":"2024-09-11T00:23:50.713565+0000","last_became_active":"2024-09-11T00:23:47.921195+0000","last_became_peered":"2024-09-11T00:23:47.921195+0000","last_unstale":"2024-09-11T00:23:50.713565+0000","last_undegraded":"2024-09-11T00:23:50.713565+0000","last_fullsized":"2024-09-11T00:23:50.713565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:14:45.347474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871089+0000","last_change":"2024-09-11T00:23:48.943396+0000","last_active":"2024-09-11T00:23:50.871089+0000","last_peered":"2024-09-11T00:23:50.871089+0000","last_clean":"2024-09-11T00:23:50.871089+0000","last_became_active":"2024-09-11T00:23:48.943075+0000","last_became_peered":"2024-09-11T00:23:48.943075+0000","last_unstale":"2024-09-11T00:23:50.871089+0000","last_undegraded":"2024-09-11T00:23:50.871089+0000","last_fullsized":"2024-09-11T00:23:50.871089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:52.627600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.936327+0000","last_change":"2024-09-11T00:23:47.927064+0000","last_active":"2024-09-11T00:23:49.936327+0000","last_peered":"2024-09-11T00:23:49.936327+0000","last_clean":"2024-09-11T00:23:49.936327+0000","last_became_active":"2024-09-11T00:23:47.926712+0000","last_became_peered":"2024-09-11T00:23:47.926712+0000","last_unstale":"2024-09-11T00:23:49.936327+0000","last_undegraded":"2024-09-11T00:23:49.936327+0000","last_fullsized":"2024-09-11T00:23:49.936327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:04.442035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871836+0000","last_change":"2024-09-11T00:23:48.944697+0000","last_active":"2024-09-11T00:23:50.871836+0000","last_peered":"2024-09-11T00:23:50.871836+0000","last_clean":"2024-09-11T00:23:50.871836+0000","last_became_active":"2024-09-11T00:23:48.944401+0000","last_became_peered":"2024-09-11T00:23:48.944401+0000","last_unstale":"2024-09-11T00:23:50.871836+0000","last_undegraded":"2024-09-11T00:23:50.871836+0000","last_fullsized":"2024-09-11T00:23:50.871836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:37.819167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713804+0000","last_change":"2024-09-11T00:23:47.925285+0000","last_active":"2024-09-11T00:23:50.713804+0000","last_peered":"2024-09-11T00:23:50.713804+0000","last_clean":"2024-09-11T00:23:50.713804+0000","last_became_active":"2024-09-11T00:23:47.923814+0000","last_became_peered":"2024-09-11T00:23:47.923814+0000","last_unstale":"2024-09-11T00:23:50.713804+0000","last_undegraded":"2024-09-11T00:23:50.713804+0000","last_fullsized":"2024-09-11T00:23:50.713804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:05.769710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.872231+0000","last_change":"2024-09-11T00:23:48.943572+0000","last_active":"2024-09-11T00:23:50.872231+0000","last_peered":"2024-09-11T00:23:50.872231+0000","last_clean":"2024-09-11T00:23:50.872231+0000","last_became_active":"2024-09-11T00:23:48.943332+0000","last_became_peered":"2024-09-11T00:23:48.943332+0000","last_unstale":"2024-09-11T00:23:50.872231+0000","last_undegraded":"2024-09-11T00:23:50.872231+0000","last_fullsized":"2024-09-11T00:23:50.872231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:27.017230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933857+0000","last_change":"2024-09-11T00:23:47.916785+0000","last_active":"2024-09-11T00:23:49.933857+0000","last_peered":"2024-09-11T00:23:49.933857+0000","last_clean":"2024-09-11T00:23:49.933857+0000","last_became_active":"2024-09-11T00:23:47.916497+0000","last_became_peered":"2024-09-11T00:23:47.916497+0000","last_unstale":"2024-09-11T00:23:49.933857+0000","last_undegraded":"2024-09-11T00:23:49.933857+0000","last_fullsized":"2024-09-11T00:23:49.933857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:05.872152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935575+0000","last_change":"2024-09-11T00:23:48.930287+0000","last_active":"2024-09-11T00:23:49.935575+0000","last_peered":"2024-09-11T00:23:49.935575+0000","last_clean":"2024-09-11T00:23:49.935575+0000","last_became_active":"2024-09-11T00:23:48.929725+0000","last_became_peered":"2024-09-11T00:23:48.929725+0000","last_unstale":"2024-09-11T00:23:49.935575+0000","last_undegraded":"2024-09-11T00:23:49.935575+0000","last_fullsized":"2024-09-11T00:23:49.935575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:27.758680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713703+0000","last_change":"2024-09-11T00:23:47.921536+0000","last_active":"2024-09-11T00:23:50.713703+0000","last_peered":"2024-09-11T00:23:50.713703+0000","last_clean":"2024-09-11T00:23:50.713703+0000","last_became_active":"2024-09-11T00:23:47.921189+0000","last_became_peered":"2024-09-11T00:23:47.921189+0000","last_unstale":"2024-09-11T00:23:50.713703+0000","last_undegraded":"2024-09-11T00:23:50.713703+0000","last_fullsized":"2024-09-11T00:23:50.713703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:00.103061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870954+0000","last_change":"2024-09-11T00:23:48.938303+0000","last_active":"2024-09-11T00:23:50.870954+0000","last_peered":"2024-09-11T00:23:50.870954+0000","last_clean":"2024-09-11T00:23:50.870954+0000","last_became_active":"2024-09-11T00:23:48.938020+0000","last_became_peered":"2024-09-11T00:23:48.938020+0000","last_unstale":"2024-09-11T00:23:50.870954+0000","last_undegraded":"2024-09-11T00:23:50.870954+0000","last_fullsized":"2024-09-11T00:23:50.870954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:27:37.871843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870713+0000","last_change":"2024-09-11T00:23:38.923873+0000","last_active":"2024-09-11T00:23:50.870713+0000","last_peered":"2024-09-11T00:23:50.870713+0000","last_clean":"2024-09-11T00:23:50.870713+0000","last_became_active":"2024-09-11T00:23:38.920629+0000","last_became_peered":"2024-09-11T00:23:38.920629+0000","last_unstale":"2024-09-11T00:23:50.870713+0000","last_undegraded":"2024-09-11T00:23:50.870713+0000","last_fullsized":"2024-09-11T00:23:50.870713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_clean_scrub_stamp":"2024-09-11T00:23:37.844553+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.533941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934753+0000","last_change":"2024-09-11T00:23:47.922903+0000","last_active":"2024-09-11T00:23:49.934753+0000","last_peered":"2024-09-11T00:23:49.934753+0000","last_clean":"2024-09-11T00:23:49.934753+0000","last_became_active":"2024-09-11T00:23:47.921860+0000","last_became_peered":"2024-09-11T00:23:47.921860+0000","last_unstale":"2024-09-11T00:23:49.934753+0000","last_undegraded":"2024-09-11T00:23:49.934753+0000","last_fullsized":"2024-09-11T00:23:49.934753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:36.398079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869697+0000","last_change":"2024-09-11T00:23:48.943469+0000","last_active":"2024-09-11T00:23:50.869697+0000","last_peered":"2024-09-11T00:23:50.869697+0000","last_clean":"2024-09-11T00:23:50.869697+0000","last_became_active":"2024-09-11T00:23:48.939041+0000","last_became_peered":"2024-09-11T00:23:48.939041+0000","last_unstale":"2024-09-11T00:23:50.869697+0000","last_undegraded":"2024-09-11T00:23:50.869697+0000","last_fullsized":"2024-09-11T00:23:50.869697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:57.017486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870591+0000","last_change":"2024-09-11T00:23:47.938200+0000","last_active":"2024-09-11T00:23:50.870591+0000","last_peered":"2024-09-11T00:23:50.870591+0000","last_clean":"2024-09-11T00:23:50.870591+0000","last_became_active":"2024-09-11T00:23:47.937671+0000","last_became_peered":"2024-09-11T00:23:47.937671+0000","last_unstale":"2024-09-11T00:23:50.870591+0000","last_undegraded":"2024-09-11T00:23:50.870591+0000","last_fullsized":"2024-09-11T00:23:50.870591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:21.182195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526116+0000","last_change":"2024-09-11T00:23:48.933693+0000","last_active":"2024-09-11T00:23:50.526116+0000","last_peered":"2024-09-11T00:23:50.526116+0000","last_clean":"2024-09-11T00:23:50.526116+0000","last_became_active":"2024-09-11T00:23:48.933355+0000","last_became_peered":"2024-09-11T00:23:48.933355+0000","last_unstale":"2024-09-11T00:23:50.526116+0000","last_undegraded":"2024-09-11T00:23:50.526116+0000","last_fullsized":"2024-09-11T00:23:50.526116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:26.797108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.713671+0000","last_change":"2024-09-11T00:23:47.929198+0000","last_active":"2024-09-11T00:23:50.713671+0000","last_peered":"2024-09-11T00:23:50.713671+0000","last_clean":"2024-09-11T00:23:50.713671+0000","last_became_active":"2024-09-11T00:23:47.928882+0000","last_became_peered":"2024-09-11T00:23:47.928882+0000","last_unstale":"2024-09-11T00:23:50.713671+0000","last_undegraded":"2024-09-11T00:23:50.713671+0000","last_fullsized":"2024-09-11T00:23:50.713671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:17.848252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933279+0000","last_change":"2024-09-11T00:23:48.932829+0000","last_active":"2024-09-11T00:23:49.933279+0000","last_peered":"2024-09-11T00:23:49.933279+0000","last_clean":"2024-09-11T00:23:49.933279+0000","last_became_active":"2024-09-11T00:23:48.932546+0000","last_became_peered":"2024-09-11T00:23:48.932546+0000","last_unstale":"2024-09-11T00:23:49.933279+0000","last_undegraded":"2024-09-11T00:23:49.933279+0000","last_fullsized":"2024-09-11T00:23:49.933279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:23.709720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935373+0000","last_change":"2024-09-11T00:23:47.917787+0000","last_active":"2024-09-11T00:23:49.935373+0000","last_peered":"2024-09-11T00:23:49.935373+0000","last_clean":"2024-09-11T00:23:49.935373+0000","last_became_active":"2024-09-11T00:23:47.916390+0000","last_became_peered":"2024-09-11T00:23:47.916390+0000","last_unstale":"2024-09-11T00:23:49.935373+0000","last_undegraded":"2024-09-11T00:23:49.935373+0000","last_fullsized":"2024-09-11T00:23:49.935373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:21.182195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935541+0000","last_change":"2024-09-11T00:23:48.936767+0000","last_active":"2024-09-11T00:23:49.935541+0000","last_peered":"2024-09-11T00:23:49.935541+0000","last_clean":"2024-09-11T00:23:49.935541+0000","last_became_active":"2024-09-11T00:23:48.936263+0000","last_became_peered":"2024-09-11T00:23:48.936263+0000","last_unstale":"2024-09-11T00:23:49.935541+0000","last_undegraded":"2024-09-11T00:23:49.935541+0000","last_fullsized":"2024-09-11T00:23:49.935541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:28.841981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933635+0000","last_change":"2024-09-11T00:23:47.930283+0000","last_active":"2024-09-11T00:23:49.933635+0000","last_peered":"2024-09-11T00:23:49.933635+0000","last_clean":"2024-09-11T00:23:49.933635+0000","last_became_active":"2024-09-11T00:23:47.930008+0000","last_became_peered":"2024-09-11T00:23:47.930008+0000","last_unstale":"2024-09-11T00:23:49.933635+0000","last_undegraded":"2024-09-11T00:23:49.933635+0000","last_fullsized":"2024-09-11T00:23:49.933635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:27.835276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935676+0000","last_change":"2024-09-11T00:23:48.929269+0000","last_active":"2024-09-11T00:23:49.935676+0000","last_peered":"2024-09-11T00:23:49.935676+0000","last_clean":"2024-09-11T00:23:49.935676+0000","last_became_active":"2024-09-11T00:23:48.928947+0000","last_became_peered":"2024-09-11T00:23:48.928947+0000","last_unstale":"2024-09-11T00:23:49.935676+0000","last_undegraded":"2024-09-11T00:23:49.935676+0000","last_fullsized":"2024-09-11T00:23:49.935676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:31.745356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871434+0000","last_change":"2024-09-11T00:23:47.940851+0000","last_active":"2024-09-11T00:23:50.871434+0000","last_peered":"2024-09-11T00:23:50.871434+0000","last_clean":"2024-09-11T00:23:50.871434+0000","last_became_active":"2024-09-11T00:23:47.940667+0000","last_became_peered":"2024-09-11T00:23:47.940667+0000","last_unstale":"2024-09-11T00:23:50.871434+0000","last_undegraded":"2024-09-11T00:23:50.871434+0000","last_fullsized":"2024-09-11T00:23:50.871434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:06.334712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933539+0000","last_change":"2024-09-11T00:23:48.928214+0000","last_active":"2024-09-11T00:23:49.933539+0000","last_peered":"2024-09-11T00:23:49.933539+0000","last_clean":"2024-09-11T00:23:49.933539+0000","last_became_active":"2024-09-11T00:23:48.927947+0000","last_became_peered":"2024-09-11T00:23:48.927947+0000","last_unstale":"2024-09-11T00:23:49.933539+0000","last_undegraded":"2024-09-11T00:23:49.933539+0000","last_fullsized":"2024-09-11T00:23:49.933539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:08:27.071042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934052+0000","last_change":"2024-09-11T00:23:47.935782+0000","last_active":"2024-09-11T00:23:49.934052+0000","last_peered":"2024-09-11T00:23:49.934052+0000","last_clean":"2024-09-11T00:23:49.934052+0000","last_became_active":"2024-09-11T00:23:47.935518+0000","last_became_peered":"2024-09-11T00:23:47.935518+0000","last_unstale":"2024-09-11T00:23:49.934052+0000","last_undegraded":"2024-09-11T00:23:49.934052+0000","last_fullsized":"2024-09-11T00:23:49.934052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:59.939503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870137+0000","last_change":"2024-09-11T00:23:48.942240+0000","last_active":"2024-09-11T00:23:50.870137+0000","last_peered":"2024-09-11T00:23:50.870137+0000","last_clean":"2024-09-11T00:23:50.870137+0000","last_became_active":"2024-09-11T00:23:48.941950+0000","last_became_peered":"2024-09-11T00:23:48.941950+0000","last_unstale":"2024-09-11T00:23:50.870137+0000","last_undegraded":"2024-09-11T00:23:50.870137+0000","last_fullsized":"2024-09-11T00:23:50.870137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:05.378796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871100+0000","last_change":"2024-09-11T00:23:47.940231+0000","last_active":"2024-09-11T00:23:50.871100+0000","last_peered":"2024-09-11T00:23:50.871100+0000","last_clean":"2024-09-11T00:23:50.871100+0000","last_became_active":"2024-09-11T00:23:47.939887+0000","last_became_peered":"2024-09-11T00:23:47.939887+0000","last_unstale":"2024-09-11T00:23:50.871100+0000","last_undegraded":"2024-09-11T00:23:50.871100+0000","last_fullsized":"2024-09-11T00:23:50.871100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:40.413211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526432+0000","last_change":"2024-09-11T00:23:48.948747+0000","last_active":"2024-09-11T00:23:50.526432+0000","last_peered":"2024-09-11T00:23:50.526432+0000","last_clean":"2024-09-11T00:23:50.526432+0000","last_became_active":"2024-09-11T00:23:48.948439+0000","last_became_peered":"2024-09-11T00:23:48.948439+0000","last_unstale":"2024-09-11T00:23:50.526432+0000","last_undegraded":"2024-09-11T00:23:50.526432+0000","last_fullsized":"2024-09-11T00:23:50.526432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:59.951812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870404+0000","last_change":"2024-09-11T00:23:47.938518+0000","last_active":"2024-09-11T00:23:50.870404+0000","last_peered":"2024-09-11T00:23:50.870404+0000","last_clean":"2024-09-11T00:23:50.870404+0000","last_became_active":"2024-09-11T00:23:47.937928+0000","last_became_peered":"2024-09-11T00:23:47.937928+0000","last_unstale":"2024-09-11T00:23:50.870404+0000","last_undegraded":"2024-09-11T00:23:50.870404+0000","last_fullsized":"2024-09-11T00:23:50.870404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:25.625230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.934570+0000","last_change":"2024-09-11T00:23:48.929011+0000","last_active":"2024-09-11T00:23:49.934570+0000","last_peered":"2024-09-11T00:23:49.934570+0000","last_clean":"2024-09-11T00:23:49.934570+0000","last_became_active":"2024-09-11T00:23:48.927838+0000","last_became_peered":"2024-09-11T00:23:48.927838+0000","last_unstale":"2024-09-11T00:23:49.934570+0000","last_undegraded":"2024-09-11T00:23:49.934570+0000","last_fullsized":"2024-09-11T00:23:49.934570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:01.109766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933263+0000","last_change":"2024-09-11T00:23:47.930702+0000","last_active":"2024-09-11T00:23:49.933263+0000","last_peered":"2024-09-11T00:23:49.933263+0000","last_clean":"2024-09-11T00:23:49.933263+0000","last_became_active":"2024-09-11T00:23:47.930044+0000","last_became_peered":"2024-09-11T00:23:47.930044+0000","last_unstale":"2024-09-11T00:23:49.933263+0000","last_undegraded":"2024-09-11T00:23:49.933263+0000","last_fullsized":"2024-09-11T00:23:49.933263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:05.769710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869927+0000","last_change":"2024-09-11T00:23:48.932964+0000","last_active":"2024-09-11T00:23:50.869927+0000","last_peered":"2024-09-11T00:23:50.869927+0000","last_clean":"2024-09-11T00:23:50.869927+0000","last_became_active":"2024-09-11T00:23:48.932262+0000","last_became_peered":"2024-09-11T00:23:48.932262+0000","last_unstale":"2024-09-11T00:23:50.869927+0000","last_undegraded":"2024-09-11T00:23:50.869927+0000","last_fullsized":"2024-09-11T00:23:50.869927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:50.142533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.933446+0000","last_change":"2024-09-11T00:23:47.924671+0000","last_active":"2024-09-11T00:23:49.933446+0000","last_peered":"2024-09-11T00:23:49.933446+0000","last_clean":"2024-09-11T00:23:49.933446+0000","last_became_active":"2024-09-11T00:23:47.924383+0000","last_became_peered":"2024-09-11T00:23:47.924383+0000","last_unstale":"2024-09-11T00:23:49.933446+0000","last_undegraded":"2024-09-11T00:23:49.933446+0000","last_fullsized":"2024-09-11T00:23:49.933446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:00.103061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.869954+0000","last_change":"2024-09-11T00:23:48.949725+0000","last_active":"2024-09-11T00:23:50.869954+0000","last_peered":"2024-09-11T00:23:50.869954+0000","last_clean":"2024-09-11T00:23:50.869954+0000","last_became_active":"2024-09-11T00:23:48.949445+0000","last_became_peered":"2024-09-11T00:23:48.949445+0000","last_unstale":"2024-09-11T00:23:50.869954+0000","last_undegraded":"2024-09-11T00:23:50.869954+0000","last_fullsized":"2024-09-11T00:23:50.869954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:32.096363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871560+0000","last_change":"2024-09-11T00:23:47.940381+0000","last_active":"2024-09-11T00:23:50.871560+0000","last_peered":"2024-09-11T00:23:50.871560+0000","last_clean":"2024-09-11T00:23:50.871560+0000","last_became_active":"2024-09-11T00:23:47.940030+0000","last_became_peered":"2024-09-11T00:23:47.940030+0000","last_unstale":"2024-09-11T00:23:50.871560+0000","last_undegraded":"2024-09-11T00:23:50.871560+0000","last_fullsized":"2024-09-11T00:23:50.871560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:49.214733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870694+0000","last_change":"2024-09-11T00:23:48.934776+0000","last_active":"2024-09-11T00:23:50.870694+0000","last_peered":"2024-09-11T00:23:50.870694+0000","last_clean":"2024-09-11T00:23:50.870694+0000","last_became_active":"2024-09-11T00:23:48.925601+0000","last_became_peered":"2024-09-11T00:23:48.925601+0000","last_unstale":"2024-09-11T00:23:50.870694+0000","last_undegraded":"2024-09-11T00:23:50.870694+0000","last_fullsized":"2024-09-11T00:23:50.870694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:23.709720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935472+0000","last_change":"2024-09-11T00:23:48.921538+0000","last_active":"2024-09-11T00:23:49.935472+0000","last_peered":"2024-09-11T00:23:49.935472+0000","last_clean":"2024-09-11T00:23:49.935472+0000","last_became_active":"2024-09-11T00:23:48.921162+0000","last_became_peered":"2024-09-11T00:23:48.921162+0000","last_unstale":"2024-09-11T00:23:49.935472+0000","last_undegraded":"2024-09-11T00:23:49.935472+0000","last_fullsized":"2024-09-11T00:23:49.935472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:14:08.841886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871337+0000","last_change":"2024-09-11T00:23:47.938661+0000","last_active":"2024-09-11T00:23:50.871337+0000","last_peered":"2024-09-11T00:23:50.871337+0000","last_clean":"2024-09-11T00:23:50.871337+0000","last_became_active":"2024-09-11T00:23:47.937858+0000","last_became_peered":"2024-09-11T00:23:47.937858+0000","last_unstale":"2024-09-11T00:23:50.871337+0000","last_undegraded":"2024-09-11T00:23:50.871337+0000","last_fullsized":"2024-09-11T00:23:50.871337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:34.793911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:49.935205+0000","last_change":"2024-09-11T00:23:48.916507+0000","last_active":"2024-09-11T00:23:49.935205+0000","last_peered":"2024-09-11T00:23:49.935205+0000","last_clean":"2024-09-11T00:23:49.935205+0000","last_became_active":"2024-09-11T00:23:48.916168+0000","last_became_peered":"2024-09-11T00:23:48.916168+0000","last_unstale":"2024-09-11T00:23:49.935205+0000","last_undegraded":"2024-09-11T00:23:49.935205+0000","last_fullsized":"2024-09-11T00:23:49.935205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:53.184159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.871007+0000","last_change":"2024-09-11T00:23:47.941406+0000","last_active":"2024-09-11T00:23:50.871007+0000","last_peered":"2024-09-11T00:23:50.871007+0000","last_clean":"2024-09-11T00:23:50.871007+0000","last_became_active":"2024-09-11T00:23:47.940051+0000","last_became_peered":"2024-09-11T00:23:47.940051+0000","last_unstale":"2024-09-11T00:23:50.871007+0000","last_undegraded":"2024-09-11T00:23:50.871007+0000","last_fullsized":"2024-09-11T00:23:50.871007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:02.075049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526442+0000","last_change":"2024-09-11T00:23:48.925648+0000","last_active":"2024-09-11T00:23:50.526442+0000","last_peered":"2024-09-11T00:23:50.526442+0000","last_clean":"2024-09-11T00:23:50.526442+0000","last_became_active":"2024-09-11T00:23:48.924442+0000","last_became_peered":"2024-09-11T00:23:48.924442+0000","last_unstale":"2024-09-11T00:23:50.526442+0000","last_undegraded":"2024-09-11T00:23:50.526442+0000","last_fullsized":"2024-09-11T00:23:50.526442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:54.299102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870045+0000","last_change":"2024-09-11T00:23:47.932359+0000","last_active":"2024-09-11T00:23:50.870045+0000","last_peered":"2024-09-11T00:23:50.870045+0000","last_clean":"2024-09-11T00:23:50.870045+0000","last_became_active":"2024-09-11T00:23:47.932075+0000","last_became_peered":"2024-09-11T00:23:47.932075+0000","last_unstale":"2024-09-11T00:23:50.870045+0000","last_undegraded":"2024-09-11T00:23:50.870045+0000","last_fullsized":"2024-09-11T00:23:50.870045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:17.848252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.870089+0000","last_change":"2024-09-11T00:23:48.939724+0000","last_active":"2024-09-11T00:23:50.870089+0000","last_peered":"2024-09-11T00:23:50.870089+0000","last_clean":"2024-09-11T00:23:50.870089+0000","last_became_active":"2024-09-11T00:23:48.939505+0000","last_became_peered":"2024-09-11T00:23:48.939505+0000","last_unstale":"2024-09-11T00:23:50.870089+0000","last_undegraded":"2024-09-11T00:23:50.870089+0000","last_fullsized":"2024-09-11T00:23:50.870089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:47.897289+0000","last_clean_scrub_stamp":"2024-09-11T00:23:47.897289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:19.018125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T00:23:50.526569+0000","last_change":"2024-09-11T00:23:47.940123+0000","last_active":"2024-09-11T00:23:50.526569+0000","last_peered":"2024-09-11T00:23:50.526569+0000","last_clean":"2024-09-11T00:23:50.526569+0000","last_became_active":"2024-09-11T00:23:47.939901+0000","last_became_peered":"2024-09-11T00:23:47.939901+0000","last_unstale":"2024-09-11T00:23:50.526569+0000","last_undegraded":"2024-09-11T00:23:50.526569+0000","last_fullsized":"2024-09-11T00:23:50.526569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:46.890584+0000","last_clean_scrub_stamp":"2024-09-11T00:23:46.890584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:45.637790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":667234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":76410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":667290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:24:03.864 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T00:24:03.865 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T00:24:03.865 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-11T00:24:03.865 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T00:24:04.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.063+0000 7fb7a9c00640 1 -- 172.21.15.40:0/244101747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7a415a410 msgr2=0x7fb7a40724f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:04.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.063+0000 7fb7a9c00640 1 --2- 172.21.15.40:0/244101747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7a415a410 0x7fb7a40724f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb78c005fd0 tx=0x7fb78c02a5d0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.063+0000 7fb7a9c00640 1 -- 172.21.15.40:0/244101747 shutdown_connections 2024-09-11T00:24:04.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.063+0000 7fb7a9c00640 1 --2- 172.21.15.40:0/244101747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7a40d06d0 0x7fb7a40cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.063+0000 7fb7a9c00640 1 --2- 172.21.15.40:0/244101747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7a415a410 0x7fb7a40724f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.063+0000 7fb7a9c00640 1 -- 172.21.15.40:0/244101747 >> 172.21.15.40:0/244101747 conn(0x7fb7a40cfbb0 msgr2=0x7fb7a40cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:04.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.063+0000 7fb7a9c00640 1 -- 172.21.15.40:0/244101747 shutdown_connections 2024-09-11T00:24:04.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.063+0000 7fb7a9c00640 1 -- 172.21.15.40:0/244101747 wait complete. 2024-09-11T00:24:04.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.064+0000 7fb7a9c00640 1 Processor -- start 2024-09-11T00:24:04.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.065+0000 7fb7a9c00640 1 -- start start 2024-09-11T00:24:04.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.066+0000 7fb7a9c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7a40ca350 0x7fb7a4155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:04.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.066+0000 7fb7a9c00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7a40d06d0 0x7fb7a4159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:04.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.066+0000 7fb7a9c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7a415a410 0x7fb7a4159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:04.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.066+0000 7fb7a9c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a4072ae0 con 0x7fb7a40ca350 2024-09-11T00:24:04.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.066+0000 7fb7a9c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a415df80 con 0x7fb7a415a410 2024-09-11T00:24:04.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.066+0000 7fb7a9c00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a40cefb0 con 0x7fb7a40d06d0 2024-09-11T00:24:04.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.066+0000 7fb7a2a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7a40ca350 0x7fb7a4155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:04.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.066+0000 7fb7a2a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7a40ca350 0x7fb7a4155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39814/0 (socket says 172.21.15.40:39814) 2024-09-11T00:24:04.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.066+0000 7fb7a2a00640 1 -- 172.21.15.40:0/3557679377 learned_addr learned my addr 172.21.15.40:0/3557679377 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:04.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.066+0000 7fb79a000640 1 --2- 172.21.15.40:0/3557679377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7a40d06d0 0x7fb7a4159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:04.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.066+0000 7fb7a3400640 1 --2- 172.21.15.40:0/3557679377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7a415a410 0x7fb7a4159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:04.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.066+0000 7fb7a2a00640 1 -- 172.21.15.40:0/3557679377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7a40d06d0 msgr2=0x7fb7a4159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:04.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.066+0000 7fb7a2a00640 1 --2- 172.21.15.40:0/3557679377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7a40d06d0 0x7fb7a4159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.066+0000 7fb7a2a00640 1 -- 172.21.15.40:0/3557679377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7a415a410 msgr2=0x7fb7a4159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:04.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.066+0000 7fb7a2a00640 1 --2- 172.21.15.40:0/3557679377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7a415a410 0x7fb7a4159660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.066+0000 7fb7a2a00640 1 -- 172.21.15.40:0/3557679377 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a40c7cd0 con 0x7fb7a40ca350 2024-09-11T00:24:04.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.067+0000 7fb7a2a00640 1 --2- 172.21.15.40:0/3557679377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7a40ca350 0x7fb7a4155210 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb79400c450 tx=0x7fb79400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:04.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.067+0000 7fb79b400640 1 -- 172.21.15.40:0/3557679377 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7940052d0 con 0x7fb7a40ca350 2024-09-11T00:24:04.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.067+0000 7fb79b400640 1 -- 172.21.15.40:0/3557679377 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb794005470 con 0x7fb7a40ca350 2024-09-11T00:24:04.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.067+0000 7fb79b400640 1 -- 172.21.15.40:0/3557679377 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb794012870 con 0x7fb7a40ca350 2024-09-11T00:24:04.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.067+0000 7fb7a9c00640 1 -- 172.21.15.40:0/3557679377 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a41f4b50 con 0x7fb7a40ca350 2024-09-11T00:24:04.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.067+0000 7fb7a9c00640 1 -- 172.21.15.40:0/3557679377 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a41f50f0 con 0x7fb7a40ca350 2024-09-11T00:24:04.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.068+0000 7fb7a9c00640 1 -- 172.21.15.40:0/3557679377 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a40cf540 con 0x7fb7a40ca350 2024-09-11T00:24:04.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.069+0000 7fb79b400640 1 -- 172.21.15.40:0/3557679377 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb7940035f0 con 0x7fb7a40ca350 2024-09-11T00:24:04.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.070+0000 7fb79b400640 1 --2- 172.21.15.40:0/3557679377 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb780077f70 0x7fb78007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:04.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.070+0000 7fb79b400640 1 -- 172.21.15.40:0/3557679377 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb7940997b0 con 0x7fb7a40ca350 2024-09-11T00:24:04.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.071+0000 7fb79a000640 1 --2- 172.21.15.40:0/3557679377 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb780077f70 0x7fb78007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:04.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.071+0000 7fb79a000640 1 --2- 172.21.15.40:0/3557679377 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb780077f70 0x7fb78007a430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb78c033000 tx=0x7fb78c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:04.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.074+0000 7fb79b400640 1 -- 172.21.15.40:0/3557679377 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb794061c60 con 0x7fb7a40ca350 2024-09-11T00:24:04.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.308+0000 7fb7a9c00640 1 -- 172.21.15.40:0/3557679377 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb7a40b5b30 con 0x7fb7a40ca350 2024-09-11T00:24:04.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.308+0000 7fb79b400640 1 -- 172.21.15.40:0/3557679377 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fb794066690 con 0x7fb7a40ca350 2024-09-11T00:24:04.310 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:04.310 INFO:teuthology.orchestra.run.smithi040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T00:24:04.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.311+0000 7fb7a9c00640 1 -- 172.21.15.40:0/3557679377 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb780077f70 msgr2=0x7fb78007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:04.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.311+0000 7fb7a9c00640 1 --2- 172.21.15.40:0/3557679377 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb780077f70 0x7fb78007a430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb78c033000 tx=0x7fb78c004730 comp rx=0 tx=0).stop 2024-09-11T00:24:04.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.311+0000 7fb7a9c00640 1 -- 172.21.15.40:0/3557679377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7a40ca350 msgr2=0x7fb7a4155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:04.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.311+0000 7fb7a9c00640 1 --2- 172.21.15.40:0/3557679377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7a40ca350 0x7fb7a4155210 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb79400c450 tx=0x7fb79400c910 comp rx=0 tx=0).stop 2024-09-11T00:24:04.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.311+0000 7fb7a9c00640 1 -- 172.21.15.40:0/3557679377 shutdown_connections 2024-09-11T00:24:04.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.311+0000 7fb7a9c00640 1 --2- 172.21.15.40:0/3557679377 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb780077f70 0x7fb78007a430 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.311+0000 7fb7a9c00640 1 --2- 172.21.15.40:0/3557679377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7a415a410 0x7fb7a4159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.311+0000 7fb7a9c00640 1 --2- 172.21.15.40:0/3557679377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7a40d06d0 0x7fb7a4159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.311+0000 7fb7a9c00640 1 --2- 172.21.15.40:0/3557679377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7a40ca350 0x7fb7a4155210 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.311+0000 7fb7a9c00640 1 -- 172.21.15.40:0/3557679377 >> 172.21.15.40:0/3557679377 conn(0x7fb7a40cfbb0 msgr2=0x7fb7a415e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:04.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.311+0000 7fb7a9c00640 1 -- 172.21.15.40:0/3557679377 shutdown_connections 2024-09-11T00:24:04.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.311+0000 7fb7a9c00640 1 -- 172.21.15.40:0/3557679377 wait complete. 2024-09-11T00:24:04.328 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-11T00:24:04.328 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:24:04.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.485+0000 7f9936c00640 1 -- 172.21.15.40:0/2481359389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99300cc180 msgr2=0x7f99300cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:04.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.485+0000 7f9936c00640 1 --2- 172.21.15.40:0/2481359389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99300cc180 0x7f99300cb420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f991c005fd0 tx=0x7f991c02a670 comp rx=0 tx=0).stop 2024-09-11T00:24:04.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.485+0000 7f9936c00640 1 -- 172.21.15.40:0/2481359389 shutdown_connections 2024-09-11T00:24:04.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.485+0000 7f9936c00640 1 --2- 172.21.15.40:0/2481359389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99300cc180 0x7f99300cb420 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.485+0000 7f9936c00640 1 -- 172.21.15.40:0/2481359389 >> 172.21.15.40:0/2481359389 conn(0x7f99300cfbb0 msgr2=0x7f99300cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:04.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.485+0000 7f9936c00640 1 -- 172.21.15.40:0/2481359389 shutdown_connections 2024-09-11T00:24:04.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.485+0000 7f9936c00640 1 -- 172.21.15.40:0/2481359389 wait complete. 2024-09-11T00:24:04.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.487+0000 7f9936c00640 1 Processor -- start 2024-09-11T00:24:04.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.487+0000 7f9936c00640 1 -- start start 2024-09-11T00:24:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.488+0000 7f9936c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f993006e910 0x7f99301f6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.488+0000 7f9936c00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99300cc180 0x7f9930152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.488+0000 7f9936c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f993015bcc0 0x7f99301f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.488+0000 7f9936c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f993006f450 con 0x7f993006e910 2024-09-11T00:24:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.488+0000 7f9936c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f993015f9d0 con 0x7f993015bcc0 2024-09-11T00:24:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.488+0000 7f9936c00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f993006f5d0 con 0x7f99300cc180 2024-09-11T00:24:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.488+0000 7f992fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f993006e910 0x7f99301f6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.488+0000 7f992fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f993006e910 0x7f99301f6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39842/0 (socket says 172.21.15.40:39842) 2024-09-11T00:24:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.488+0000 7f992fe00640 1 -- 172.21.15.40:0/205739984 learned_addr learned my addr 172.21.15.40:0/205739984 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.489+0000 7f992f400640 1 --2- 172.21.15.40:0/205739984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99300cc180 0x7f9930152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.489+0000 7f9934c00640 1 --2- 172.21.15.40:0/205739984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f993015bcc0 0x7f99301f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.489+0000 7f992fe00640 1 -- 172.21.15.40:0/205739984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99300cc180 msgr2=0x7f9930152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.489+0000 7f992fe00640 1 --2- 172.21.15.40:0/205739984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99300cc180 0x7f9930152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.489+0000 7f992fe00640 1 -- 172.21.15.40:0/205739984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f993015bcc0 msgr2=0x7f99301f2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.489+0000 7f992fe00640 1 --2- 172.21.15.40:0/205739984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f993015bcc0 0x7f99301f2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.489+0000 7f992fe00640 1 -- 172.21.15.40:0/205739984 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99301f6ac0 con 0x7f993006e910 2024-09-11T00:24:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.489+0000 7f992f400640 1 --2- 172.21.15.40:0/205739984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99300cc180 0x7f9930152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.489+0000 7f9934c00640 1 --2- 172.21.15.40:0/205739984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f993015bcc0 0x7f99301f2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.489+0000 7f992fe00640 1 --2- 172.21.15.40:0/205739984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f993006e910 0x7f99301f6580 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f992000c3a0 tx=0x7f992000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.489+0000 7f9927e00640 1 -- 172.21.15.40:0/205739984 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9920017070 con 0x7f993006e910 2024-09-11T00:24:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.489+0000 7f9927e00640 1 -- 172.21.15.40:0/205739984 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99200053c0 con 0x7f993006e910 2024-09-11T00:24:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.489+0000 7f9936c00640 1 -- 172.21.15.40:0/205739984 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99300c5e00 con 0x7f993006e910 2024-09-11T00:24:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.489+0000 7f9927e00640 1 -- 172.21.15.40:0/205739984 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9920003850 con 0x7f993006e910 2024-09-11T00:24:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.489+0000 7f9936c00640 1 -- 172.21.15.40:0/205739984 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99300c63c0 con 0x7f993006e910 2024-09-11T00:24:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.490+0000 7f9936c00640 1 -- 172.21.15.40:0/205739984 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f993006fa20 con 0x7f993006e910 2024-09-11T00:24:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.491+0000 7f9927e00640 1 -- 172.21.15.40:0/205739984 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f99200039f0 con 0x7f993006e910 2024-09-11T00:24:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.492+0000 7f9927e00640 1 --2- 172.21.15.40:0/205739984 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9910077f70 0x7f991007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.492+0000 7f9927e00640 1 -- 172.21.15.40:0/205739984 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9920099440 con 0x7f993006e910 2024-09-11T00:24:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.493+0000 7f992f400640 1 --2- 172.21.15.40:0/205739984 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9910077f70 0x7f991007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.494+0000 7f992f400640 1 --2- 172.21.15.40:0/205739984 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9910077f70 0x7f991007a430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f991c033000 tx=0x7f991c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:04.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.497+0000 7f9927e00640 1 -- 172.21.15.40:0/205739984 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f99301f6ac0 con 0x7f993006e910 2024-09-11T00:24:04.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.727+0000 7f9936c00640 1 -- 172.21.15.40:0/205739984 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99300cb230 con 0x7f993006e910 2024-09-11T00:24:04.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.728+0000 7f9927e00640 1 -- 172.21.15.40:0/205739984 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7f9920061ea0 con 0x7f993006e910 2024-09-11T00:24:04.785 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:04.785 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"btime":"2024-09-11T00:23:51:938503+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3825015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3825015784},{"type":"v1","addr":"172.21.15.175:6836","nonce":3825015784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4334,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1127011821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1127011821},{"type":"v1","addr":"172.21.15.175:6837","nonce":1127011821}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2724658296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2724658296},{"type":"v1","addr":"172.21.15.40:6833","nonce":2724658296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:23:48.351685+0000","modified":"2024-09-11T00:23:51.368958+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4356":{"gid":4356,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3237981730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3237981730},{"type":"v1","addr":"172.21.15.40:6835","nonce":3237981730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4356,"qdb_cluster":[4356]},"id":1}]} 2024-09-11T00:24:04.787 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-11T00:24:04.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.731+0000 7f9936c00640 1 -- 172.21.15.40:0/205739984 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9910077f70 msgr2=0x7f991007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:04.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.731+0000 7f9936c00640 1 --2- 172.21.15.40:0/205739984 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9910077f70 0x7f991007a430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f991c033000 tx=0x7f991c004730 comp rx=0 tx=0).stop 2024-09-11T00:24:04.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.731+0000 7f9936c00640 1 -- 172.21.15.40:0/205739984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f993006e910 msgr2=0x7f99301f6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:04.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.731+0000 7f9936c00640 1 --2- 172.21.15.40:0/205739984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f993006e910 0x7f99301f6580 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f992000c3a0 tx=0x7f992000c860 comp rx=0 tx=0).stop 2024-09-11T00:24:04.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.731+0000 7f9936c00640 1 -- 172.21.15.40:0/205739984 shutdown_connections 2024-09-11T00:24:04.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.731+0000 7f9936c00640 1 --2- 172.21.15.40:0/205739984 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9910077f70 0x7f991007a430 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.731+0000 7f9936c00640 1 --2- 172.21.15.40:0/205739984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f993015bcc0 0x7f99301f2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.731+0000 7f9936c00640 1 --2- 172.21.15.40:0/205739984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99300cc180 0x7f9930152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.731+0000 7f9936c00640 1 --2- 172.21.15.40:0/205739984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f993006e910 0x7f99301f6580 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.731+0000 7f9936c00640 1 -- 172.21.15.40:0/205739984 >> 172.21.15.40:0/205739984 conn(0x7f99300cfbb0 msgr2=0x7f99300c9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:04.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.731+0000 7f9936c00640 1 -- 172.21.15.40:0/205739984 shutdown_connections 2024-09-11T00:24:04.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.731+0000 7f9936c00640 1 -- 172.21.15.40:0/205739984 wait complete. 2024-09-11T00:24:04.788 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:24:04.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.950+0000 7fb729600640 1 -- 172.21.15.40:0/3810303869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7240b2d20 msgr2=0x7fb7240d4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:04.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.950+0000 7fb729600640 1 --2- 172.21.15.40:0/3810303869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7240b2d20 0x7fb7240d4740 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb71c005fd0 tx=0x7fb71c02a8b0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.950+0000 7fb729600640 1 -- 172.21.15.40:0/3810303869 shutdown_connections 2024-09-11T00:24:04.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.950+0000 7fb729600640 1 --2- 172.21.15.40:0/3810303869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7240b2d20 0x7fb7240d4740 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.950+0000 7fb729600640 1 -- 172.21.15.40:0/3810303869 >> 172.21.15.40:0/3810303869 conn(0x7fb7240d3c20 msgr2=0x7fb7240d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:04.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.950+0000 7fb729600640 1 -- 172.21.15.40:0/3810303869 shutdown_connections 2024-09-11T00:24:04.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.950+0000 7fb729600640 1 -- 172.21.15.40:0/3810303869 wait complete. 2024-09-11T00:24:04.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.951+0000 7fb729600640 1 Processor -- start 2024-09-11T00:24:04.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.952+0000 7fb729600640 1 -- start start 2024-09-11T00:24:04.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.952+0000 7fb729600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7240b2d20 0x7fb724157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:04.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.952+0000 7fb729600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7240d09e0 0x7fb7240b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:04.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.952+0000 7fb729600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb72415dd10 0x7fb7240cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:04.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.952+0000 7fb729600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb72406daa0 con 0x7fb72415dd10 2024-09-11T00:24:04.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.952+0000 7fb729600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb72406d920 con 0x7fb7240d09e0 2024-09-11T00:24:04.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.952+0000 7fb729600640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb72406dc20 con 0x7fb7240b2d20 2024-09-11T00:24:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.953+0000 7fb728c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb72415dd10 0x7fb7240cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.953+0000 7fb728c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb72415dd10 0x7fb7240cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39850/0 (socket says 172.21.15.40:39850) 2024-09-11T00:24:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.953+0000 7fb728c00640 1 -- 172.21.15.40:0/2225958665 learned_addr learned my addr 172.21.15.40:0/2225958665 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.953+0000 7fb723e00640 1 --2- 172.21.15.40:0/2225958665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7240b2d20 0x7fb724157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.953+0000 7fb71b400640 1 --2- 172.21.15.40:0/2225958665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7240d09e0 0x7fb7240b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.953+0000 7fb728c00640 1 -- 172.21.15.40:0/2225958665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7240b2d20 msgr2=0x7fb724157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.953+0000 7fb728c00640 1 --2- 172.21.15.40:0/2225958665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7240b2d20 0x7fb724157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.953+0000 7fb728c00640 1 -- 172.21.15.40:0/2225958665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7240d09e0 msgr2=0x7fb7240b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.953+0000 7fb728c00640 1 --2- 172.21.15.40:0/2225958665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7240d09e0 0x7fb7240b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.953+0000 7fb728c00640 1 -- 172.21.15.40:0/2225958665 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb724157fa0 con 0x7fb72415dd10 2024-09-11T00:24:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.953+0000 7fb71b400640 1 --2- 172.21.15.40:0/2225958665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7240d09e0 0x7fb7240b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.953+0000 7fb728c00640 1 --2- 172.21.15.40:0/2225958665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb72415dd10 0x7fb7240cd510 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb71c009cd0 tx=0x7fb71c031670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:04.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.954+0000 7fb720c00640 1 -- 172.21.15.40:0/2225958665 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c040070 con 0x7fb72415dd10 2024-09-11T00:24:04.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.954+0000 7fb720c00640 1 -- 172.21.15.40:0/2225958665 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb71c004040 con 0x7fb72415dd10 2024-09-11T00:24:04.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.954+0000 7fb720c00640 1 -- 172.21.15.40:0/2225958665 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c004490 con 0x7fb72415dd10 2024-09-11T00:24:04.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.954+0000 7fb729600640 1 -- 172.21.15.40:0/2225958665 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7240cae20 con 0x7fb72415dd10 2024-09-11T00:24:04.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.954+0000 7fb729600640 1 -- 172.21.15.40:0/2225958665 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7240cb3e0 con 0x7fb72415dd10 2024-09-11T00:24:04.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.955+0000 7fb729600640 1 -- 172.21.15.40:0/2225958665 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb72406e140 con 0x7fb72415dd10 2024-09-11T00:24:04.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.956+0000 7fb720c00640 1 -- 172.21.15.40:0/2225958665 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb71c004630 con 0x7fb72415dd10 2024-09-11T00:24:04.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.957+0000 7fb720c00640 1 --2- 172.21.15.40:0/2225958665 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb700077f70 0x7fb70007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:04.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.957+0000 7fb720c00640 1 -- 172.21.15.40:0/2225958665 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb71c0bb4e0 con 0x7fb72415dd10 2024-09-11T00:24:04.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.957+0000 7fb723e00640 1 --2- 172.21.15.40:0/2225958665 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb700077f70 0x7fb70007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:04.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.958+0000 7fb723e00640 1 --2- 172.21.15.40:0/2225958665 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb700077f70 0x7fb70007a430 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb714001120 tx=0x7fb714009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:04.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:04.961+0000 7fb720c00640 1 -- 172.21.15.40:0/2225958665 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb71c083fd0 con 0x7fb72415dd10 2024-09-11T00:24:05.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.193+0000 7fb729600640 1 -- 172.21.15.40:0/2225958665 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7240b6bd0 con 0x7fb72415dd10 2024-09-11T00:24:05.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.193+0000 7fb720c00640 1 -- 172.21.15.40:0/2225958665 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7fb71c0838d0 con 0x7fb72415dd10 2024-09-11T00:24:05.195 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:05.195 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"btime":"2024-09-11T00:23:51:938503+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3825015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3825015784},{"type":"v1","addr":"172.21.15.175:6836","nonce":3825015784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4334,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1127011821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1127011821},{"type":"v1","addr":"172.21.15.175:6837","nonce":1127011821}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2724658296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2724658296},{"type":"v1","addr":"172.21.15.40:6833","nonce":2724658296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:23:48.351685+0000","modified":"2024-09-11T00:23:51.368958+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4356":{"gid":4356,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3237981730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3237981730},{"type":"v1","addr":"172.21.15.40:6835","nonce":3237981730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4356,"qdb_cluster":[4356]},"id":1}]} 2024-09-11T00:24:05.195 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-11T00:24:05.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.196+0000 7fb729600640 1 -- 172.21.15.40:0/2225958665 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb700077f70 msgr2=0x7fb70007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:05.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.196+0000 7fb729600640 1 --2- 172.21.15.40:0/2225958665 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb700077f70 0x7fb70007a430 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb714001120 tx=0x7fb714009040 comp rx=0 tx=0).stop 2024-09-11T00:24:05.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.196+0000 7fb729600640 1 -- 172.21.15.40:0/2225958665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb72415dd10 msgr2=0x7fb7240cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:05.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.196+0000 7fb729600640 1 --2- 172.21.15.40:0/2225958665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb72415dd10 0x7fb7240cd510 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb71c009cd0 tx=0x7fb71c031670 comp rx=0 tx=0).stop 2024-09-11T00:24:05.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.196+0000 7fb729600640 1 -- 172.21.15.40:0/2225958665 shutdown_connections 2024-09-11T00:24:05.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.196+0000 7fb729600640 1 --2- 172.21.15.40:0/2225958665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb72415dd10 0x7fb7240cd510 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:05.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.196+0000 7fb729600640 1 --2- 172.21.15.40:0/2225958665 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb700077f70 0x7fb70007a430 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:05.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.196+0000 7fb729600640 1 --2- 172.21.15.40:0/2225958665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7240d09e0 0x7fb7240b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:05.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.196+0000 7fb729600640 1 --2- 172.21.15.40:0/2225958665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7240b2d20 0x7fb724157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:05.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.196+0000 7fb729600640 1 -- 172.21.15.40:0/2225958665 >> 172.21.15.40:0/2225958665 conn(0x7fb7240d3c20 msgr2=0x7fb7240b73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:05.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.196+0000 7fb729600640 1 -- 172.21.15.40:0/2225958665 shutdown_connections 2024-09-11T00:24:05.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.196+0000 7fb729600640 1 -- 172.21.15.40:0/2225958665 wait complete. 2024-09-11T00:24:05.213 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:24:05.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.373+0000 7f3d96a00640 1 -- 172.21.15.40:0/3958655568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d9015baa0 msgr2=0x7f3d9006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:05.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.373+0000 7f3d96a00640 1 --2- 172.21.15.40:0/3958655568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d9015baa0 0x7f3d9006e890 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3d84005fd0 tx=0x7f3d8402a940 comp rx=0 tx=0).stop 2024-09-11T00:24:05.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.373+0000 7f3d96a00640 1 -- 172.21.15.40:0/3958655568 shutdown_connections 2024-09-11T00:24:05.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.373+0000 7f3d96a00640 1 --2- 172.21.15.40:0/3958655568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d9015baa0 0x7f3d9006e890 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:05.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.373+0000 7f3d96a00640 1 -- 172.21.15.40:0/3958655568 >> 172.21.15.40:0/3958655568 conn(0x7f3d900cf770 msgr2=0x7f3d900cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:05.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.373+0000 7f3d96a00640 1 -- 172.21.15.40:0/3958655568 shutdown_connections 2024-09-11T00:24:05.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.373+0000 7f3d96a00640 1 -- 172.21.15.40:0/3958655568 wait complete. 2024-09-11T00:24:05.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.375+0000 7f3d96a00640 1 Processor -- start 2024-09-11T00:24:05.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.375+0000 7f3d96a00640 1 -- start start 2024-09-11T00:24:05.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.376+0000 7f3d96a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d90073f40 0x7f3d90157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:05.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.376+0000 7f3d96a00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d900ae640 0x7f3d900c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:05.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.376+0000 7f3d96a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d9015baa0 0x7f3d900b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:05.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.376+0000 7f3d96a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9015c710 con 0x7f3d9015baa0 2024-09-11T00:24:05.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.376+0000 7f3d96a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9015c590 con 0x7f3d90073f40 2024-09-11T00:24:05.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.376+0000 7f3d96a00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3d9015c890 con 0x7f3d900ae640 2024-09-11T00:24:05.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.376+0000 7f3d96000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d9015baa0 0x7f3d900b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:05.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.376+0000 7f3d96000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d9015baa0 0x7f3d900b3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39856/0 (socket says 172.21.15.40:39856) 2024-09-11T00:24:05.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.376+0000 7f3d96000640 1 -- 172.21.15.40:0/3449167386 learned_addr learned my addr 172.21.15.40:0/3449167386 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:05.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.376+0000 7f3d95600640 1 --2- 172.21.15.40:0/3449167386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d90073f40 0x7f3d90157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:05.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.376+0000 7f3d94c00640 1 --2- 172.21.15.40:0/3449167386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d900ae640 0x7f3d900c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:05.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.376+0000 7f3d96000640 1 -- 172.21.15.40:0/3449167386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d900ae640 msgr2=0x7f3d900c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:05.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.376+0000 7f3d96000640 1 --2- 172.21.15.40:0/3449167386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d900ae640 0x7f3d900c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:05.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.376+0000 7f3d96000640 1 -- 172.21.15.40:0/3449167386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d90073f40 msgr2=0x7f3d90157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:05.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.376+0000 7f3d96000640 1 --2- 172.21.15.40:0/3449167386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d90073f40 0x7f3d90157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:05.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.376+0000 7f3d96000640 1 -- 172.21.15.40:0/3449167386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d901f8230 con 0x7f3d9015baa0 2024-09-11T00:24:05.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.376+0000 7f3d94c00640 1 --2- 172.21.15.40:0/3449167386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d900ae640 0x7f3d900c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:05.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.377+0000 7f3d96000640 1 --2- 172.21.15.40:0/3449167386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d9015baa0 0x7f3d900b3610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800c400 tx=0x7f3d8800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:05.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.377+0000 7f3d8d600640 1 -- 172.21.15.40:0/3449167386 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88011790 con 0x7f3d9015baa0 2024-09-11T00:24:05.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.377+0000 7f3d8d600640 1 -- 172.21.15.40:0/3449167386 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d88017070 con 0x7f3d9015baa0 2024-09-11T00:24:05.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.377+0000 7f3d8d600640 1 -- 172.21.15.40:0/3449167386 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88011cc0 con 0x7f3d9015baa0 2024-09-11T00:24:05.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.377+0000 7f3d96a00640 1 -- 172.21.15.40:0/3449167386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d901f8510 con 0x7f3d9015baa0 2024-09-11T00:24:05.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.377+0000 7f3d96a00640 1 -- 172.21.15.40:0/3449167386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d901f8ad0 con 0x7f3d9015baa0 2024-09-11T00:24:05.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.378+0000 7f3d96a00640 1 -- 172.21.15.40:0/3449167386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d9015cef0 con 0x7f3d9015baa0 2024-09-11T00:24:05.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.379+0000 7f3d8d600640 1 -- 172.21.15.40:0/3449167386 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3d8801c460 con 0x7f3d9015baa0 2024-09-11T00:24:05.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.380+0000 7f3d8d600640 1 --2- 172.21.15.40:0/3449167386 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f3d70077f70 0x7f3d7007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:05.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.380+0000 7f3d8d600640 1 -- 172.21.15.40:0/3449167386 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3d88099b40 con 0x7f3d9015baa0 2024-09-11T00:24:05.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.381+0000 7f3d95600640 1 --2- 172.21.15.40:0/3449167386 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f3d70077f70 0x7f3d7007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:05.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.381+0000 7f3d95600640 1 --2- 172.21.15.40:0/3449167386 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f3d70077f70 0x7f3d7007a430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3d84034000 tx=0x7f3d84004ab0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:05.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.384+0000 7f3d8d600640 1 -- 172.21.15.40:0/3449167386 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3d9015cef0 con 0x7f3d9015baa0 2024-09-11T00:24:05.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.579+0000 7f3d96a00640 1 -- 172.21.15.40:0/3449167386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d9006ef40 con 0x7f3d9015baa0 2024-09-11T00:24:05.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.581+0000 7f3d8d600640 1 -- 172.21.15.40:0/3449167386 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16641 (secure 0 0 0) 0x7f3d880625a0 con 0x7f3d9015baa0 2024-09-11T00:24:05.582 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:05.582 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":22,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","created":"2024-09-11T00:23:22.512139+0000","modified":"2024-09-11T00:23:49.924132+0000","last_up_change":"2024-09-11T00:23:36.842446+0000","last_in_change":"2024-09-11T00:23:26.734953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:23:37.800502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:23:46.379819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:23:47.307802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee10e123-8817-4d94-a340-73d00121af37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6801","nonce":973366008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6803","nonce":973366008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6807","nonce":973366008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6805","nonce":973366008}]},"public_addr":"172.21.15.40:6801/973366008","cluster_addr":"172.21.15.40:6803/973366008","heartbeat_back_addr":"172.21.15.40:6807/973366008","heartbeat_front_addr":"172.21.15.40:6805/973366008","state":["exists","up"]},{"osd":1,"uuid":"f90895e9-8660-42b9-8aba-3f9d4d130b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6823","nonce":2542266029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6827","nonce":2542266029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6831","nonce":2542266029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6829","nonce":2542266029}]},"public_addr":"172.21.15.40:6823/2542266029","cluster_addr":"172.21.15.40:6827/2542266029","heartbeat_back_addr":"172.21.15.40:6831/2542266029","heartbeat_front_addr":"172.21.15.40:6829/2542266029","state":["exists","up"]},{"osd":2,"uuid":"a190497a-2aba-4748-8f1d-7e372259d65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6815","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6817","nonce":559505356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6819","nonce":559505356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6826","nonce":559505356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6822","nonce":559505356}]},"public_addr":"172.21.15.40:6817/559505356","cluster_addr":"172.21.15.40:6819/559505356","heartbeat_back_addr":"172.21.15.40:6826/559505356","heartbeat_front_addr":"172.21.15.40:6822/559505356","state":["exists","up"]},{"osd":3,"uuid":"8be32ced-898a-46f2-b850-1517667766b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6809","nonce":503633839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6811","nonce":503633839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6816","nonce":503633839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6813","nonce":503633839}]},"public_addr":"172.21.15.40:6809/503633839","cluster_addr":"172.21.15.40:6811/503633839","heartbeat_back_addr":"172.21.15.40:6816/503633839","heartbeat_front_addr":"172.21.15.40:6813/503633839","state":["exists","up"]},{"osd":4,"uuid":"9867fdfc-6f93-466e-b768-b5a1da7157de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6811","nonce":2418348042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6813","nonce":2418348042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6817","nonce":2418348042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6815","nonce":2418348042}]},"public_addr":"172.21.15.175:6811/2418348042","cluster_addr":"172.21.15.175:6813/2418348042","heartbeat_back_addr":"172.21.15.175:6817/2418348042","heartbeat_front_addr":"172.21.15.175:6815/2418348042","state":["exists","up"]},{"osd":5,"uuid":"e2f6f616-b5db-466e-942f-e2762171a8ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6827","nonce":520822300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6829","nonce":520822300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6833","nonce":520822300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6831","nonce":520822300}]},"public_addr":"172.21.15.175:6827/520822300","cluster_addr":"172.21.15.175:6829/520822300","heartbeat_back_addr":"172.21.15.175:6833/520822300","heartbeat_front_addr":"172.21.15.175:6831/520822300","state":["exists","up"]},{"osd":6,"uuid":"807ac045-bf63-4ff6-9a06-7f7022f9ef32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6819","nonce":1431736593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6821","nonce":1431736593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6825","nonce":1431736593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6823","nonce":1431736593}]},"public_addr":"172.21.15.175:6819/1431736593","cluster_addr":"172.21.15.175:6821/1431736593","heartbeat_back_addr":"172.21.15.175:6825/1431736593","heartbeat_front_addr":"172.21.15.175:6823/1431736593","state":["exists","up"]},{"osd":7,"uuid":"8e0b3293-390f-4b43-b29d-babdc5e88f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6803","nonce":3300317000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6805","nonce":3300317000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6809","nonce":3300317000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6807","nonce":3300317000}]},"public_addr":"172.21.15.175:6803/3300317000","cluster_addr":"172.21.15.175:6805/3300317000","heartbeat_back_addr":"172.21.15.175:6809/3300317000","heartbeat_front_addr":"172.21.15.175:6807/3300317000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:32.967062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.266558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.063509+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.616332+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.431077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.866822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.645225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.016210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:24:05.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.583+0000 7f3d96a00640 1 -- 172.21.15.40:0/3449167386 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f3d70077f70 msgr2=0x7f3d7007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:05.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.583+0000 7f3d96a00640 1 --2- 172.21.15.40:0/3449167386 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f3d70077f70 0x7f3d7007a430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3d84034000 tx=0x7f3d84004ab0 comp rx=0 tx=0).stop 2024-09-11T00:24:05.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.583+0000 7f3d96a00640 1 -- 172.21.15.40:0/3449167386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d9015baa0 msgr2=0x7f3d900b3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:05.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.583+0000 7f3d96a00640 1 --2- 172.21.15.40:0/3449167386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d9015baa0 0x7f3d900b3610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800c400 tx=0x7f3d8800c8c0 comp rx=0 tx=0).stop 2024-09-11T00:24:05.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.583+0000 7f3d96a00640 1 -- 172.21.15.40:0/3449167386 shutdown_connections 2024-09-11T00:24:05.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.583+0000 7f3d96a00640 1 --2- 172.21.15.40:0/3449167386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d9015baa0 0x7f3d900b3610 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:05.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.583+0000 7f3d96a00640 1 --2- 172.21.15.40:0/3449167386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d900ae640 0x7f3d900c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:05.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.583+0000 7f3d96a00640 1 --2- 172.21.15.40:0/3449167386 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f3d70077f70 0x7f3d7007a430 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:05.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.583+0000 7f3d96a00640 1 --2- 172.21.15.40:0/3449167386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d90073f40 0x7f3d90157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:05.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.583+0000 7f3d96a00640 1 -- 172.21.15.40:0/3449167386 >> 172.21.15.40:0/3449167386 conn(0x7f3d900cf770 msgr2=0x7f3d900cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:05.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.583+0000 7f3d96a00640 1 -- 172.21.15.40:0/3449167386 shutdown_connections 2024-09-11T00:24:05.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.583+0000 7f3d96a00640 1 -- 172.21.15.40:0/3449167386 wait complete. 2024-09-11T00:24:05.600 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:24:05.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.757+0000 7fb081400640 1 -- 172.21.15.40:0/1200851070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb07c06e910 msgr2=0x7fb07c06ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:05.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.757+0000 7fb081400640 1 --2- 172.21.15.40:0/1200851070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb07c06e910 0x7fb07c06ed80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb074009830 tx=0x7fb07402a510 comp rx=0 tx=0).stop 2024-09-11T00:24:05.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.757+0000 7fb081400640 1 -- 172.21.15.40:0/1200851070 shutdown_connections 2024-09-11T00:24:05.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.757+0000 7fb081400640 1 --2- 172.21.15.40:0/1200851070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb07c06e910 0x7fb07c06ed80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:05.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.757+0000 7fb081400640 1 --2- 172.21.15.40:0/1200851070 >> v2:172.21.15.175:3300/0 conn(0x7fb07c0cc180 0x7fb07c0cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:05.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.758+0000 7fb081400640 1 -- 172.21.15.40:0/1200851070 >> 172.21.15.40:0/1200851070 conn(0x7fb07c0cfbb0 msgr2=0x7fb07c0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:05.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.758+0000 7fb081400640 1 -- 172.21.15.40:0/1200851070 shutdown_connections 2024-09-11T00:24:05.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.758+0000 7fb081400640 1 -- 172.21.15.40:0/1200851070 wait complete. 2024-09-11T00:24:05.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.759+0000 7fb081400640 1 Processor -- start 2024-09-11T00:24:05.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.759+0000 7fb081400640 1 -- start start 2024-09-11T00:24:05.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.760+0000 7fb081400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb07c06e910 0x7fb07c148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:05.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.760+0000 7fb081400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb07c0cc180 0x7fb07c15e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:05.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.760+0000 7fb081400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb07c15bcc0 0x7fb07c15e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.760+0000 7fb081400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c06f2c0 con 0x7fb07c06e910 2024-09-11T00:24:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.760+0000 7fb081400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c15f9d0 con 0x7fb07c15bcc0 2024-09-11T00:24:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.760+0000 7fb081400640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb07c06f440 con 0x7fb07c0cc180 2024-09-11T00:24:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.760+0000 7fb07a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb07c06e910 0x7fb07c148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.760+0000 7fb07a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb07c06e910 0x7fb07c148360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39860/0 (socket says 172.21.15.40:39860) 2024-09-11T00:24:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.760+0000 7fb07a800640 1 -- 172.21.15.40:0/2361259598 learned_addr learned my addr 172.21.15.40:0/2361259598 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.761+0000 7fb071e00640 1 --2- 172.21.15.40:0/2361259598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb07c0cc180 0x7fb07c15e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.761+0000 7fb07a800640 1 -- 172.21.15.40:0/2361259598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb07c0cc180 msgr2=0x7fb07c15e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.761+0000 7fb07b200640 1 --2- 172.21.15.40:0/2361259598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb07c15bcc0 0x7fb07c15e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.761+0000 7fb07a800640 1 --2- 172.21.15.40:0/2361259598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb07c0cc180 0x7fb07c15e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.761+0000 7fb07a800640 1 -- 172.21.15.40:0/2361259598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb07c15bcc0 msgr2=0x7fb07c15e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.761+0000 7fb07a800640 1 --2- 172.21.15.40:0/2361259598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb07c15bcc0 0x7fb07c15e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:05.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.761+0000 7fb07a800640 1 -- 172.21.15.40:0/2361259598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07c15f120 con 0x7fb07c06e910 2024-09-11T00:24:05.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.761+0000 7fb071e00640 1 --2- 172.21.15.40:0/2361259598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb07c0cc180 0x7fb07c15e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:05.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.761+0000 7fb07b200640 1 --2- 172.21.15.40:0/2361259598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb07c15bcc0 0x7fb07c15e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:05.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.761+0000 7fb07a800640 1 --2- 172.21.15.40:0/2361259598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb07c06e910 0x7fb07c148360 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00cb70 tx=0x7fb06c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:05.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.761+0000 7fb073400640 1 -- 172.21.15.40:0/2361259598 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c016020 con 0x7fb07c06e910 2024-09-11T00:24:05.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.761+0000 7fb073400640 1 -- 172.21.15.40:0/2361259598 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb06c00ae50 con 0x7fb07c06e910 2024-09-11T00:24:05.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.761+0000 7fb081400640 1 -- 172.21.15.40:0/2361259598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb07c15ee40 con 0x7fb07c06e910 2024-09-11T00:24:05.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.761+0000 7fb073400640 1 -- 172.21.15.40:0/2361259598 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c012680 con 0x7fb07c06e910 2024-09-11T00:24:05.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.762+0000 7fb081400640 1 -- 172.21.15.40:0/2361259598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb07c1f5da0 con 0x7fb07c06e910 2024-09-11T00:24:05.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.763+0000 7fb081400640 1 -- 172.21.15.40:0/2361259598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb07c070790 con 0x7fb07c06e910 2024-09-11T00:24:05.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.764+0000 7fb073400640 1 -- 172.21.15.40:0/2361259598 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb06c012820 con 0x7fb07c06e910 2024-09-11T00:24:05.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.765+0000 7fb073400640 1 --2- 172.21.15.40:0/2361259598 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb058077f70 0x7fb05807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:05.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.765+0000 7fb073400640 1 -- 172.21.15.40:0/2361259598 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb06c09a4c0 con 0x7fb07c06e910 2024-09-11T00:24:05.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.766+0000 7fb071e00640 1 --2- 172.21.15.40:0/2361259598 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb058077f70 0x7fb05807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:05.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.766+0000 7fb071e00640 1 --2- 172.21.15.40:0/2361259598 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb058077f70 0x7fb05807a430 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0c69a0 tx=0x7fb064005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:05.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:05.769+0000 7fb073400640 1 -- 172.21.15.40:0/2361259598 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb07c070790 con 0x7fb07c06e910 2024-09-11T00:24:06.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.001+0000 7fb081400640 1 -- 172.21.15.40:0/2361259598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb07c06f9d0 con 0x7fb07c06e910 2024-09-11T00:24:06.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.002+0000 7fb073400640 1 -- 172.21.15.40:0/2361259598 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7fb06c020030 con 0x7fb07c06e910 2024-09-11T00:24:06.003 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:06.003 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"btime":"2024-09-11T00:23:51:938503+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3825015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3825015784},{"type":"v1","addr":"172.21.15.175:6836","nonce":3825015784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4334,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1127011821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1127011821},{"type":"v1","addr":"172.21.15.175:6837","nonce":1127011821}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2724658296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2724658296},{"type":"v1","addr":"172.21.15.40:6833","nonce":2724658296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:23:48.351685+0000","modified":"2024-09-11T00:23:51.368958+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4356":{"gid":4356,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3237981730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3237981730},{"type":"v1","addr":"172.21.15.40:6835","nonce":3237981730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4356,"qdb_cluster":[4356]},"id":1}]} 2024-09-11T00:24:06.003 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-11T00:24:06.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.004+0000 7fb081400640 1 -- 172.21.15.40:0/2361259598 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb058077f70 msgr2=0x7fb05807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:06.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.004+0000 7fb081400640 1 --2- 172.21.15.40:0/2361259598 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb058077f70 0x7fb05807a430 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0c69a0 tx=0x7fb064005f90 comp rx=0 tx=0).stop 2024-09-11T00:24:06.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.004+0000 7fb081400640 1 -- 172.21.15.40:0/2361259598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb07c06e910 msgr2=0x7fb07c148360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:06.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.004+0000 7fb081400640 1 --2- 172.21.15.40:0/2361259598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb07c06e910 0x7fb07c148360 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00cb70 tx=0x7fb06c00a430 comp rx=0 tx=0).stop 2024-09-11T00:24:06.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.004+0000 7fb081400640 1 -- 172.21.15.40:0/2361259598 shutdown_connections 2024-09-11T00:24:06.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.004+0000 7fb081400640 1 --2- 172.21.15.40:0/2361259598 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb058077f70 0x7fb05807a430 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.004+0000 7fb081400640 1 --2- 172.21.15.40:0/2361259598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb07c15bcc0 0x7fb07c15e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.004+0000 7fb081400640 1 --2- 172.21.15.40:0/2361259598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb07c0cc180 0x7fb07c15e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.004+0000 7fb081400640 1 --2- 172.21.15.40:0/2361259598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb07c06e910 0x7fb07c148360 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.004+0000 7fb081400640 1 -- 172.21.15.40:0/2361259598 >> 172.21.15.40:0/2361259598 conn(0x7fb07c0cfbb0 msgr2=0x7fb07c0c9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:06.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.004+0000 7fb081400640 1 -- 172.21.15.40:0/2361259598 shutdown_connections 2024-09-11T00:24:06.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.004+0000 7fb081400640 1 -- 172.21.15.40:0/2361259598 wait complete. 2024-09-11T00:24:06.425 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T00:23:48.351685+0000', 'modified': '2024-09-11T00:23:51.368958+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4356}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4356': {'gid': 4356, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6835/3237981730', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6834', 'nonce': 3237981730}, {'type': 'v1', 'addr': '172.21.15.40:6835', 'nonce': 3237981730}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4356, 'qdb_cluster': [4356]} 2024-09-11T00:24:06.425 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T00:24:06.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-11T00:24:06.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.588+0000 7fc720000640 1 -- 172.21.15.40:0/995459947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc71815bcc0 msgr2=0x7fc7180cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:06.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.588+0000 7fc720000640 1 --2- 172.21.15.40:0/995459947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc71815bcc0 0x7fc7180cb420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009830 tx=0x7fc70c02a510 comp rx=0 tx=0).stop 2024-09-11T00:24:06.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.588+0000 7fc720000640 1 -- 172.21.15.40:0/995459947 shutdown_connections 2024-09-11T00:24:06.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.588+0000 7fc720000640 1 --2- 172.21.15.40:0/995459947 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7180cba70 0x7fc7180cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.588+0000 7fc720000640 1 --2- 172.21.15.40:0/995459947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc71815bcc0 0x7fc7180cb420 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.588+0000 7fc720000640 1 -- 172.21.15.40:0/995459947 >> 172.21.15.40:0/995459947 conn(0x7fc7180cfbb0 msgr2=0x7fc7180cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:06.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.589+0000 7fc720000640 1 -- 172.21.15.40:0/995459947 shutdown_connections 2024-09-11T00:24:06.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.589+0000 7fc720000640 1 -- 172.21.15.40:0/995459947 wait complete. 2024-09-11T00:24:06.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.590+0000 7fc720000640 1 Processor -- start 2024-09-11T00:24:06.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.590+0000 7fc720000640 1 -- start start 2024-09-11T00:24:06.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.591+0000 7fc720000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7180ca200 0x7fc7180af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:06.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.591+0000 7fc720000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7180cba70 0x7fc7180cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:06.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.591+0000 7fc720000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc71815bcc0 0x7fc718156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:06.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.591+0000 7fc720000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc71815f940 con 0x7fc7180ca200 2024-09-11T00:24:06.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.591+0000 7fc720000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc71815f7c0 con 0x7fc71815bcc0 2024-09-11T00:24:06.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.591+0000 7fc720000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc7180cada0 con 0x7fc7180cba70 2024-09-11T00:24:06.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.591+0000 7fc71d600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7180ca200 0x7fc7180af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.591+0000 7fc71d600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7180ca200 0x7fc7180af010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39870/0 (socket says 172.21.15.40:39870) 2024-09-11T00:24:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.591+0000 7fc71d600640 1 -- 172.21.15.40:0/348572067 learned_addr learned my addr 172.21.15.40:0/348572067 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.592+0000 7fc71cc00640 1 --2- 172.21.15.40:0/348572067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7180cba70 0x7fc7180cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.592+0000 7fc71e000640 1 --2- 172.21.15.40:0/348572067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc71815bcc0 0x7fc718156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.592+0000 7fc71d600640 1 -- 172.21.15.40:0/348572067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7180cba70 msgr2=0x7fc7180cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.592+0000 7fc71d600640 1 --2- 172.21.15.40:0/348572067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7180cba70 0x7fc7180cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.592+0000 7fc71d600640 1 -- 172.21.15.40:0/348572067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc71815bcc0 msgr2=0x7fc718156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.592+0000 7fc71d600640 1 --2- 172.21.15.40:0/348572067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc71815bcc0 0x7fc718156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.592+0000 7fc71d600640 1 -- 172.21.15.40:0/348572067 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7180c9910 con 0x7fc7180ca200 2024-09-11T00:24:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.592+0000 7fc71e000640 1 --2- 172.21.15.40:0/348572067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc71815bcc0 0x7fc718156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.592+0000 7fc71d600640 1 --2- 172.21.15.40:0/348572067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7180ca200 0x7fc7180af010 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc70c02ab00 tx=0x7fc70c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.592+0000 7fc715600640 1 -- 172.21.15.40:0/348572067 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c031d60 con 0x7fc7180ca200 2024-09-11T00:24:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.592+0000 7fc715600640 1 -- 172.21.15.40:0/348572067 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc70c033e10 con 0x7fc7180ca200 2024-09-11T00:24:06.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.592+0000 7fc715600640 1 -- 172.21.15.40:0/348572067 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c005260 con 0x7fc7180ca200 2024-09-11T00:24:06.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.593+0000 7fc720000640 1 -- 172.21.15.40:0/348572067 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7181f57a0 con 0x7fc7180ca200 2024-09-11T00:24:06.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.593+0000 7fc720000640 1 -- 172.21.15.40:0/348572067 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7181f5d60 con 0x7fc7180ca200 2024-09-11T00:24:06.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.595+0000 7fc715600640 1 -- 172.21.15.40:0/348572067 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc70c005400 con 0x7fc7180ca200 2024-09-11T00:24:06.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.596+0000 7fc715600640 1 --2- 172.21.15.40:0/348572067 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc6f8077f70 0x7fc6f807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:06.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.596+0000 7fc715600640 1 -- 172.21.15.40:0/348572067 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc70c0badf0 con 0x7fc7180ca200 2024-09-11T00:24:06.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.596+0000 7fc723048740 1 Processor -- start 2024-09-11T00:24:06.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.596+0000 7fc723048740 1 -- start start 2024-09-11T00:24:06.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.596+0000 7fc71cc00640 1 --2- 172.21.15.40:0/348572067 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc6f8077f70 0x7fc6f807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:06.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.597+0000 7fc71cc00640 1 --2- 172.21.15.40:0/348572067 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc6f8077f70 0x7fc6f807a430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc704005fd0 tx=0x7fc704005850 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:06.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.597+0000 7fc723048740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a876c68b0 0x559a876c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:06.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.597+0000 7fc723048740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a8767bf20 0x559a876a7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:06.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.597+0000 7fc723048740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767b000 0x559a876a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:06.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.597+0000 7fc723048740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x559a87604430 con 0x559a8767b000 2024-09-11T00:24:06.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.597+0000 7fc723048740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559a875f45d0 con 0x559a876c68b0 2024-09-11T00:24:06.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.597+0000 7fc723048740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x559a875e3a00 con 0x559a8767bf20 2024-09-11T00:24:06.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.597+0000 7fc71e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767b000 0x559a876a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:06.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.597+0000 7fc71e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767b000 0x559a876a7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39886/0 (socket says 172.21.15.40:39886) 2024-09-11T00:24:06.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.597+0000 7fc71e000640 1 -- 172.21.15.40:0/2485416694 learned_addr learned my addr 172.21.15.40:0/2485416694 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:06.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.597+0000 7fc71cc00640 1 --2- 172.21.15.40:0/2485416694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a8767bf20 0x559a876a7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:06.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.597+0000 7fc71d600640 1 --2- 172.21.15.40:0/2485416694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a876c68b0 0x559a876c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:06.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.598+0000 7fc71e000640 1 -- 172.21.15.40:0/2485416694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a8767bf20 msgr2=0x559a876a7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:06.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.598+0000 7fc71e000640 1 --2- 172.21.15.40:0/2485416694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a8767bf20 0x559a876a7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.598+0000 7fc71e000640 1 -- 172.21.15.40:0/2485416694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a876c68b0 msgr2=0x559a876c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:06.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.598+0000 7fc71e000640 1 --2- 172.21.15.40:0/2485416694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a876c68b0 0x559a876c6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.598+0000 7fc71e000640 1 -- 172.21.15.40:0/2485416694 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a875ac520 con 0x559a8767b000 2024-09-11T00:24:06.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.598+0000 7fc71e000640 1 --2- 172.21.15.40:0/2485416694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767b000 0x559a876a7b50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc710001e10 tx=0x7fc71000d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3075ec6cda12d384 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:06.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.598+0000 7fc709c00640 1 -- 172.21.15.40:0/2485416694 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc710018070 con 0x559a8767b000 2024-09-11T00:24:06.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.598+0000 7fc709c00640 1 -- 172.21.15.40:0/2485416694 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc710003990 con 0x559a8767b000 2024-09-11T00:24:06.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.598+0000 7fc709c00640 1 -- 172.21.15.40:0/2485416694 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc710003da0 con 0x559a8767b000 2024-09-11T00:24:06.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.599+0000 7fc723048740 1 -- 172.21.15.40:0/2485416694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767b000 msgr2=0x559a876a7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:06.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.599+0000 7fc723048740 1 --2- 172.21.15.40:0/2485416694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767b000 0x559a876a7b50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc710001e10 tx=0x7fc71000d520 comp rx=0 tx=0).stop 2024-09-11T00:24:06.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.599+0000 7fc723048740 1 -- 172.21.15.40:0/2485416694 shutdown_connections 2024-09-11T00:24:06.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.599+0000 7fc723048740 1 --2- 172.21.15.40:0/2485416694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767b000 0x559a876a7b50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.599+0000 7fc723048740 1 --2- 172.21.15.40:0/2485416694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a8767bf20 0x559a876a7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.599+0000 7fc723048740 1 --2- 172.21.15.40:0/2485416694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a876c68b0 0x559a876c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.599+0000 7fc723048740 1 -- 172.21.15.40:0/2485416694 >> 172.21.15.40:0/2485416694 conn(0x559a8767cff0 msgr2=0x559a87680a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:06.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.599+0000 7fc723048740 1 -- 172.21.15.40:0/2485416694 shutdown_connections 2024-09-11T00:24:06.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.599+0000 7fc723048740 1 -- 172.21.15.40:0/2485416694 wait complete. 2024-09-11T00:24:06.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.600+0000 7fc723048740 1 -- start start 2024-09-11T00:24:06.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.600+0000 7fc723048740 1 Processor -- start 2024-09-11T00:24:06.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.601+0000 7fc723048740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767bf20 0x559a876a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:06.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.601+0000 7fc723048740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a876c68b0 0x559a876bc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:06.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.601+0000 7fc723048740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a876a1af0 0x559a876bcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:06.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.601+0000 7fc723048740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x559a8758a330 con 0x559a8767bf20 2024-09-11T00:24:06.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.601+0000 7fc723048740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559a875e7810 con 0x559a876c68b0 2024-09-11T00:24:06.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.601+0000 7fc723048740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x559a87354620 con 0x559a876a1af0 2024-09-11T00:24:06.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.601+0000 7fc723048740 10 client.0 _ll_register_callbacks cb 0x559a8758f420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:24:06.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.601+0000 7fc71d600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767bf20 0x559a876a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:06.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.601+0000 7fc71d600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767bf20 0x559a876a0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39898/0 (socket says 172.21.15.40:39898) 2024-09-11T00:24:06.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.601+0000 7fc71d600640 1 -- 172.21.15.40:0/605944789 learned_addr learned my addr 172.21.15.40:0/605944789 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:06.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.601+0000 7fc71cc00640 1 --2- 172.21.15.40:0/605944789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a876c68b0 0x559a876bc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:06.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.601+0000 7fc71e000640 1 --2- 172.21.15.40:0/605944789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a876a1af0 0x559a876bcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:06.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.602+0000 7fc71d600640 1 -- 172.21.15.40:0/605944789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a876a1af0 msgr2=0x559a876bcb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:06.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.602+0000 7fc71d600640 1 --2- 172.21.15.40:0/605944789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a876a1af0 0x559a876bcb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.602+0000 7fc71d600640 1 -- 172.21.15.40:0/605944789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a876c68b0 msgr2=0x559a876bc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:06.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.602+0000 7fc71d600640 1 --2- 172.21.15.40:0/605944789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a876c68b0 0x559a876bc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.602+0000 7fc71d600640 1 -- 172.21.15.40:0/605944789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a87345850 con 0x559a8767bf20 2024-09-11T00:24:06.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.602+0000 7fc71e000640 1 --2- 172.21.15.40:0/605944789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a876a1af0 0x559a876bcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:06.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.602+0000 7fc71d600640 1 --2- 172.21.15.40:0/605944789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767bf20 0x559a876a0db0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc70c080450 tx=0x7fc70c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44921b72967bdba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:06.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.602+0000 7fc6fe000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-09-11T00:24:06.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.602+0000 7fc6fe000640 1 -- 172.21.15.40:0/605944789 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c048030 con 0x559a8767bf20 2024-09-11T00:24:06.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.602+0000 7fc6fe000640 1 -- 172.21.15.40:0/605944789 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc70c08c450 con 0x559a8767bf20 2024-09-11T00:24:06.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.602+0000 7fc723048740 1 -- 172.21.15.40:0/605944789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc710003990 con 0x559a8767bf20 2024-09-11T00:24:06.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.602+0000 7fc6fe000640 1 -- 172.21.15.40:0/605944789 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fc70c082950 con 0x559a8767bf20 2024-09-11T00:24:06.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.602+0000 7fc723048740 10 client.4701 fetch_fsmap learned FSMap version 8 2024-09-11T00:24:06.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.602+0000 7fc723048740 1 -- 172.21.15.40:0/605944789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x559a873bc6b0 con 0x559a8767bf20 2024-09-11T00:24:06.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.603+0000 7fc6fe000640 1 -- 172.21.15.40:0/605944789 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc710003990 con 0x559a8767bf20 2024-09-11T00:24:06.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.603+0000 7fc6fe000640 1 -- 172.21.15.40:0/605944789 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fc70c082440 con 0x559a8767bf20 2024-09-11T00:24:06.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.603+0000 7fc723048740 10 client.4701 fetch_fsmap finished waiting for FSMap version 8 2024-09-11T00:24:06.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.603+0000 7fc723048740 10 client.4701 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T00:24:06.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.603+0000 7fc723048740 20 client.4701 populate_metadata read hostname 'smithi040' 2024-09-11T00:24:06.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.603+0000 7fc723048740 1 --2- 172.21.15.40:0/605944789 >> [v2:172.21.15.40:6834/3237981730,v1:172.21.15.40:6835/3237981730] conn(0x559a876bdf00 0x559a876e8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:06.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.603+0000 7fc723048740 4 client.4701 mds_command: new command op to 4356 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:24:06.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.603+0000 7fc723048740 1 -- 172.21.15.40:0/605944789 --> [v2:172.21.15.40:6834/3237981730,v1:172.21.15.40:6835/3237981730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a875f6520 con 0x559a876bdf00 2024-09-11T00:24:06.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.603+0000 7fc71cc00640 1 --2- 172.21.15.40:0/605944789 >> [v2:172.21.15.40:6834/3237981730,v1:172.21.15.40:6835/3237981730] conn(0x559a876bdf00 0x559a876e8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:06.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.604+0000 7fc71cc00640 1 --2- 172.21.15.40:0/605944789 >> [v2:172.21.15.40:6834/3237981730,v1:172.21.15.40:6835/3237981730] conn(0x559a876bdf00 0x559a876e8540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa7fe7305c4a789b server_cookie=f22cfcb306542db in_seq=0 out_seq=0 2024-09-11T00:24:06.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.604+0000 7fc6fe000640 10 client.4701 ms_handle_connect on v2:172.21.15.40:6834/3237981730 2024-09-11T00:24:06.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.604+0000 7fc6fe000640 1 -- 172.21.15.40:0/605944789 <== mds.0 v2:172.21.15.40:6834/3237981730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a875f6520 con 0x559a876bdf00 2024-09-11T00:24:06.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.604+0000 7fc6fe000640 10 client.4701 handle_command_reply: tid=0 2024-09-11T00:24:06.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.604+0000 7fc723048740 1 client.4701 shutdown 2024-09-11T00:24:06.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.605+0000 7fc723048740 1 -- 172.21.15.40:0/605944789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767bf20 msgr2=0x559a876a0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:06.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.605+0000 7fc723048740 1 --2- 172.21.15.40:0/605944789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767bf20 0x559a876a0db0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc70c080450 tx=0x7fc70c005f90 comp rx=0 tx=0).stop 2024-09-11T00:24:06.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.605+0000 7fc723048740 1 -- 172.21.15.40:0/605944789 shutdown_connections 2024-09-11T00:24:06.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.605+0000 7fc723048740 1 --2- 172.21.15.40:0/605944789 >> [v2:172.21.15.40:6834/3237981730,v1:172.21.15.40:6835/3237981730] conn(0x559a876bdf00 0x559a876e8540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.605+0000 7fc723048740 1 --2- 172.21.15.40:0/605944789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a876a1af0 0x559a876bcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.605+0000 7fc723048740 1 --2- 172.21.15.40:0/605944789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a876c68b0 0x559a876bc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.605+0000 7fc723048740 1 --2- 172.21.15.40:0/605944789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767bf20 0x559a876a0db0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.605+0000 7fc6fe000640 0 client.4701 ms_handle_reset on v2:172.21.15.40:6834/3237981730 2024-09-11T00:24:06.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.605+0000 7fc723048740 1 -- 172.21.15.40:0/605944789 >> 172.21.15.40:0/605944789 conn(0x559a8767b000 msgr2=0x559a87680c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:06.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.605+0000 7fc723048740 1 -- 172.21.15.40:0/605944789 shutdown_connections 2024-09-11T00:24:06.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.605+0000 7fc723048740 1 -- 172.21.15.40:0/605944789 wait complete. 2024-09-11T00:24:06.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.605+0000 7fc723048740 20 client.4701 trim_cache size 0 max 16384 2024-09-11T00:24:06.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.624+0000 7fc723048740 1 Processor -- start 2024-09-11T00:24:06.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.624+0000 7fc723048740 1 -- start start 2024-09-11T00:24:06.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.625+0000 7fc723048740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a8767bf20 0x559a876a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:06.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.625+0000 7fc723048740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a876a1af0 0x559a8767b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:06.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.625+0000 7fc723048740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a876c68b0 0x559a8767b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:06.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.625+0000 7fc723048740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc7181fcb90 con 0x559a876c68b0 2024-09-11T00:24:06.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.625+0000 7fc723048740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc7180cefe0 con 0x559a8767bf20 2024-09-11T00:24:06.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.625+0000 7fc723048740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc71815cb30 con 0x559a876a1af0 2024-09-11T00:24:06.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.625+0000 7fc71e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a876c68b0 0x559a8767b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:06.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.625+0000 7fc71e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a876c68b0 0x559a8767b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39908/0 (socket says 172.21.15.40:39908) 2024-09-11T00:24:06.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.625+0000 7fc71e000640 1 -- 172.21.15.40:0/505752107 learned_addr learned my addr 172.21.15.40:0/505752107 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:06.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.626+0000 7fc71d600640 1 --2- 172.21.15.40:0/505752107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a8767bf20 0x559a876a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:06.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.626+0000 7fc71cc00640 1 --2- 172.21.15.40:0/505752107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a876a1af0 0x559a8767b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:06.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.626+0000 7fc71e000640 1 -- 172.21.15.40:0/505752107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a876a1af0 msgr2=0x559a8767b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:06.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.626+0000 7fc71e000640 1 --2- 172.21.15.40:0/505752107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a876a1af0 0x559a8767b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.626+0000 7fc71e000640 1 -- 172.21.15.40:0/505752107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a8767bf20 msgr2=0x559a876a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:06.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.626+0000 7fc71e000640 1 --2- 172.21.15.40:0/505752107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a8767bf20 0x559a876a09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.626+0000 7fc71e000640 1 -- 172.21.15.40:0/505752107 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a876c4890 con 0x559a876c68b0 2024-09-11T00:24:06.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.626+0000 7fc71e000640 1 --2- 172.21.15.40:0/505752107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a876c68b0 0x559a8767b920 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc71000ddc0 tx=0x7fc710001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c64bef6c32bd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:06.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.626+0000 7fc709200640 1 -- 172.21.15.40:0/505752107 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc710023070 con 0x559a876c68b0 2024-09-11T00:24:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.626+0000 7fc709200640 1 -- 172.21.15.40:0/505752107 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc710003a60 con 0x559a876c68b0 2024-09-11T00:24:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.626+0000 7fc709200640 1 -- 172.21.15.40:0/505752107 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc710018040 con 0x559a876c68b0 2024-09-11T00:24:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.627+0000 7fc723048740 1 -- 172.21.15.40:0/505752107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a876c68b0 msgr2=0x559a8767b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.627+0000 7fc723048740 1 --2- 172.21.15.40:0/505752107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a876c68b0 0x559a8767b920 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc71000ddc0 tx=0x7fc710001250 comp rx=0 tx=0).stop 2024-09-11T00:24:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.627+0000 7fc723048740 1 -- 172.21.15.40:0/505752107 shutdown_connections 2024-09-11T00:24:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.627+0000 7fc723048740 1 --2- 172.21.15.40:0/505752107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a876c68b0 0x559a8767b920 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.627+0000 7fc723048740 1 --2- 172.21.15.40:0/505752107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a876a1af0 0x559a8767b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.627+0000 7fc723048740 1 --2- 172.21.15.40:0/505752107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a8767bf20 0x559a876a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.627+0000 7fc723048740 1 -- 172.21.15.40:0/505752107 >> 172.21.15.40:0/505752107 conn(0x559a8767b000 msgr2=0x559a8767e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.627+0000 7fc723048740 1 -- 172.21.15.40:0/505752107 shutdown_connections 2024-09-11T00:24:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.627+0000 7fc723048740 1 -- 172.21.15.40:0/505752107 wait complete. 2024-09-11T00:24:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.628+0000 7fc723048740 1 -- start start 2024-09-11T00:24:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.628+0000 7fc723048740 1 Processor -- start 2024-09-11T00:24:06.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.629+0000 7fc723048740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767bf20 0x559a876bef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:06.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.629+0000 7fc723048740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a876a1af0 0x559a8767b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:06.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.629+0000 7fc723048740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a876c68b0 0x559a8767b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:06.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.629+0000 7fc723048740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x559a8758a330 con 0x559a8767bf20 2024-09-11T00:24:06.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.629+0000 7fc723048740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc7180ce990 con 0x559a876a1af0 2024-09-11T00:24:06.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.629+0000 7fc723048740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x559a876a15f0 con 0x559a876c68b0 2024-09-11T00:24:06.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.629+0000 7fc723048740 10 client.0 _ll_register_callbacks cb 0x7fc70c0097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:24:06.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.629+0000 7fc71d600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767bf20 0x559a876bef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.629+0000 7fc71d600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767bf20 0x559a876bef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39914/0 (socket says 172.21.15.40:39914) 2024-09-11T00:24:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.629+0000 7fc71d600640 1 -- 172.21.15.40:0/915841842 learned_addr learned my addr 172.21.15.40:0/915841842 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.629+0000 7fc71cc00640 1 --2- 172.21.15.40:0/915841842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a876a1af0 0x559a8767b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.629+0000 7fc71e000640 1 --2- 172.21.15.40:0/915841842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a876c68b0 0x559a8767b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.629+0000 7fc71d600640 1 -- 172.21.15.40:0/915841842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a876c68b0 msgr2=0x559a8767b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.629+0000 7fc71d600640 1 --2- 172.21.15.40:0/915841842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a876c68b0 0x559a8767b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.629+0000 7fc71d600640 1 -- 172.21.15.40:0/915841842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a876a1af0 msgr2=0x559a8767b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.629+0000 7fc71d600640 1 --2- 172.21.15.40:0/915841842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a876a1af0 0x559a8767b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.629+0000 7fc71d600640 1 -- 172.21.15.40:0/915841842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a876aa2f0 con 0x559a8767bf20 2024-09-11T00:24:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.629+0000 7fc71e000640 1 --2- 172.21.15.40:0/915841842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a876c68b0 0x559a8767b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.630+0000 7fc71d600640 1 --2- 172.21.15.40:0/915841842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767bf20 0x559a876bef90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc70c09a040 tx=0x7fc70c08c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253ef52cfba98f83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.630+0000 7fc6fe000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-09-11T00:24:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.630+0000 7fc6fe000640 1 -- 172.21.15.40:0/915841842 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c048070 con 0x559a8767bf20 2024-09-11T00:24:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.630+0000 7fc6fe000640 1 -- 172.21.15.40:0/915841842 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc70c07eb30 con 0x559a8767bf20 2024-09-11T00:24:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.630+0000 7fc723048740 1 -- 172.21.15.40:0/915841842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc710003a60 con 0x559a8767bf20 2024-09-11T00:24:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.630+0000 7fc6fe000640 1 -- 172.21.15.40:0/915841842 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fc70c07f080 con 0x559a8767bf20 2024-09-11T00:24:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.630+0000 7fc723048740 10 client.4707 fetch_fsmap learned FSMap version 8 2024-09-11T00:24:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.630+0000 7fc723048740 1 -- 172.21.15.40:0/915841842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x559a8774e0b0 con 0x559a8767bf20 2024-09-11T00:24:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.630+0000 7fc6fe000640 1 -- 172.21.15.40:0/915841842 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc710003a60 con 0x559a8767bf20 2024-09-11T00:24:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.630+0000 7fc6fe000640 1 -- 172.21.15.40:0/915841842 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fc70c07ed30 con 0x559a8767bf20 2024-09-11T00:24:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.630+0000 7fc723048740 10 client.4707 fetch_fsmap finished waiting for FSMap version 8 2024-09-11T00:24:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.630+0000 7fc723048740 10 client.4707 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T00:24:06.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.630+0000 7fc723048740 20 client.4707 populate_metadata read hostname 'smithi040' 2024-09-11T00:24:06.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.630+0000 7fc723048740 1 --2- 172.21.15.40:0/915841842 >> [v2:172.21.15.40:6834/3237981730,v1:172.21.15.40:6835/3237981730] conn(0x559a8774b2d0 0x559a876a2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:06.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.630+0000 7fc723048740 4 client.4707 mds_command: new command op to 4356 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T00:24:06.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.630+0000 7fc723048740 1 -- 172.21.15.40:0/915841842 --> [v2:172.21.15.40:6834/3237981730,v1:172.21.15.40:6835/3237981730] -- command(tid 0: {"prefix": "status"}) -- 0x559a875f1fd0 con 0x559a8774b2d0 2024-09-11T00:24:06.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.631+0000 7fc71cc00640 1 --2- 172.21.15.40:0/915841842 >> [v2:172.21.15.40:6834/3237981730,v1:172.21.15.40:6835/3237981730] conn(0x559a8774b2d0 0x559a876a2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:06.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.631+0000 7fc71cc00640 1 --2- 172.21.15.40:0/915841842 >> [v2:172.21.15.40:6834/3237981730,v1:172.21.15.40:6835/3237981730] conn(0x559a8774b2d0 0x559a876a2880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28ee02eb204bc636 server_cookie=5e07318adc6fda3a in_seq=0 out_seq=0 2024-09-11T00:24:06.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.631+0000 7fc6fe000640 10 client.4707 ms_handle_connect on v2:172.21.15.40:6834/3237981730 2024-09-11T00:24:06.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.631+0000 7fc6fe000640 1 -- 172.21.15.40:0/915841842 <== mds.0 v2:172.21.15.40:6834/3237981730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x559a875f1fd0 con 0x559a8774b2d0 2024-09-11T00:24:06.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.631+0000 7fc6fe000640 10 client.4707 handle_command_reply: tid=0 2024-09-11T00:24:06.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.631+0000 7fc723048740 1 client.4707 shutdown 2024-09-11T00:24:06.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.632+0000 7fc723048740 1 -- 172.21.15.40:0/915841842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767bf20 msgr2=0x559a876bef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:06.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.632+0000 7fc723048740 1 --2- 172.21.15.40:0/915841842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767bf20 0x559a876bef90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc70c09a040 tx=0x7fc70c08c480 comp rx=0 tx=0).stop 2024-09-11T00:24:06.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.632+0000 7fc723048740 1 -- 172.21.15.40:0/915841842 shutdown_connections 2024-09-11T00:24:06.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.632+0000 7fc723048740 1 --2- 172.21.15.40:0/915841842 >> [v2:172.21.15.40:6834/3237981730,v1:172.21.15.40:6835/3237981730] conn(0x559a8774b2d0 0x559a876a2880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.632+0000 7fc723048740 1 --2- 172.21.15.40:0/915841842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x559a876c68b0 0x559a8767b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.632+0000 7fc723048740 1 --2- 172.21.15.40:0/915841842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a876a1af0 0x559a8767b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.632+0000 7fc723048740 1 --2- 172.21.15.40:0/915841842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559a8767bf20 0x559a876bef90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.632+0000 7fc6fe000640 0 client.4707 ms_handle_reset on v2:172.21.15.40:6834/3237981730 2024-09-11T00:24:06.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.632+0000 7fc723048740 1 -- 172.21.15.40:0/915841842 >> 172.21.15.40:0/915841842 conn(0x559a8767b000 msgr2=0x559a876a7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:06.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.632+0000 7fc723048740 1 -- 172.21.15.40:0/915841842 shutdown_connections 2024-09-11T00:24:06.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.632+0000 7fc723048740 1 -- 172.21.15.40:0/915841842 wait complete. 2024-09-11T00:24:06.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.632+0000 7fc723048740 20 client.4707 trim_cache size 0 max 16384 2024-09-11T00:24:06.638 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T00:24:06.639 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "f5cb250f-2a64-4822-87ba-c63d5f030b36", 2024-09-11T00:24:06.639 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2024-09-11T00:24:06.639 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4356, 2024-09-11T00:24:06.639 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-09-11T00:24:06.639 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-09-11T00:24:06.639 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-09-11T00:24:06.639 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 17.72584007, 2024-09-11T00:24:06.639 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 8, 2024-09-11T00:24:06.639 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 22, 2024-09-11T00:24:06.639 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 22, 2024-09-11T00:24:06.639 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 23.756101132000001 2024-09-11T00:24:06.639 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T00:24:06.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.632+0000 7fc720000640 1 -- 172.21.15.40:0/348572067 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc6f8077f70 msgr2=0x7fc6f807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:06.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.632+0000 7fc720000640 1 --2- 172.21.15.40:0/348572067 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc6f8077f70 0x7fc6f807a430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc704005fd0 tx=0x7fc704005850 comp rx=0 tx=0).stop 2024-09-11T00:24:06.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.632+0000 7fc720000640 1 -- 172.21.15.40:0/348572067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7180ca200 msgr2=0x7fc7180af010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:06.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.632+0000 7fc720000640 1 --2- 172.21.15.40:0/348572067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7180ca200 0x7fc7180af010 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc70c02ab00 tx=0x7fc70c033c20 comp rx=0 tx=0).stop 2024-09-11T00:24:06.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.633+0000 7fc720000640 1 -- 172.21.15.40:0/348572067 shutdown_connections 2024-09-11T00:24:06.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.633+0000 7fc720000640 1 --2- 172.21.15.40:0/348572067 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc6f8077f70 0x7fc6f807a430 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.633+0000 7fc720000640 1 --2- 172.21.15.40:0/348572067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc71815bcc0 0x7fc718156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.633+0000 7fc720000640 1 --2- 172.21.15.40:0/348572067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7180cba70 0x7fc7180cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.633+0000 7fc720000640 1 --2- 172.21.15.40:0/348572067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7180ca200 0x7fc7180af010 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:06.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.633+0000 7fc720000640 1 -- 172.21.15.40:0/348572067 >> 172.21.15.40:0/348572067 conn(0x7fc7180cfbb0 msgr2=0x7fc71815b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:06.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.633+0000 7fc720000640 1 -- 172.21.15.40:0/348572067 shutdown_connections 2024-09-11T00:24:06.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:06.633+0000 7fc720000640 1 -- 172.21.15.40:0/348572067 wait complete. 2024-09-11T00:24:06.649 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-11T00:24:06.677 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-11T00:24:06.677 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-11T00:24:06.678 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-11T00:24:06.678 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T00:24:06.678 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T00:24:06.678 INFO:tasks.ceph_fuse:client.2 config is {} 2024-09-11T00:24:06.678 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T00:24:06.678 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-11T00:24:06.678 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-11T00:24:06.678 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T00:24:06.678 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T00:24:06.679 INFO:tasks.ceph_fuse:client.3 config is {} 2024-09-11T00:24:06.679 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T00:24:06.679 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-11T00:24:06.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:06.679 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-09-11T00:24:06.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:06.720 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2024-09-11T00:24:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:Cannot find device "ceph-brx" 2024-09-11T00:24:06.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:24:06.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:06.826 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-09-11T00:24:06.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:06.862 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-09-11T00:24:06.961 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2024-09-11T00:24:06.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:24:06.964 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-11T00:24:06.964 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-11T00:24:06.964 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T00:24:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.124+0000 7f3c0e000640 1 -- 172.21.15.40:0/1203569041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c0815c3b0 msgr2=0x7f3c0815ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.124+0000 7f3c0e000640 1 --2- 172.21.15.40:0/1203569041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c0815c3b0 0x7f3c0815ba60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0005fd0 tx=0x7f3bf002a5d0 comp rx=0 tx=0).stop 2024-09-11T00:24:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.124+0000 7f3c0e000640 1 -- 172.21.15.40:0/1203569041 shutdown_connections 2024-09-11T00:24:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.124+0000 7f3c0e000640 1 --2- 172.21.15.40:0/1203569041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c080cb060 0x7f3c08073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.124+0000 7f3c0e000640 1 --2- 172.21.15.40:0/1203569041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c0815c3b0 0x7f3c0815ba60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.124+0000 7f3c0e000640 1 -- 172.21.15.40:0/1203569041 >> 172.21.15.40:0/1203569041 conn(0x7f3c080cfbb0 msgr2=0x7f3c080cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.124+0000 7f3c0e000640 1 -- 172.21.15.40:0/1203569041 shutdown_connections 2024-09-11T00:24:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.124+0000 7f3c0e000640 1 -- 172.21.15.40:0/1203569041 wait complete. 2024-09-11T00:24:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.126+0000 7f3c0e000640 1 Processor -- start 2024-09-11T00:24:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.126+0000 7f3c0e000640 1 -- start start 2024-09-11T00:24:07.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.127+0000 7f3c0e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c080cb060 0x7f3c081f69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:07.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.127+0000 7f3c0e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c0815c3b0 0x7f3c08153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:07.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.127+0000 7f3c0e000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c0815e100 0x7f3c08156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:07.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.127+0000 7f3c0e000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3c08073b20 con 0x7f3c0815c3b0 2024-09-11T00:24:07.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.127+0000 7f3c0e000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3c080739a0 con 0x7f3c080cb060 2024-09-11T00:24:07.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.127+0000 7f3c0e000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3c08073ca0 con 0x7f3c0815e100 2024-09-11T00:24:07.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.127+0000 7f3bfea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c0815c3b0 0x7f3c08153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:07.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.127+0000 7f3bfea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c0815c3b0 0x7f3c08153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39918/0 (socket says 172.21.15.40:39918) 2024-09-11T00:24:07.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.127+0000 7f3bfea00640 1 -- 172.21.15.40:0/2605925658 learned_addr learned my addr 172.21.15.40:0/2605925658 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:07.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.127+0000 7f3c07400640 1 --2- 172.21.15.40:0/2605925658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c080cb060 0x7f3c081f69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:07.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.127+0000 7f3c07e00640 1 --2- 172.21.15.40:0/2605925658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c0815e100 0x7f3c08156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:07.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.128+0000 7f3bfea00640 1 -- 172.21.15.40:0/2605925658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c0815e100 msgr2=0x7f3c08156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:07.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.128+0000 7f3bfea00640 1 --2- 172.21.15.40:0/2605925658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c0815e100 0x7f3c08156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:07.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.128+0000 7f3bfea00640 1 -- 172.21.15.40:0/2605925658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c080cb060 msgr2=0x7f3c081f69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:07.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.128+0000 7f3bfea00640 1 --2- 172.21.15.40:0/2605925658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c080cb060 0x7f3c081f69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:07.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.128+0000 7f3bfea00640 1 -- 172.21.15.40:0/2605925658 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c081554d0 con 0x7f3c0815c3b0 2024-09-11T00:24:07.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.128+0000 7f3bfea00640 1 --2- 172.21.15.40:0/2605925658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c0815c3b0 0x7f3c08153c20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0009850 tx=0x7f3bf00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:07.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.128+0000 7f3bffe00640 1 -- 172.21.15.40:0/2605925658 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf003f070 con 0x7f3c0815c3b0 2024-09-11T00:24:07.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.128+0000 7f3bffe00640 1 -- 172.21.15.40:0/2605925658 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bf00047a0 con 0x7f3c0815c3b0 2024-09-11T00:24:07.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.128+0000 7f3bffe00640 1 -- 172.21.15.40:0/2605925658 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0035030 con 0x7f3c0815c3b0 2024-09-11T00:24:07.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.128+0000 7f3c0e000640 1 -- 172.21.15.40:0/2605925658 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c081557b0 con 0x7f3c0815c3b0 2024-09-11T00:24:07.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.128+0000 7f3c0e000640 1 -- 172.21.15.40:0/2605925658 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c081f64d0 con 0x7f3c0815c3b0 2024-09-11T00:24:07.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.130+0000 7f3c0e000640 1 -- 172.21.15.40:0/2605925658 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c08073250 con 0x7f3c0815c3b0 2024-09-11T00:24:07.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.131+0000 7f3bffe00640 1 -- 172.21.15.40:0/2605925658 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3bf0004b90 con 0x7f3c0815c3b0 2024-09-11T00:24:07.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.132+0000 7f3bffe00640 1 --2- 172.21.15.40:0/2605925658 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f3be4077f70 0x7f3be407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:07.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.132+0000 7f3bffe00640 1 -- 172.21.15.40:0/2605925658 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3bf00bac20 con 0x7f3c0815c3b0 2024-09-11T00:24:07.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.133+0000 7f3c07400640 1 --2- 172.21.15.40:0/2605925658 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f3be4077f70 0x7f3be407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:07.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.133+0000 7f3c07400640 1 --2- 172.21.15.40:0/2605925658 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f3be4077f70 0x7f3be407a430 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8007fd0 tx=0x7f3bf8009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:07.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.136+0000 7f3bffe00640 1 -- 172.21.15.40:0/2605925658 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3bf0083160 con 0x7f3c0815c3b0 2024-09-11T00:24:07.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.367+0000 7f3c0e000640 1 -- 172.21.15.40:0/2605925658 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3c081f66a0 con 0x7f3c0815c3b0 2024-09-11T00:24:07.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.368+0000 7f3bffe00640 1 -- 172.21.15.40:0/2605925658 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f3bf0087b90 con 0x7f3c0815c3b0 2024-09-11T00:24:07.369 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T00:24:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.370+0000 7f3c0e000640 1 -- 172.21.15.40:0/2605925658 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f3be4077f70 msgr2=0x7f3be407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.370+0000 7f3c0e000640 1 --2- 172.21.15.40:0/2605925658 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f3be4077f70 0x7f3be407a430 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8007fd0 tx=0x7f3bf8009040 comp rx=0 tx=0).stop 2024-09-11T00:24:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.370+0000 7f3c0e000640 1 -- 172.21.15.40:0/2605925658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c0815c3b0 msgr2=0x7f3c08153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.370+0000 7f3c0e000640 1 --2- 172.21.15.40:0/2605925658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c0815c3b0 0x7f3c08153c20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0009850 tx=0x7f3bf00038a0 comp rx=0 tx=0).stop 2024-09-11T00:24:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.370+0000 7f3c0e000640 1 -- 172.21.15.40:0/2605925658 shutdown_connections 2024-09-11T00:24:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.370+0000 7f3c0e000640 1 --2- 172.21.15.40:0/2605925658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c0815e100 0x7f3c08156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.370+0000 7f3c0e000640 1 --2- 172.21.15.40:0/2605925658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c0815c3b0 0x7f3c08153c20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.370+0000 7f3c0e000640 1 --2- 172.21.15.40:0/2605925658 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f3be4077f70 0x7f3be407a430 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.370+0000 7f3c0e000640 1 --2- 172.21.15.40:0/2605925658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c080cb060 0x7f3c081f69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.370+0000 7f3c0e000640 1 -- 172.21.15.40:0/2605925658 >> 172.21.15.40:0/2605925658 conn(0x7f3c080cfbb0 msgr2=0x7f3c0815c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.370+0000 7f3c0e000640 1 -- 172.21.15.40:0/2605925658 shutdown_connections 2024-09-11T00:24:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07.370+0000 7f3c0e000640 1 -- 172.21.15.40:0/2605925658 wait complete. 2024-09-11T00:24:07.387 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T00:24:07.387 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T00:24:07.387 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2024-09-11T00:24:07.387 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T00:24:07.387 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T00:24:07.387 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T00:24:07.387 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T00:24:07.388 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T00:24:07.388 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T00:24:07.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:07.388 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2024-09-11T00:24:07.423 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:24:07.424 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:24:07.424 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:24:07.424 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:07.424 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-09-11T00:24:07.424 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:07.424 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:24:07.424 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:07.425 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2024-09-11T00:24:07.425 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:24:07.425 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:07.425 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2024-09-11T00:24:07.425 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T00:24:07.425 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:07.425 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2024-09-11T00:24:07.425 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T00:24:07.425 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42672sec preferred_lft 42672sec 2024-09-11T00:24:07.426 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2024-09-11T00:24:07.426 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:07.426 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:24:07.426 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:07.426 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2024-09-11T00:24:07.426 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T00:24:07.427 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:24:07.427 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T00:24:07.427 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2024-09-11T00:24:07.427 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2024-09-11T00:24:07.427 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2024-09-11T00:24:07.427 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T00:24:07.427 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T00:24:07.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:24:07.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:07.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:07.852 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T00:24:07.908 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-09-11T00:24:07.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:07.911 DEBUG:teuthology.orchestra.run.smithi040:> route 2024-09-11T00:24:07.961 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2024-09-11T00:24:07.962 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T00:24:07.962 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T00:24:07.962 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T00:24:07.962 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T00:24:07.962 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:24:07.963 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T00:24:07.963 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T00:24:07.963 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T00:24:07.963 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T00:24:07.963 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T00:24:08.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:24:08.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:08.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:08.544 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-09-11T00:24:08.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:08.581 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2024-09-11T00:24:08.655 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:24:08.656 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T00:24:08.656 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:24:08.656 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-11T00:24:08.656 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T00:24:08.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:24:08.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:08.833 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-11T00:24:08.833 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:24:08.833 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T00:24:08.834 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-11T00:24:08.834 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T00:24:08.834 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-11T00:24:08.834 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-11T00:24:08.834 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-11T00:24:08.834 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T00:24:08.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:24:09.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:09.083 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:24:09.083 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T00:24:09.083 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2024-09-11T00:24:09.084 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T00:24:09.084 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T00:24:09.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:24:09.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:09.252 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-11T00:24:09.252 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:24:09.253 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T00:24:09.290 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T00:24:09.291 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:24:09.291 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T00:24:09.369 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-09-11T00:24:09.470 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:24:09.507 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-09-11T00:24:09.508 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-09-11T00:24:09.508 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-09-11T00:24:09.508 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-09-11T00:24:09.508 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-09-11T00:24:09.508 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-09-11T00:24:09.508 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-09-11T00:24:09.508 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-09-11T00:24:09.508 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-09-11T00:24:09.508 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-09-11T00:24:09.508 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-09-11T00:24:09.508 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2024-09-11T00:24:09.508 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:24:09.509 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-09-11T00:24:09.509 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-09-11T00:24:09.509 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-09-11T00:24:09.509 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-09-11T00:24:09.509 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-09-11T00:24:09.509 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-09-11T00:24:09.509 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:24:09.509 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:24:09.509 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:24:09.509 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:24:09.509 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-09-11T00:24:09.509 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-09-11T00:24:09.509 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T00:24:09.510 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T00:24:09.510 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T00:24:09.510 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T00:24:09.510 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-09-11T00:24:09.510 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:24:09.510 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:24:09.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:09.511 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-09-11T00:24:09.587 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T00:24:09.587 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-11T00:24:09.631 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-09-11T00:24:09.693 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:24:09.730 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-09-11T00:24:09.730 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-09-11T00:24:09.730 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-09-11T00:24:09.730 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-09-11T00:24:09.731 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-09-11T00:24:09.731 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-09-11T00:24:09.731 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-09-11T00:24:09.731 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-09-11T00:24:09.731 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-09-11T00:24:09.731 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-09-11T00:24:09.731 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-09-11T00:24:09.731 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2024-09-11T00:24:09.731 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:24:09.731 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-09-11T00:24:09.731 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-09-11T00:24:09.731 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-09-11T00:24:09.732 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-09-11T00:24:09.732 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-09-11T00:24:09.732 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-09-11T00:24:09.732 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:24:09.732 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:24:09.732 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:24:09.732 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:24:09.732 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-09-11T00:24:09.732 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-09-11T00:24:09.732 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T00:24:09.732 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T00:24:09.732 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T00:24:09.732 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T00:24:09.733 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-09-11T00:24:09.733 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:24:09.733 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:24:09.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:09.734 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-09-11T00:24:09.830 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2024-09-11T00:24:09.829+0000 7f79c3d42480 -1 init, newargv = 0x5640eecbb520 newargc=15 2024-09-11T00:24:09.831 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[44344]: starting ceph client 2024-09-11T00:24:09.840 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[44344]: starting fuse 2024-09-11T00:24:10.914 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-09-11T00:24:10.974 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:24:11.010 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-09-11T00:24:11.010 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-09-11T00:24:11.010 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-09-11T00:24:11.010 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-09-11T00:24:11.010 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-09-11T00:24:11.010 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-09-11T00:24:11.010 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-09-11T00:24:11.010 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-09-11T00:24:11.011 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-09-11T00:24:11.011 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-09-11T00:24:11.011 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-09-11T00:24:11.011 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2024-09-11T00:24:11.011 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:24:11.011 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-09-11T00:24:11.011 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-09-11T00:24:11.011 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-09-11T00:24:11.011 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-09-11T00:24:11.011 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-09-11T00:24:11.011 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-09-11T00:24:11.011 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:24:11.011 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:24:11.011 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:24:11.012 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:24:11.012 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-09-11T00:24:11.012 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-09-11T00:24:11.012 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T00:24:11.012 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T00:24:11.012 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T00:24:11.012 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T00:24:11.012 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-09-11T00:24:11.012 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:24:11.012 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:24:11.012 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T00:24:11.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:11.013 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-09-11T00:24:11.089 INFO:teuthology.orchestra.run.smithi040.stdout:43 2024-09-11T00:24:11.089 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-11T00:24:11.089 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2024-09-11T00:24:11.089 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2024-09-11T00:24:11.089 DEBUG:teuthology.orchestra.run.smithi040:> import re 2024-09-11T00:24:11.089 DEBUG:teuthology.orchestra.run.smithi040:> import os 2024-09-11T00:24:11.089 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2024-09-11T00:24:11.090 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-11T00:24:11.090 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2024-09-11T00:24:11.090 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T00:24:11.090 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2024-09-11T00:24:11.090 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T00:24:11.090 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-11T00:24:11.090 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2024-09-11T00:24:11.090 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2024-09-11T00:24:11.090 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2024-09-11T00:24:11.090 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2024-09-11T00:24:11.091 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-11T00:24:11.091 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2024-09-11T00:24:11.091 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T00:24:11.091 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T00:24:11.091 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T00:24:11.091 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2024-09-11T00:24:11.091 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2024-09-11T00:24:11.091 DEBUG:teuthology.orchestra.run.smithi040:> return f 2024-09-11T00:24:11.091 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T00:24:11.091 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-11T00:24:11.091 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.0")) 2024-09-11T00:24:11.091 DEBUG:teuthology.orchestra.run.smithi040:> ' 2024-09-11T00:24:11.252 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.0.44344.asok 2024-09-11T00:24:11.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:11.267 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44344.asok 2024-09-11T00:24:11.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:11.267 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44344.asok status 2024-09-11T00:24:11.451 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T00:24:11.451 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2024-09-11T00:24:11.451 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-11T00:24:11.451 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-11T00:24:11.451 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "0", 2024-09-11T00:24:11.451 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2024-09-11T00:24:11.451 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T00:24:11.452 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "44344", 2024-09-11T00:24:11.452 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2024-09-11T00:24:11.452 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:11.452 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2024-09-11T00:24:11.452 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2024-09-11T00:24:11.452 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4722, 2024-09-11T00:24:11.452 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2024-09-11T00:24:11.452 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2024-09-11T00:24:11.452 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2024-09-11T00:24:11.452 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 4722 2024-09-11T00:24:11.452 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:11.452 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-09-11T00:24:11.452 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-09-11T00:24:11.452 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2024-09-11T00:24:11.453 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2707149491 2024-09-11T00:24:11.453 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:11.453 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:11.453 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-09-11T00:24:11.453 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-09-11T00:24:11.453 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2024-09-11T00:24:11.453 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2707149491 2024-09-11T00:24:11.453 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:11.453 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.4722 192.168.0.1:0/2707149491", 2024-09-11T00:24:11.453 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/2707149491", 2024-09-11T00:24:11.453 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2024-09-11T00:24:11.453 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 8, 2024-09-11T00:24:11.453 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 22, 2024-09-11T00:24:11.453 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2024-09-11T00:24:11.454 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2024-09-11T00:24:11.454 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2024-09-11T00:24:11.454 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T00:24:11.464 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-11T00:24:11.464 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T00:24:11.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.622+0000 7f9215c00640 1 -- 172.21.15.40:0/980332890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92100ae640 msgr2=0x7f921006edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:11.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.622+0000 7f9215c00640 1 --2- 172.21.15.40:0/980332890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92100ae640 0x7f921006edd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f921006a060 tx=0x7f91fc02a560 comp rx=0 tx=0).stop 2024-09-11T00:24:11.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.623+0000 7f9215c00640 1 -- 172.21.15.40:0/980332890 shutdown_connections 2024-09-11T00:24:11.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.623+0000 7f9215c00640 1 --2- 172.21.15.40:0/980332890 >> v2:172.21.15.175:3300/0 conn(0x7f9210073830 0x7f9210073cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:11.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.623+0000 7f9215c00640 1 --2- 172.21.15.40:0/980332890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92100ae640 0x7f921006edd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:11.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.623+0000 7f9215c00640 1 --2- 172.21.15.40:0/980332890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f921015baa0 0x7f921006e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:11.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.623+0000 7f9215c00640 1 -- 172.21.15.40:0/980332890 >> 172.21.15.40:0/980332890 conn(0x7f92100cf770 msgr2=0x7f92100cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:11.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.623+0000 7f9215c00640 1 -- 172.21.15.40:0/980332890 shutdown_connections 2024-09-11T00:24:11.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.623+0000 7f9215c00640 1 -- 172.21.15.40:0/980332890 wait complete. 2024-09-11T00:24:11.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.624+0000 7f9215c00640 1 Processor -- start 2024-09-11T00:24:11.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.624+0000 7f9215c00640 1 -- start start 2024-09-11T00:24:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.625+0000 7f9215c00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9210073830 0x7f9210159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.625+0000 7f9215c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92100ae640 0x7f92100caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.625+0000 7f9215c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f921015baa0 0x7f92100cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.625+0000 7f9215c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f92100b56d0 con 0x7f92100ae640 2024-09-11T00:24:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.625+0000 7f9215c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f92100b5550 con 0x7f921015baa0 2024-09-11T00:24:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.625+0000 7f9215c00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f921015be80 con 0x7f9210073830 2024-09-11T00:24:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.625+0000 7f920f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92100ae640 0x7f92100caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.625+0000 7f920f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92100ae640 0x7f92100caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43024/0 (socket says 172.21.15.40:43024) 2024-09-11T00:24:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.625+0000 7f920f400640 1 -- 172.21.15.40:0/872716252 learned_addr learned my addr 172.21.15.40:0/872716252 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.626+0000 7f920fe00640 1 --2- 172.21.15.40:0/872716252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9210073830 0x7f9210159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.626+0000 7f9215200640 1 --2- 172.21.15.40:0/872716252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f921015baa0 0x7f92100cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.626+0000 7f920f400640 1 -- 172.21.15.40:0/872716252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9210073830 msgr2=0x7f9210159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.626+0000 7f920f400640 1 --2- 172.21.15.40:0/872716252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9210073830 0x7f9210159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.626+0000 7f920f400640 1 -- 172.21.15.40:0/872716252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f921015baa0 msgr2=0x7f92100cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.626+0000 7f920f400640 1 --2- 172.21.15.40:0/872716252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f921015baa0 0x7f92100cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.626+0000 7f920f400640 1 -- 172.21.15.40:0/872716252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92101f7cb0 con 0x7f92100ae640 2024-09-11T00:24:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.626+0000 7f920f400640 1 --2- 172.21.15.40:0/872716252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92100ae640 0x7f92100caf40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f91fc02ab50 tx=0x7f91fc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.626+0000 7f9207e00640 1 -- 172.21.15.40:0/872716252 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc03f070 con 0x7f92100ae640 2024-09-11T00:24:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.627+0000 7f9207e00640 1 -- 172.21.15.40:0/872716252 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91fc004890 con 0x7f92100ae640 2024-09-11T00:24:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.627+0000 7f9207e00640 1 -- 172.21.15.40:0/872716252 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc035030 con 0x7f92100ae640 2024-09-11T00:24:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.627+0000 7f9215c00640 1 -- 172.21.15.40:0/872716252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92101f7f90 con 0x7f92100ae640 2024-09-11T00:24:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.627+0000 7f9215c00640 1 -- 172.21.15.40:0/872716252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f921015a2f0 con 0x7f92100ae640 2024-09-11T00:24:11.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.628+0000 7f9215c00640 1 -- 172.21.15.40:0/872716252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9210073cc0 con 0x7f92100ae640 2024-09-11T00:24:11.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.629+0000 7f9207e00640 1 -- 172.21.15.40:0/872716252 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f91fc004ce0 con 0x7f92100ae640 2024-09-11T00:24:11.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.630+0000 7f9207e00640 1 --2- 172.21.15.40:0/872716252 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f91f0077fa0 0x7f91f007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:11.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.630+0000 7f9207e00640 1 -- 172.21.15.40:0/872716252 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f91fc0baf90 con 0x7f92100ae640 2024-09-11T00:24:11.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.630+0000 7f920fe00640 1 --2- 172.21.15.40:0/872716252 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f91f0077fa0 0x7f91f007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:11.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.631+0000 7f920fe00640 1 --2- 172.21.15.40:0/872716252 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f91f0077fa0 0x7f91f007a460 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9200005d70 tx=0x7f9200005d00 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:11.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.634+0000 7f9207e00640 1 -- 172.21.15.40:0/872716252 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f91fc0839f0 con 0x7f92100ae640 2024-09-11T00:24:11.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.866+0000 7f9215c00640 1 -- 172.21.15.40:0/872716252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f921006f3b0 con 0x7f92100ae640 2024-09-11T00:24:11.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.867+0000 7f9207e00640 1 -- 172.21.15.40:0/872716252 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f91fc0832f0 con 0x7f92100ae640 2024-09-11T00:24:11.869 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T00:24:11.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.869+0000 7f9215c00640 1 -- 172.21.15.40:0/872716252 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f91f0077fa0 msgr2=0x7f91f007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.869+0000 7f9215c00640 1 --2- 172.21.15.40:0/872716252 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f91f0077fa0 0x7f91f007a460 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9200005d70 tx=0x7f9200005d00 comp rx=0 tx=0).stop 2024-09-11T00:24:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.869+0000 7f9215c00640 1 -- 172.21.15.40:0/872716252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92100ae640 msgr2=0x7f92100caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.869+0000 7f9215c00640 1 --2- 172.21.15.40:0/872716252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92100ae640 0x7f92100caf40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f91fc02ab50 tx=0x7f91fc0039e0 comp rx=0 tx=0).stop 2024-09-11T00:24:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.869+0000 7f9215c00640 1 -- 172.21.15.40:0/872716252 shutdown_connections 2024-09-11T00:24:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.869+0000 7f9215c00640 1 --2- 172.21.15.40:0/872716252 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f91f0077fa0 0x7f91f007a460 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.869+0000 7f9215c00640 1 --2- 172.21.15.40:0/872716252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f921015baa0 0x7f92100cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.869+0000 7f9215c00640 1 --2- 172.21.15.40:0/872716252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92100ae640 0x7f92100caf40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.869+0000 7f9215c00640 1 --2- 172.21.15.40:0/872716252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9210073830 0x7f9210159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.869+0000 7f9215c00640 1 -- 172.21.15.40:0/872716252 >> 172.21.15.40:0/872716252 conn(0x7f92100cf770 msgr2=0x7f92100ad870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.869+0000 7f9215c00640 1 -- 172.21.15.40:0/872716252 shutdown_connections 2024-09-11T00:24:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:11.869+0000 7f9215c00640 1 -- 172.21.15.40:0/872716252 wait complete. 2024-09-11T00:24:11.886 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T00:24:11.886 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T00:24:11.886 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2024-09-11T00:24:11.886 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-11T00:24:11.886 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-11T00:24:11.886 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T00:24:11.886 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T00:24:11.886 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T00:24:11.886 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-11T00:24:11.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:11.887 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2024-09-11T00:24:11.922 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:24:11.922 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:24:11.923 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:24:11.923 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:11.923 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-09-11T00:24:11.923 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:11.923 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:24:11.923 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:11.923 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2024-09-11T00:24:11.923 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:24:11.923 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:11.923 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2024-09-11T00:24:11.923 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T00:24:11.923 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:11.924 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2024-09-11T00:24:11.924 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T00:24:11.924 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42667sec preferred_lft 42667sec 2024-09-11T00:24:11.924 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2024-09-11T00:24:11.924 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:11.924 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:24:11.924 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:11.924 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2024-09-11T00:24:11.924 INFO:teuthology.orchestra.run.smithi040.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T00:24:11.924 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 22:6f:9d:79:5f:1f brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:11.924 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T00:24:11.924 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:11.924 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::9470:ccff:fe73:e014/64 scope link 2024-09-11T00:24:11.924 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:11.925 INFO:teuthology.orchestra.run.smithi040.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T00:24:11.925 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 22:6f:9d:79:5f:1f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:24:11.925 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::206f:9dff:fe79:5f1f/64 scope link 2024-09-11T00:24:11.925 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:11.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:11.925 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T00:24:12.018 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-09-11T00:24:12.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:12.021 DEBUG:teuthology.orchestra.run.smithi040:> route 2024-09-11T00:24:12.057 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2024-09-11T00:24:12.057 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T00:24:12.057 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T00:24:12.057 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T00:24:12.058 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T00:24:12.058 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:24:12.058 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T00:24:12.058 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T00:24:12.058 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T00:24:12.058 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T00:24:12.058 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T00:24:12.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:24:12.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:12.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:12.255 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-09-11T00:24:12.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T00:24:12.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:12.292 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2024-09-11T00:24:12.365 INFO:teuthology.orchestra.run.smithi040.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-11T00:24:12.366 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:24:12.366 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T00:24:12.366 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T00:24:12.366 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-11T00:24:12.367 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T00:24:12.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:24:12.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:12.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:12.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-11T00:24:12.560 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:24:12.591 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:24:12.597 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:24:12.597 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:24:12.598 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:24:12.598 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:12.598 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-09-11T00:24:12.598 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:12.598 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T00:24:12.598 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 3a:e5:b6:80:03:e2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T00:24:12.599 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T00:24:12.599 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:12.599 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::38e5:b6ff:fe80:3e2/64 scope link 2024-09-11T00:24:12.599 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:12.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:12.601 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-11T00:24:12.697 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:24:12.697 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:24:12.697 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:24:12.697 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:12.700 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-09-11T00:24:12.700 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:12.700 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T00:24:12.700 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 3a:e5:b6:80:03:e2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T00:24:12.700 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T00:24:12.701 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:12.701 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::38e5:b6ff:fe80:3e2/64 scope link 2024-09-11T00:24:12.701 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:12.703 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-11T00:24:12.703 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:24:12.704 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T00:24:12.704 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-11T00:24:12.704 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-11T00:24:12.704 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-11T00:24:12.704 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-11T00:24:12.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-11T00:24:12.705 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T00:24:12.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:24:12.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:12.961 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:24:12.962 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T00:24:12.962 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.1 up 2024-09-11T00:24:12.962 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.1 master ceph-brx 2024-09-11T00:24:12.962 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T00:24:13.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:24:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:13.130 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-09-11T00:24:13.130 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:24:13.131 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-11T00:24:13.165 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-11T00:24:13.166 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:24:13.166 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-11T00:24:13.242 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-09-11T00:24:13.339 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:24:13.375 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-09-11T00:24:13.375 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-09-11T00:24:13.376 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-09-11T00:24:13.376 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-09-11T00:24:13.376 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-09-11T00:24:13.376 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-09-11T00:24:13.376 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-09-11T00:24:13.376 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-09-11T00:24:13.376 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-09-11T00:24:13.376 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-09-11T00:24:13.376 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-09-11T00:24:13.376 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2024-09-11T00:24:13.376 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:24:13.376 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-09-11T00:24:13.376 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-09-11T00:24:13.377 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-09-11T00:24:13.377 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-09-11T00:24:13.377 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-09-11T00:24:13.377 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-09-11T00:24:13.377 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:24:13.377 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:24:13.377 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:24:13.377 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:24:13.377 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-09-11T00:24:13.377 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-09-11T00:24:13.377 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T00:24:13.377 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T00:24:13.377 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T00:24:13.378 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T00:24:13.378 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-09-11T00:24:13.378 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:24:13.378 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:24:13.378 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T00:24:13.378 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T00:24:13.378 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T00:24:13.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:13.379 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-09-11T00:24:13.454 INFO:teuthology.orchestra.run.smithi040.stdout:43 2024-09-11T00:24:13.454 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2024-09-11T00:24:13.454 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-09-11T00:24:13.500 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-09-11T00:24:13.559 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:24:13.598 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-09-11T00:24:13.598 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-09-11T00:24:13.598 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-09-11T00:24:13.598 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-09-11T00:24:13.598 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-09-11T00:24:13.598 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-09-11T00:24:13.599 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-09-11T00:24:13.599 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-09-11T00:24:13.599 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-09-11T00:24:13.599 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-09-11T00:24:13.599 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-09-11T00:24:13.599 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2024-09-11T00:24:13.599 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:24:13.599 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-09-11T00:24:13.599 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-09-11T00:24:13.599 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-09-11T00:24:13.599 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-09-11T00:24:13.599 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-09-11T00:24:13.600 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-09-11T00:24:13.600 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:24:13.600 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:24:13.600 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:24:13.600 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:24:13.600 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-09-11T00:24:13.600 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-09-11T00:24:13.600 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T00:24:13.600 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T00:24:13.600 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T00:24:13.600 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T00:24:13.600 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-09-11T00:24:13.600 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:24:13.601 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:24:13.601 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T00:24:13.601 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T00:24:13.601 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T00:24:13.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:13.602 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-09-11T00:24:13.647 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi040.stderr:2024-09-11T00:24:13.645+0000 7f961d12a480 -1 init, newargv = 0x55e4a1ce1530 newargc=15 2024-09-11T00:24:13.647 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi040.stderr:ceph-fuse[44907]: starting ceph client 2024-09-11T00:24:13.654 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi040.stderr:ceph-fuse[44907]: starting fuse 2024-09-11T00:24:13.680 INFO:teuthology.orchestra.run.smithi040.stdout:43 2024-09-11T00:24:13.680 INFO:teuthology.orchestra.run.smithi040.stdout:44 2024-09-11T00:24:13.680 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2024-09-11T00:24:13.681 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2024-09-11T00:24:13.681 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2024-09-11T00:24:13.681 DEBUG:teuthology.orchestra.run.smithi040:> import re 2024-09-11T00:24:13.681 DEBUG:teuthology.orchestra.run.smithi040:> import os 2024-09-11T00:24:13.681 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2024-09-11T00:24:13.681 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-11T00:24:13.681 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2024-09-11T00:24:13.681 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-11T00:24:13.681 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2024-09-11T00:24:13.681 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-11T00:24:13.681 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-11T00:24:13.682 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2024-09-11T00:24:13.682 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2024-09-11T00:24:13.682 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2024-09-11T00:24:13.682 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2024-09-11T00:24:13.682 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-11T00:24:13.682 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2024-09-11T00:24:13.682 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T00:24:13.682 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T00:24:13.682 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T00:24:13.682 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2024-09-11T00:24:13.682 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2024-09-11T00:24:13.682 DEBUG:teuthology.orchestra.run.smithi040:> return f 2024-09-11T00:24:13.682 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T00:24:13.682 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-11T00:24:13.682 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.2")) 2024-09-11T00:24:13.683 DEBUG:teuthology.orchestra.run.smithi040:> ' 2024-09-11T00:24:13.843 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.2.44907.asok 2024-09-11T00:24:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:13.858 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.44907.asok 2024-09-11T00:24:13.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:13.858 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.44907.asok status 2024-09-11T00:24:14.044 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T00:24:14.045 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2024-09-11T00:24:14.045 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-11T00:24:14.045 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-11T00:24:14.045 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "2", 2024-09-11T00:24:14.045 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2024-09-11T00:24:14.045 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-11T00:24:14.045 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "44907", 2024-09-11T00:24:14.045 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2024-09-11T00:24:14.045 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:14.045 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2024-09-11T00:24:14.046 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2024-09-11T00:24:14.046 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4737, 2024-09-11T00:24:14.046 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2024-09-11T00:24:14.046 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2024-09-11T00:24:14.046 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2024-09-11T00:24:14.046 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 4737 2024-09-11T00:24:14.046 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:14.046 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-09-11T00:24:14.046 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-09-11T00:24:14.046 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.2:0", 2024-09-11T00:24:14.046 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1514907141 2024-09-11T00:24:14.046 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:14.046 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-09-11T00:24:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-09-11T00:24:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.2:0", 2024-09-11T00:24:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1514907141 2024-09-11T00:24:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.4737 192.168.0.2:0/1514907141", 2024-09-11T00:24:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.2:0/1514907141", 2024-09-11T00:24:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2024-09-11T00:24:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 8, 2024-09-11T00:24:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 22, 2024-09-11T00:24:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2024-09-11T00:24:14.047 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2024-09-11T00:24:14.048 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2024-09-11T00:24:14.048 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T00:24:14.056 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-11T00:24:14.057 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T00:24:14.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.215+0000 7f4096200640 1 -- 172.21.15.40:0/1659406011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f409006e910 msgr2=0x7f409006eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:14.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.215+0000 7f4096200640 1 --2- 172.21.15.40:0/1659406011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f409006e910 0x7f409006eda0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4088005fd0 tx=0x7f408802a8a0 comp rx=0 tx=0).stop 2024-09-11T00:24:14.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.216+0000 7f4096200640 1 -- 172.21.15.40:0/1659406011 shutdown_connections 2024-09-11T00:24:14.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.216+0000 7f4096200640 1 --2- 172.21.15.40:0/1659406011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f409006e910 0x7f409006eda0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:14.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.216+0000 7f4096200640 1 --2- 172.21.15.40:0/1659406011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40900cc180 0x7f40900cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:14.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.216+0000 7f4096200640 1 -- 172.21.15.40:0/1659406011 >> 172.21.15.40:0/1659406011 conn(0x7f40900cfbb0 msgr2=0x7f40900cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:14.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.216+0000 7f4096200640 1 -- 172.21.15.40:0/1659406011 shutdown_connections 2024-09-11T00:24:14.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.216+0000 7f4096200640 1 -- 172.21.15.40:0/1659406011 wait complete. 2024-09-11T00:24:14.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.217+0000 7f4096200640 1 Processor -- start 2024-09-11T00:24:14.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.217+0000 7f4096200640 1 -- start start 2024-09-11T00:24:14.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.218+0000 7f4096200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f409006e910 0x7f409015a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:14.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.218+0000 7f4096200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40900cc180 0x7f409015c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:14.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.218+0000 7f4096200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f409015bcc0 0x7f409015c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:14.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.218+0000 7f4096200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f409006f2e0 con 0x7f409006e910 2024-09-11T00:24:14.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.218+0000 7f4096200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f409015f9d0 con 0x7f40900cc180 2024-09-11T00:24:14.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.218+0000 7f4096200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f409006f460 con 0x7f409015bcc0 2024-09-11T00:24:14.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.218+0000 7f408f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f409006e910 0x7f409015a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:14.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.219+0000 7f408f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f409006e910 0x7f409015a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43034/0 (socket says 172.21.15.40:43034) 2024-09-11T00:24:14.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.219+0000 7f408f400640 1 -- 172.21.15.40:0/2277187200 learned_addr learned my addr 172.21.15.40:0/2277187200 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:14.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.219+0000 7f408fe00640 1 --2- 172.21.15.40:0/2277187200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f409015bcc0 0x7f409015c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:14.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.219+0000 7f4086a00640 1 --2- 172.21.15.40:0/2277187200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40900cc180 0x7f409015c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:14.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.219+0000 7f408f400640 1 -- 172.21.15.40:0/2277187200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f409015bcc0 msgr2=0x7f409015c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:14.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.219+0000 7f408f400640 1 --2- 172.21.15.40:0/2277187200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f409015bcc0 0x7f409015c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:14.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.219+0000 7f408f400640 1 -- 172.21.15.40:0/2277187200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40900cc180 msgr2=0x7f409015c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:14.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.219+0000 7f408f400640 1 --2- 172.21.15.40:0/2277187200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40900cc180 0x7f409015c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:14.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.219+0000 7f408f400640 1 -- 172.21.15.40:0/2277187200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409015a630 con 0x7f409006e910 2024-09-11T00:24:14.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.219+0000 7f4086a00640 1 --2- 172.21.15.40:0/2277187200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40900cc180 0x7f409015c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:14.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.219+0000 7f408f400640 1 --2- 172.21.15.40:0/2277187200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f409006e910 0x7f409015a0f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f408000c430 tx=0x7f408000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:14.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.219+0000 7f4087e00640 1 -- 172.21.15.40:0/2277187200 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080011790 con 0x7f409006e910 2024-09-11T00:24:14.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.220+0000 7f4087e00640 1 -- 172.21.15.40:0/2277187200 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4080017070 con 0x7f409006e910 2024-09-11T00:24:14.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.220+0000 7f4096200640 1 -- 172.21.15.40:0/2277187200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40900aef00 con 0x7f409006e910 2024-09-11T00:24:14.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.220+0000 7f4087e00640 1 -- 172.21.15.40:0/2277187200 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080011ce0 con 0x7f409006e910 2024-09-11T00:24:14.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.220+0000 7f4096200640 1 -- 172.21.15.40:0/2277187200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40901f45e0 con 0x7f409006e910 2024-09-11T00:24:14.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.221+0000 7f4096200640 1 -- 172.21.15.40:0/2277187200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f409006f920 con 0x7f409006e910 2024-09-11T00:24:14.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.222+0000 7f4087e00640 1 -- 172.21.15.40:0/2277187200 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f408001c460 con 0x7f409006e910 2024-09-11T00:24:14.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.223+0000 7f4087e00640 1 --2- 172.21.15.40:0/2277187200 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f406c077fa0 0x7f406c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:14.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.223+0000 7f4087e00640 1 -- 172.21.15.40:0/2277187200 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4080099a90 con 0x7f409006e910 2024-09-11T00:24:14.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.223+0000 7f4086a00640 1 --2- 172.21.15.40:0/2277187200 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f406c077fa0 0x7f406c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:14.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.224+0000 7f4086a00640 1 --2- 172.21.15.40:0/2277187200 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f406c077fa0 0x7f406c07a460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f40900ca990 tx=0x7f4078005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:14.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.227+0000 7f4087e00640 1 -- 172.21.15.40:0/2277187200 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f40800624f0 con 0x7f409006e910 2024-09-11T00:24:14.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.459+0000 7f4096200640 1 -- 172.21.15.40:0/2277187200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f409015b270 con 0x7f409006e910 2024-09-11T00:24:14.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.460+0000 7f4087e00640 1 -- 172.21.15.40:0/2277187200 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f4080061df0 con 0x7f409006e910 2024-09-11T00:24:14.461 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T00:24:14.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.462+0000 7f4096200640 1 -- 172.21.15.40:0/2277187200 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f406c077fa0 msgr2=0x7f406c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:14.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.462+0000 7f4096200640 1 --2- 172.21.15.40:0/2277187200 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f406c077fa0 0x7f406c07a460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f40900ca990 tx=0x7f4078005f90 comp rx=0 tx=0).stop 2024-09-11T00:24:14.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.462+0000 7f4096200640 1 -- 172.21.15.40:0/2277187200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f409006e910 msgr2=0x7f409015a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:14.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.462+0000 7f4096200640 1 --2- 172.21.15.40:0/2277187200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f409006e910 0x7f409015a0f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f408000c430 tx=0x7f408000c8f0 comp rx=0 tx=0).stop 2024-09-11T00:24:14.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.462+0000 7f4096200640 1 -- 172.21.15.40:0/2277187200 shutdown_connections 2024-09-11T00:24:14.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.462+0000 7f4096200640 1 --2- 172.21.15.40:0/2277187200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f409015bcc0 0x7f409015c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:14.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.462+0000 7f4096200640 1 --2- 172.21.15.40:0/2277187200 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f406c077fa0 0x7f406c07a460 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:14.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.462+0000 7f4096200640 1 --2- 172.21.15.40:0/2277187200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40900cc180 0x7f409015c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:14.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.462+0000 7f4096200640 1 --2- 172.21.15.40:0/2277187200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f409006e910 0x7f409015a0f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:14.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.462+0000 7f4096200640 1 -- 172.21.15.40:0/2277187200 >> 172.21.15.40:0/2277187200 conn(0x7f40900cfbb0 msgr2=0x7f40900cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:14.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.462+0000 7f4096200640 1 -- 172.21.15.40:0/2277187200 shutdown_connections 2024-09-11T00:24:14.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:14.462+0000 7f4096200640 1 -- 172.21.15.40:0/2277187200 wait complete. 2024-09-11T00:24:14.479 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T00:24:14.479 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T00:24:14.479 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-09-11T00:24:14.479 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T00:24:14.480 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T00:24:14.480 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T00:24:14.480 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T00:24:14.480 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T00:24:14.480 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T00:24:14.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:14.480 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-09-11T00:24:14.520 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:24:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:24:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:24:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-09-11T00:24:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:14.520 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:24:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:14.520 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-09-11T00:24:14.520 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:24:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-09-11T00:24:14.521 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:24:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:14.521 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T00:24:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T00:24:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42663sec preferred_lft 42663sec 2024-09-11T00:24:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link noprefixroute 2024-09-11T00:24:14.521 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:14.522 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T00:24:14.522 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:24:14.522 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-09-11T00:24:14.523 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add name ceph-brx type bridge 2024-09-11T00:24:14.523 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip addr flush dev ceph-brx 2024-09-11T00:24:14.523 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set ceph-brx up 2024-09-11T00:24:14.523 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T00:24:14.523 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-09-11T00:24:14.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:24:14.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:14.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:14.951 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T00:24:15.009 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-09-11T00:24:15.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:15.012 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-09-11T00:24:15.066 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-09-11T00:24:15.066 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T00:24:15.066 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T00:24:15.066 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T00:24:15.066 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T00:24:15.067 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:24:15.067 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-09-11T00:24:15.067 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T00:24:15.067 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T00:24:15.067 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T00:24:15.067 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-09-11T00:24:15.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:24:15.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:15.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:15.687 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-09-11T00:24:15.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:15.723 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list-id 2024-09-11T00:24:15.798 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:24:15.798 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-09-11T00:24:15.798 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:24:15.799 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-11T00:24:15.799 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-09-11T00:24:15.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:24:15.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:15.978 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-11T00:24:15.978 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:24:15.978 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-09-11T00:24:15.978 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-11T00:24:15.978 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T00:24:15.978 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-11T00:24:15.978 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-11T00:24:15.978 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-11T00:24:15.978 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-09-11T00:24:16.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:24:16.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:16.226 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:24:16.226 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-09-11T00:24:16.226 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-09-11T00:24:16.226 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T00:24:16.226 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-09-11T00:24:16.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:24:16.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:16.394 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-11T00:24:16.394 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:24:16.394 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T00:24:16.431 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T00:24:16.431 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:24:16.431 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T00:24:16.506 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2024-09-11T00:24:16.603 DEBUG:teuthology.orchestra.run.smithi175:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:24:16.640 INFO:teuthology.orchestra.run.smithi175.stdout:/proc 2024-09-11T00:24:16.640 INFO:teuthology.orchestra.run.smithi175.stdout:/sys 2024-09-11T00:24:16.640 INFO:teuthology.orchestra.run.smithi175.stdout:/dev 2024-09-11T00:24:16.640 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/security 2024-09-11T00:24:16.640 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/shm 2024-09-11T00:24:16.640 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/pts 2024-09-11T00:24:16.640 INFO:teuthology.orchestra.run.smithi175.stdout:/run 2024-09-11T00:24:16.640 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/cgroup 2024-09-11T00:24:16.640 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/pstore 2024-09-11T00:24:16.640 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/bpf 2024-09-11T00:24:16.640 INFO:teuthology.orchestra.run.smithi175.stdout:/ 2024-09-11T00:24:16.641 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/selinux 2024-09-11T00:24:16.641 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:24:16.641 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/hugepages 2024-09-11T00:24:16.641 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/mqueue 2024-09-11T00:24:16.641 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/debug 2024-09-11T00:24:16.641 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/tracing 2024-09-11T00:24:16.641 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/fuse/connections 2024-09-11T00:24:16.641 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/config 2024-09-11T00:24:16.641 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:24:16.641 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:24:16.641 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:24:16.641 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:24:16.641 INFO:teuthology.orchestra.run.smithi175.stdout:/run/user/1000 2024-09-11T00:24:16.641 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph 2024-09-11T00:24:16.642 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-4 2024-09-11T00:24:16.642 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-5 2024-09-11T00:24:16.642 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-6 2024-09-11T00:24:16.642 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-7 2024-09-11T00:24:16.642 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns 2024-09-11T00:24:16.642 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:24:16.642 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:24:16.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:16.643 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2024-09-11T00:24:16.719 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T00:24:16.719 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-11T00:24:16.763 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2024-09-11T00:24:16.818 DEBUG:teuthology.orchestra.run.smithi175:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout:/proc 2024-09-11T00:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout:/sys 2024-09-11T00:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout:/dev 2024-09-11T00:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/security 2024-09-11T00:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/shm 2024-09-11T00:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/pts 2024-09-11T00:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout:/run 2024-09-11T00:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/cgroup 2024-09-11T00:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/pstore 2024-09-11T00:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/bpf 2024-09-11T00:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout:/ 2024-09-11T00:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/selinux 2024-09-11T00:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/hugepages 2024-09-11T00:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/mqueue 2024-09-11T00:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/debug 2024-09-11T00:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/tracing 2024-09-11T00:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/fuse/connections 2024-09-11T00:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/config 2024-09-11T00:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout:/run/user/1000 2024-09-11T00:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph 2024-09-11T00:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-4 2024-09-11T00:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-5 2024-09-11T00:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-6 2024-09-11T00:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-7 2024-09-11T00:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns 2024-09-11T00:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:24:16.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:16.857 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2024-09-11T00:24:16.921 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:2024-09-11T00:24:16.919+0000 7f6c6518a480 -1 init, newargv = 0x556ab77fb590 newargc=15 2024-09-11T00:24:16.922 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[41499]: starting ceph client 2024-09-11T00:24:16.933 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[41499]: starting fuse 2024-09-11T00:24:16.936 INFO:teuthology.orchestra.run.smithi175.stdout:43 2024-09-11T00:24:16.936 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-11T00:24:16.936 DEBUG:teuthology.orchestra.run.smithi175:> sudo stdin-killer -- python3 -c ' 2024-09-11T00:24:16.937 DEBUG:teuthology.orchestra.run.smithi175:> import glob 2024-09-11T00:24:16.937 DEBUG:teuthology.orchestra.run.smithi175:> import re 2024-09-11T00:24:16.937 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-09-11T00:24:16.937 DEBUG:teuthology.orchestra.run.smithi175:> import subprocess 2024-09-11T00:24:16.937 DEBUG:teuthology.orchestra.run.smithi175:> 2024-09-11T00:24:16.937 DEBUG:teuthology.orchestra.run.smithi175:> def _find_admin_socket(client_name): 2024-09-11T00:24:16.937 DEBUG:teuthology.orchestra.run.smithi175:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-11T00:24:16.937 DEBUG:teuthology.orchestra.run.smithi175:> files = glob.glob(asok_path) 2024-09-11T00:24:16.937 DEBUG:teuthology.orchestra.run.smithi175:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-11T00:24:16.937 DEBUG:teuthology.orchestra.run.smithi175:> 2024-09-11T00:24:16.937 DEBUG:teuthology.orchestra.run.smithi175:> # Given a non-glob path, it better be there 2024-09-11T00:24:16.937 DEBUG:teuthology.orchestra.run.smithi175:> if "*" not in asok_path: 2024-09-11T00:24:16.937 DEBUG:teuthology.orchestra.run.smithi175:> assert(len(files) == 1) 2024-09-11T00:24:16.937 DEBUG:teuthology.orchestra.run.smithi175:> return files[0] 2024-09-11T00:24:16.937 DEBUG:teuthology.orchestra.run.smithi175:> 2024-09-11T00:24:16.938 DEBUG:teuthology.orchestra.run.smithi175:> for f in files: 2024-09-11T00:24:16.938 DEBUG:teuthology.orchestra.run.smithi175:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T00:24:16.938 DEBUG:teuthology.orchestra.run.smithi175:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T00:24:16.938 DEBUG:teuthology.orchestra.run.smithi175:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T00:24:16.938 DEBUG:teuthology.orchestra.run.smithi175:> contents = proc_f.read() 2024-09-11T00:24:16.938 DEBUG:teuthology.orchestra.run.smithi175:> if mountpoint in contents: 2024-09-11T00:24:16.938 DEBUG:teuthology.orchestra.run.smithi175:> return f 2024-09-11T00:24:16.938 DEBUG:teuthology.orchestra.run.smithi175:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T00:24:16.938 DEBUG:teuthology.orchestra.run.smithi175:> 2024-09-11T00:24:16.938 DEBUG:teuthology.orchestra.run.smithi175:> print(_find_admin_socket("client.1")) 2024-09-11T00:24:16.938 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-09-11T00:24:17.098 INFO:teuthology.orchestra.run.smithi175.stdout:/var/run/ceph/ceph-client.1.41499.asok 2024-09-11T00:24:17.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:17.112 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41499.asok 2024-09-11T00:24:17.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:17.113 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41499.asok status 2024-09-11T00:24:17.294 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-11T00:24:17.295 INFO:teuthology.orchestra.run.smithi175.stdout: "metadata": { 2024-09-11T00:24:17.295 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-11T00:24:17.295 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-11T00:24:17.295 INFO:teuthology.orchestra.run.smithi175.stdout: "entity_id": "1", 2024-09-11T00:24:17.295 INFO:teuthology.orchestra.run.smithi175.stdout: "hostname": "smithi175", 2024-09-11T00:24:17.295 INFO:teuthology.orchestra.run.smithi175.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-11T00:24:17.295 INFO:teuthology.orchestra.run.smithi175.stdout: "pid": "41499", 2024-09-11T00:24:17.295 INFO:teuthology.orchestra.run.smithi175.stdout: "root": "/" 2024-09-11T00:24:17.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-11T00:24:17.295 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_count": 0, 2024-09-11T00:24:17.295 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_pinned_count": 0, 2024-09-11T00:24:17.295 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 4580, 2024-09-11T00:24:17.296 INFO:teuthology.orchestra.run.smithi175.stdout: "inst": { 2024-09-11T00:24:17.296 INFO:teuthology.orchestra.run.smithi175.stdout: "name": { 2024-09-11T00:24:17.296 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "client", 2024-09-11T00:24:17.296 INFO:teuthology.orchestra.run.smithi175.stdout: "num": 4580 2024-09-11T00:24:17.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-11T00:24:17.296 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2024-09-11T00:24:17.296 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2024-09-11T00:24:17.296 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.1:0", 2024-09-11T00:24:17.296 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 3419075217 2024-09-11T00:24:17.296 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-11T00:24:17.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-11T00:24:17.296 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2024-09-11T00:24:17.296 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2024-09-11T00:24:17.297 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.1:0", 2024-09-11T00:24:17.297 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 3419075217 2024-09-11T00:24:17.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-11T00:24:17.297 INFO:teuthology.orchestra.run.smithi175.stdout: "inst_str": "client.4580 192.168.0.1:0/3419075217", 2024-09-11T00:24:17.297 INFO:teuthology.orchestra.run.smithi175.stdout: "addr_str": "192.168.0.1:0/3419075217", 2024-09-11T00:24:17.297 INFO:teuthology.orchestra.run.smithi175.stdout: "inode_count": 1, 2024-09-11T00:24:17.297 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_epoch": 8, 2024-09-11T00:24:17.297 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch": 22, 2024-09-11T00:24:17.297 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch_barrier": 0, 2024-09-11T00:24:17.297 INFO:teuthology.orchestra.run.smithi175.stdout: "blocklisted": false, 2024-09-11T00:24:17.297 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs" 2024-09-11T00:24:17.297 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-11T00:24:17.307 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-11T00:24:17.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T00:24:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.474+0000 7f9ac9a00640 1 -- 172.21.15.40:0/2672327624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ac415f050 msgr2=0x7f9ac415e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.474+0000 7f9ac9a00640 1 --2- 172.21.15.40:0/2672327624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ac415f050 0x7f9ac415e3b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9aac009830 tx=0x7f9aac02a510 comp rx=0 tx=0).stop 2024-09-11T00:24:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.474+0000 7f9ac9a00640 1 -- 172.21.15.40:0/2672327624 shutdown_connections 2024-09-11T00:24:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.474+0000 7f9ac9a00640 1 --2- 172.21.15.40:0/2672327624 >> v2:172.21.15.175:3300/0 conn(0x7f9ac40cd780 0x7f9ac40cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.474+0000 7f9ac9a00640 1 --2- 172.21.15.40:0/2672327624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ac415f050 0x7f9ac415e3b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.474+0000 7f9ac9a00640 1 -- 172.21.15.40:0/2672327624 >> 172.21.15.40:0/2672327624 conn(0x7f9ac40cfbb0 msgr2=0x7f9ac40cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.474+0000 7f9ac9a00640 1 -- 172.21.15.40:0/2672327624 shutdown_connections 2024-09-11T00:24:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.474+0000 7f9ac9a00640 1 -- 172.21.15.40:0/2672327624 wait complete. 2024-09-11T00:24:17.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.476+0000 7f9ac9a00640 1 Processor -- start 2024-09-11T00:24:17.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.476+0000 7f9ac9a00640 1 -- start start 2024-09-11T00:24:17.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.477+0000 7f9ac9a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ac40cd780 0x7f9ac414b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.477+0000 7f9ac9a00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ac415ec70 0x7f9ac40b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.477+0000 7f9ac9a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac415f050 0x7f9ac40b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.477+0000 7f9ac9a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac41680c0 con 0x7f9ac415f050 2024-09-11T00:24:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.477+0000 7f9ac9a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac4167f40 con 0x7f9ac40cd780 2024-09-11T00:24:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.477+0000 7f9ac9a00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac4168240 con 0x7f9ac415ec70 2024-09-11T00:24:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.477+0000 7f9ac3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac415f050 0x7f9ac40b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.477+0000 7f9aba000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ac415ec70 0x7f9ac40b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.477+0000 7f9ac3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac415f050 0x7f9ac40b4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43050/0 (socket says 172.21.15.40:43050) 2024-09-11T00:24:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.477+0000 7f9ac3400640 1 -- 172.21.15.40:0/3789735472 learned_addr learned my addr 172.21.15.40:0/3789735472 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.477+0000 7f9ac2a00640 1 --2- 172.21.15.40:0/3789735472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ac40cd780 0x7f9ac414b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:17.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.478+0000 7f9aba000640 1 -- 172.21.15.40:0/3789735472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ac40cd780 msgr2=0x7f9ac414b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:17.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.478+0000 7f9aba000640 1 --2- 172.21.15.40:0/3789735472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ac40cd780 0x7f9ac414b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.478+0000 7f9aba000640 1 -- 172.21.15.40:0/3789735472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac415f050 msgr2=0x7f9ac40b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.478+0000 7f9aba000640 1 --2- 172.21.15.40:0/3789735472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac415f050 0x7f9ac40b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.478+0000 7f9aba000640 1 -- 172.21.15.40:0/3789735472 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac40c7750 con 0x7f9ac415ec70 2024-09-11T00:24:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.478+0000 7f9ac3400640 1 --2- 172.21.15.40:0/3789735472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac415f050 0x7f9ac40b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:24:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.478+0000 7f9aba000640 1 --2- 172.21.15.40:0/3789735472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ac415ec70 0x7f9ac40b3060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9aac031000 tx=0x7f9aac033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.478+0000 7f9abb400640 1 -- 172.21.15.40:0/3789735472 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac005c90 con 0x7f9ac415ec70 2024-09-11T00:24:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.478+0000 7f9abb400640 1 -- 172.21.15.40:0/3789735472 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9aac031e50 con 0x7f9ac415ec70 2024-09-11T00:24:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.478+0000 7f9abb400640 1 -- 172.21.15.40:0/3789735472 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac005280 con 0x7f9ac415ec70 2024-09-11T00:24:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.478+0000 7f9ac9a00640 1 -- 172.21.15.40:0/3789735472 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac40c7a30 con 0x7f9ac415ec70 2024-09-11T00:24:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.479+0000 7f9ac9a00640 1 -- 172.21.15.40:0/3789735472 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac40c7ff0 con 0x7f9ac415ec70 2024-09-11T00:24:17.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.480+0000 7f9ac9a00640 1 -- 172.21.15.40:0/3789735472 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ac40cdbd0 con 0x7f9ac415ec70 2024-09-11T00:24:17.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.481+0000 7f9abb400640 1 -- 172.21.15.40:0/3789735472 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9aac005420 con 0x7f9ac415ec70 2024-09-11T00:24:17.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.482+0000 7f9abb400640 1 --2- 172.21.15.40:0/3789735472 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9aa0077f70 0x7f9aa007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:17.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.482+0000 7f9abb400640 1 -- 172.21.15.40:0/3789735472 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9aac0bac20 con 0x7f9ac415ec70 2024-09-11T00:24:17.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.482+0000 7f9ac2a00640 1 --2- 172.21.15.40:0/3789735472 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9aa0077f70 0x7f9aa007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:17.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.483+0000 7f9ac2a00640 1 --2- 172.21.15.40:0/3789735472 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9aa0077f70 0x7f9aa007a430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4007fd0 tx=0x7f9ab4001410 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:17.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.487+0000 7f9abb400640 1 -- 172.21.15.40:0/3789735472 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9aac03f030 con 0x7f9ac415ec70 2024-09-11T00:24:17.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.718+0000 7f9ac9a00640 1 -- 172.21.15.40:0/3789735472 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9ac40b5b30 con 0x7f9ac415ec70 2024-09-11T00:24:17.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.719+0000 7f9abb400640 1 -- 172.21.15.40:0/3789735472 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f9aac083030 con 0x7f9ac415ec70 2024-09-11T00:24:17.720 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T00:24:17.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.721+0000 7f9ac9a00640 1 -- 172.21.15.40:0/3789735472 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9aa0077f70 msgr2=0x7f9aa007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:17.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.721+0000 7f9ac9a00640 1 --2- 172.21.15.40:0/3789735472 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9aa0077f70 0x7f9aa007a430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4007fd0 tx=0x7f9ab4001410 comp rx=0 tx=0).stop 2024-09-11T00:24:17.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.721+0000 7f9ac9a00640 1 -- 172.21.15.40:0/3789735472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ac415ec70 msgr2=0x7f9ac40b3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:17.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.721+0000 7f9ac9a00640 1 --2- 172.21.15.40:0/3789735472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ac415ec70 0x7f9ac40b3060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9aac031000 tx=0x7f9aac033c20 comp rx=0 tx=0).stop 2024-09-11T00:24:17.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.721+0000 7f9ac9a00640 1 -- 172.21.15.40:0/3789735472 shutdown_connections 2024-09-11T00:24:17.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.721+0000 7f9ac9a00640 1 --2- 172.21.15.40:0/3789735472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac415f050 0x7f9ac40b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:17.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.721+0000 7f9ac9a00640 1 --2- 172.21.15.40:0/3789735472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ac415ec70 0x7f9ac40b3060 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:17.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.721+0000 7f9ac9a00640 1 --2- 172.21.15.40:0/3789735472 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9aa0077f70 0x7f9aa007a430 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:17.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.721+0000 7f9ac9a00640 1 --2- 172.21.15.40:0/3789735472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ac40cd780 0x7f9ac414b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:17.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.721+0000 7f9ac9a00640 1 -- 172.21.15.40:0/3789735472 >> 172.21.15.40:0/3789735472 conn(0x7f9ac40cfbb0 msgr2=0x7f9ac414e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:17.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.721+0000 7f9ac9a00640 1 -- 172.21.15.40:0/3789735472 shutdown_connections 2024-09-11T00:24:17.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:17.721+0000 7f9ac9a00640 1 -- 172.21.15.40:0/3789735472 wait complete. 2024-09-11T00:24:17.738 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T00:24:17.738 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T00:24:17.738 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-09-11T00:24:17.739 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-11T00:24:17.739 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-11T00:24:17.739 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T00:24:17.739 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T00:24:17.739 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T00:24:17.739 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-11T00:24:17.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:17.739 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-09-11T00:24:17.774 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:24:17.774 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:24:17.774 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:24:17.775 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:17.775 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-09-11T00:24:17.775 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:17.775 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:24:17.775 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:17.775 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-09-11T00:24:17.775 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:24:17.775 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:17.775 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-09-11T00:24:17.775 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:24:17.775 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:17.775 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T00:24:17.775 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:17.775 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T00:24:17.776 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42659sec preferred_lft 42659sec 2024-09-11T00:24:17.776 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link noprefixroute 2024-09-11T00:24:17.776 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:17.776 INFO:teuthology.orchestra.run.smithi175.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T00:24:17.776 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 4e:cf:84:9c:78:22 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:17.776 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T00:24:17.776 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:17.776 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::24ee:5dff:fedd:2aaf/64 scope link 2024-09-11T00:24:17.776 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:17.776 INFO:teuthology.orchestra.run.smithi175.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T00:24:17.776 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 4e:cf:84:9c:78:22 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:24:17.777 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::4ccf:84ff:fe9c:7822/64 scope link 2024-09-11T00:24:17.777 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:17.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:17.778 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T00:24:17.871 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-09-11T00:24:17.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:17.875 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-09-11T00:24:17.911 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-09-11T00:24:17.912 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T00:24:17.912 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T00:24:17.912 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T00:24:17.912 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T00:24:17.912 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:24:17.912 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-09-11T00:24:17.912 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T00:24:17.912 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T00:24:17.913 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T00:24:17.913 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-09-11T00:24:18.028 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:24:18.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:18.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:18.108 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-09-11T00:24:18.143 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T00:24:18.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:18.144 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list-id 2024-09-11T00:24:18.219 INFO:teuthology.orchestra.run.smithi175.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-11T00:24:18.221 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:24:18.221 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-09-11T00:24:18.221 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T00:24:18.221 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-11T00:24:18.221 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-09-11T00:24:18.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:24:18.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:18.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:18.397 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-11T00:24:18.451 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:24:18.452 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:24:18.452 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:24:18.452 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:18.452 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-09-11T00:24:18.452 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:18.452 INFO:teuthology.orchestra.run.smithi175.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T00:24:18.452 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 76:43:c4:93:66:4d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T00:24:18.452 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T00:24:18.452 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:18.452 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::7443:c4ff:fe93:664d/64 scope link 2024-09-11T00:24:18.452 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:18.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:18.454 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-11T00:24:18.509 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:24:18.509 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:24:18.509 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:24:18.509 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:18.510 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-09-11T00:24:18.510 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:18.510 INFO:teuthology.orchestra.run.smithi175.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T00:24:18.510 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 76:43:c4:93:66:4d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T00:24:18.510 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T00:24:18.510 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:18.510 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::7443:c4ff:fe93:664d/64 scope link 2024-09-11T00:24:18.510 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:18.512 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-11T00:24:18.512 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:24:18.512 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-09-11T00:24:18.512 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-11T00:24:18.513 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-11T00:24:18.513 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-11T00:24:18.513 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-11T00:24:18.513 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-11T00:24:18.513 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-09-11T00:24:18.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:24:18.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:18.726 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:24:18.726 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-09-11T00:24:18.727 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.1 up 2024-09-11T00:24:18.727 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set dev brx.1 master ceph-brx 2024-09-11T00:24:18.727 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-09-11T00:24:18.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:24:18.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:18.892 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-09-11T00:24:18.892 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:24:18.893 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-11T00:24:18.928 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-11T00:24:18.928 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:24:18.928 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-11T00:24:19.002 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2024-09-11T00:24:19.100 DEBUG:teuthology.orchestra.run.smithi175:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:24:19.136 INFO:teuthology.orchestra.run.smithi175.stdout:/proc 2024-09-11T00:24:19.137 INFO:teuthology.orchestra.run.smithi175.stdout:/sys 2024-09-11T00:24:19.137 INFO:teuthology.orchestra.run.smithi175.stdout:/dev 2024-09-11T00:24:19.137 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/security 2024-09-11T00:24:19.137 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/shm 2024-09-11T00:24:19.137 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/pts 2024-09-11T00:24:19.137 INFO:teuthology.orchestra.run.smithi175.stdout:/run 2024-09-11T00:24:19.137 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/cgroup 2024-09-11T00:24:19.138 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/pstore 2024-09-11T00:24:19.138 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/bpf 2024-09-11T00:24:19.138 INFO:teuthology.orchestra.run.smithi175.stdout:/ 2024-09-11T00:24:19.138 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/selinux 2024-09-11T00:24:19.138 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:24:19.138 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/hugepages 2024-09-11T00:24:19.139 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/mqueue 2024-09-11T00:24:19.139 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/debug 2024-09-11T00:24:19.139 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/tracing 2024-09-11T00:24:19.139 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/fuse/connections 2024-09-11T00:24:19.139 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/config 2024-09-11T00:24:19.139 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:24:19.140 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:24:19.140 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:24:19.140 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:24:19.140 INFO:teuthology.orchestra.run.smithi175.stdout:/run/user/1000 2024-09-11T00:24:19.140 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph 2024-09-11T00:24:19.140 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-4 2024-09-11T00:24:19.141 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-5 2024-09-11T00:24:19.141 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-6 2024-09-11T00:24:19.141 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-7 2024-09-11T00:24:19.141 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns 2024-09-11T00:24:19.141 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:24:19.141 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:24:19.141 INFO:teuthology.orchestra.run.smithi175.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-11T00:24:19.141 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T00:24:19.141 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T00:24:19.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:19.143 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2024-09-11T00:24:19.217 INFO:teuthology.orchestra.run.smithi175.stdout:43 2024-09-11T00:24:19.218 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2024-09-11T00:24:19.218 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-09-11T00:24:19.262 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2024-09-11T00:24:19.318 DEBUG:teuthology.orchestra.run.smithi175:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:24:19.354 INFO:teuthology.orchestra.run.smithi175.stdout:/proc 2024-09-11T00:24:19.355 INFO:teuthology.orchestra.run.smithi175.stdout:/sys 2024-09-11T00:24:19.355 INFO:teuthology.orchestra.run.smithi175.stdout:/dev 2024-09-11T00:24:19.355 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/security 2024-09-11T00:24:19.355 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/shm 2024-09-11T00:24:19.355 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/pts 2024-09-11T00:24:19.355 INFO:teuthology.orchestra.run.smithi175.stdout:/run 2024-09-11T00:24:19.355 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/cgroup 2024-09-11T00:24:19.355 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/pstore 2024-09-11T00:24:19.355 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/bpf 2024-09-11T00:24:19.355 INFO:teuthology.orchestra.run.smithi175.stdout:/ 2024-09-11T00:24:19.355 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/selinux 2024-09-11T00:24:19.356 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:24:19.356 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/hugepages 2024-09-11T00:24:19.356 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/mqueue 2024-09-11T00:24:19.356 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/debug 2024-09-11T00:24:19.356 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/tracing 2024-09-11T00:24:19.356 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/fuse/connections 2024-09-11T00:24:19.356 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/config 2024-09-11T00:24:19.356 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:24:19.356 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:24:19.356 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:24:19.356 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:24:19.356 INFO:teuthology.orchestra.run.smithi175.stdout:/run/user/1000 2024-09-11T00:24:19.357 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph 2024-09-11T00:24:19.357 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-4 2024-09-11T00:24:19.357 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-5 2024-09-11T00:24:19.357 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-6 2024-09-11T00:24:19.357 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-7 2024-09-11T00:24:19.357 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns 2024-09-11T00:24:19.357 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:24:19.357 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:24:19.357 INFO:teuthology.orchestra.run.smithi175.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-11T00:24:19.357 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T00:24:19.357 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T00:24:19.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:19.359 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2024-09-11T00:24:19.408 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi175.stderr:2024-09-11T00:24:19.406+0000 7f11d9090480 -1 init, newargv = 0x55a630ca25d0 newargc=15 2024-09-11T00:24:19.408 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi175.stderr:ceph-fuse[41955]: starting ceph client 2024-09-11T00:24:19.416 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi175.stderr:ceph-fuse[41955]: starting fuse 2024-09-11T00:24:19.438 INFO:teuthology.orchestra.run.smithi175.stdout:43 2024-09-11T00:24:19.438 INFO:teuthology.orchestra.run.smithi175.stdout:44 2024-09-11T00:24:19.438 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2024-09-11T00:24:19.439 DEBUG:teuthology.orchestra.run.smithi175:> sudo stdin-killer -- python3 -c ' 2024-09-11T00:24:19.439 DEBUG:teuthology.orchestra.run.smithi175:> import glob 2024-09-11T00:24:19.439 DEBUG:teuthology.orchestra.run.smithi175:> import re 2024-09-11T00:24:19.439 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-09-11T00:24:19.439 DEBUG:teuthology.orchestra.run.smithi175:> import subprocess 2024-09-11T00:24:19.439 DEBUG:teuthology.orchestra.run.smithi175:> 2024-09-11T00:24:19.439 DEBUG:teuthology.orchestra.run.smithi175:> def _find_admin_socket(client_name): 2024-09-11T00:24:19.439 DEBUG:teuthology.orchestra.run.smithi175:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-09-11T00:24:19.439 DEBUG:teuthology.orchestra.run.smithi175:> files = glob.glob(asok_path) 2024-09-11T00:24:19.439 DEBUG:teuthology.orchestra.run.smithi175:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-09-11T00:24:19.439 DEBUG:teuthology.orchestra.run.smithi175:> 2024-09-11T00:24:19.439 DEBUG:teuthology.orchestra.run.smithi175:> # Given a non-glob path, it better be there 2024-09-11T00:24:19.439 DEBUG:teuthology.orchestra.run.smithi175:> if "*" not in asok_path: 2024-09-11T00:24:19.439 DEBUG:teuthology.orchestra.run.smithi175:> assert(len(files) == 1) 2024-09-11T00:24:19.439 DEBUG:teuthology.orchestra.run.smithi175:> return files[0] 2024-09-11T00:24:19.440 DEBUG:teuthology.orchestra.run.smithi175:> 2024-09-11T00:24:19.440 DEBUG:teuthology.orchestra.run.smithi175:> for f in files: 2024-09-11T00:24:19.440 DEBUG:teuthology.orchestra.run.smithi175:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T00:24:19.440 DEBUG:teuthology.orchestra.run.smithi175:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T00:24:19.440 DEBUG:teuthology.orchestra.run.smithi175:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T00:24:19.440 DEBUG:teuthology.orchestra.run.smithi175:> contents = proc_f.read() 2024-09-11T00:24:19.440 DEBUG:teuthology.orchestra.run.smithi175:> if mountpoint in contents: 2024-09-11T00:24:19.440 DEBUG:teuthology.orchestra.run.smithi175:> return f 2024-09-11T00:24:19.440 DEBUG:teuthology.orchestra.run.smithi175:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T00:24:19.440 DEBUG:teuthology.orchestra.run.smithi175:> 2024-09-11T00:24:19.440 DEBUG:teuthology.orchestra.run.smithi175:> print(_find_admin_socket("client.3")) 2024-09-11T00:24:19.440 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-09-11T00:24:19.601 INFO:teuthology.orchestra.run.smithi175.stdout:/var/run/ceph/ceph-client.3.41955.asok 2024-09-11T00:24:19.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-11T00:24:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:19.615 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.41955.asok 2024-09-11T00:24:19.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:19.615 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.41955.asok status 2024-09-11T00:24:19.797 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-11T00:24:19.797 INFO:teuthology.orchestra.run.smithi175.stdout: "metadata": { 2024-09-11T00:24:19.797 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-11T00:24:19.797 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-11T00:24:19.797 INFO:teuthology.orchestra.run.smithi175.stdout: "entity_id": "3", 2024-09-11T00:24:19.797 INFO:teuthology.orchestra.run.smithi175.stdout: "hostname": "smithi175", 2024-09-11T00:24:19.798 INFO:teuthology.orchestra.run.smithi175.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-09-11T00:24:19.798 INFO:teuthology.orchestra.run.smithi175.stdout: "pid": "41955", 2024-09-11T00:24:19.798 INFO:teuthology.orchestra.run.smithi175.stdout: "root": "/" 2024-09-11T00:24:19.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-11T00:24:19.798 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_count": 0, 2024-09-11T00:24:19.798 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_pinned_count": 0, 2024-09-11T00:24:19.798 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 4592, 2024-09-11T00:24:19.798 INFO:teuthology.orchestra.run.smithi175.stdout: "inst": { 2024-09-11T00:24:19.798 INFO:teuthology.orchestra.run.smithi175.stdout: "name": { 2024-09-11T00:24:19.798 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "client", 2024-09-11T00:24:19.798 INFO:teuthology.orchestra.run.smithi175.stdout: "num": 4592 2024-09-11T00:24:19.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-11T00:24:19.798 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2024-09-11T00:24:19.799 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2024-09-11T00:24:19.799 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.2:0", 2024-09-11T00:24:19.799 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 2999382757 2024-09-11T00:24:19.799 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-11T00:24:19.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-11T00:24:19.799 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2024-09-11T00:24:19.799 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2024-09-11T00:24:19.799 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.2:0", 2024-09-11T00:24:19.799 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 2999382757 2024-09-11T00:24:19.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-11T00:24:19.799 INFO:teuthology.orchestra.run.smithi175.stdout: "inst_str": "client.4592 192.168.0.2:0/2999382757", 2024-09-11T00:24:19.799 INFO:teuthology.orchestra.run.smithi175.stdout: "addr_str": "192.168.0.2:0/2999382757", 2024-09-11T00:24:19.799 INFO:teuthology.orchestra.run.smithi175.stdout: "inode_count": 1, 2024-09-11T00:24:19.799 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_epoch": 8, 2024-09-11T00:24:19.800 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch": 22, 2024-09-11T00:24:19.800 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch_barrier": 0, 2024-09-11T00:24:19.800 INFO:teuthology.orchestra.run.smithi175.stdout: "blocklisted": false, 2024-09-11T00:24:19.800 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs" 2024-09-11T00:24:19.800 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-11T00:24:19.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:19.809 DEBUG:teuthology.orchestra.run.smithi040:> stat --file-system '--printf=%T 2024-09-11T00:24:19.809 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T00:24:19.849 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2024-09-11T00:24:19.849 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T00:24:19.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:19.850 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T00:24:19.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:19.954 DEBUG:teuthology.orchestra.run.smithi040:> stat --file-system '--printf=%T 2024-09-11T00:24:19.954 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-11T00:24:19.991 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2024-09-11T00:24:19.992 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-11T00:24:19.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:19.992 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-11T00:24:20.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:20.097 DEBUG:teuthology.orchestra.run.smithi175:> stat --file-system '--printf=%T 2024-09-11T00:24:20.097 DEBUG:teuthology.orchestra.run.smithi175:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-11T00:24:20.133 INFO:teuthology.orchestra.run.smithi175.stdout:fuseblk 2024-09-11T00:24:20.133 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-11T00:24:20.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:20.133 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T00:24:20.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:20.229 DEBUG:teuthology.orchestra.run.smithi175:> stat --file-system '--printf=%T 2024-09-11T00:24:20.229 DEBUG:teuthology.orchestra.run.smithi175:> ' -- /home/ubuntu/cephtest/mnt.3 2024-09-11T00:24:20.265 INFO:teuthology.orchestra.run.smithi175.stdout:fuseblk 2024-09-11T00:24:20.265 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-09-11T00:24:20.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:20.265 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-11T00:24:20.361 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-11T00:24:20.428 INFO:tasks.cephfs_test_runner:Starting test: test_acls (tasks.cephfs.test_acls.TestACLs) 2024-09-11T00:24:20.428 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:24:20.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.589+0000 7fa27ee00640 1 -- 172.21.15.40:0/1211411290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa27815bcc0 msgr2=0x7fa2780cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:20.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.589+0000 7fa27ee00640 1 --2- 172.21.15.40:0/1211411290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa27815bcc0 0x7fa2780cb420 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa268005fd0 tx=0x7fa26802a530 comp rx=0 tx=0).stop 2024-09-11T00:24:20.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.589+0000 7fa27ee00640 1 -- 172.21.15.40:0/1211411290 shutdown_connections 2024-09-11T00:24:20.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.589+0000 7fa27ee00640 1 --2- 172.21.15.40:0/1211411290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2780cba70 0x7fa2780cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:20.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.589+0000 7fa27ee00640 1 --2- 172.21.15.40:0/1211411290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa27815bcc0 0x7fa2780cb420 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:20.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.589+0000 7fa27ee00640 1 -- 172.21.15.40:0/1211411290 >> 172.21.15.40:0/1211411290 conn(0x7fa2780cfbb0 msgr2=0x7fa2780cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:20.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.589+0000 7fa27ee00640 1 -- 172.21.15.40:0/1211411290 shutdown_connections 2024-09-11T00:24:20.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.589+0000 7fa27ee00640 1 -- 172.21.15.40:0/1211411290 wait complete. 2024-09-11T00:24:20.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.591+0000 7fa27ee00640 1 Processor -- start 2024-09-11T00:24:20.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.591+0000 7fa27ee00640 1 -- start start 2024-09-11T00:24:20.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.592+0000 7fa27ee00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2780ca200 0x7fa27814f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:20.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.592+0000 7fa27ee00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2780cba70 0x7fa27815eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:20.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.592+0000 7fa27ee00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa27815bcc0 0x7fa2780b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:20.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.592+0000 7fa27ee00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa27815f940 con 0x7fa27815bcc0 2024-09-11T00:24:20.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.592+0000 7fa27ee00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa27815f7c0 con 0x7fa2780cba70 2024-09-11T00:24:20.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.592+0000 7fa27ee00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa2780cada0 con 0x7fa2780ca200 2024-09-11T00:24:20.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.592+0000 7fa27ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa27815bcc0 0x7fa2780b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:20.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.592+0000 7fa27ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa27815bcc0 0x7fa2780b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59674/0 (socket says 172.21.15.40:59674) 2024-09-11T00:24:20.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.592+0000 7fa27ce00640 1 -- 172.21.15.40:0/3392895725 learned_addr learned my addr 172.21.15.40:0/3392895725 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:20.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.592+0000 7fa277e00640 1 --2- 172.21.15.40:0/3392895725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2780ca200 0x7fa27814f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:20.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.592+0000 7fa26f400640 1 --2- 172.21.15.40:0/3392895725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2780cba70 0x7fa27815eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:20.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.592+0000 7fa27ce00640 1 -- 172.21.15.40:0/3392895725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2780ca200 msgr2=0x7fa27814f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:20.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.592+0000 7fa27ce00640 1 --2- 172.21.15.40:0/3392895725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2780ca200 0x7fa27814f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:20.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.592+0000 7fa27ce00640 1 -- 172.21.15.40:0/3392895725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2780cba70 msgr2=0x7fa27815eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:20.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.592+0000 7fa27ce00640 1 --2- 172.21.15.40:0/3392895725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2780cba70 0x7fa27815eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:20.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.592+0000 7fa27ce00640 1 -- 172.21.15.40:0/3392895725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa27814f580 con 0x7fa27815bcc0 2024-09-11T00:24:20.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.593+0000 7fa27ce00640 1 --2- 172.21.15.40:0/3392895725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa27815bcc0 0x7fa2780b3a30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa27000c780 tx=0x7fa27000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:20.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.593+0000 7fa274c00640 1 -- 172.21.15.40:0/3392895725 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270004b60 con 0x7fa27815bcc0 2024-09-11T00:24:20.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.593+0000 7fa274c00640 1 -- 172.21.15.40:0/3392895725 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa270004e10 con 0x7fa27815bcc0 2024-09-11T00:24:20.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.593+0000 7fa274c00640 1 -- 172.21.15.40:0/3392895725 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270005290 con 0x7fa27815bcc0 2024-09-11T00:24:20.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.593+0000 7fa27ee00640 1 -- 172.21.15.40:0/3392895725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa27815cbd0 con 0x7fa27815bcc0 2024-09-11T00:24:20.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.593+0000 7fa27ee00640 1 -- 172.21.15.40:0/3392895725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa27815d190 con 0x7fa27815bcc0 2024-09-11T00:24:20.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.594+0000 7fa27ee00640 1 -- 172.21.15.40:0/3392895725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa27806f970 con 0x7fa27815bcc0 2024-09-11T00:24:20.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.595+0000 7fa274c00640 1 -- 172.21.15.40:0/3392895725 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa270005430 con 0x7fa27815bcc0 2024-09-11T00:24:20.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.596+0000 7fa274c00640 1 --2- 172.21.15.40:0/3392895725 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa254077f70 0x7fa25407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:20.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.597+0000 7fa274c00640 1 -- 172.21.15.40:0/3392895725 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa270099f30 con 0x7fa27815bcc0 2024-09-11T00:24:20.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.597+0000 7fa277e00640 1 --2- 172.21.15.40:0/3392895725 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa254077f70 0x7fa25407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:20.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.598+0000 7fa277e00640 1 --2- 172.21.15.40:0/3392895725 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa254077f70 0x7fa25407a430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa268033000 tx=0x7fa268004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:20.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.601+0000 7fa274c00640 1 -- 172.21.15.40:0/3392895725 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa270020070 con 0x7fa27815bcc0 2024-09-11T00:24:20.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.800+0000 7fa27ee00640 1 -- 172.21.15.40:0/3392895725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa278076260 con 0x7fa27815bcc0 2024-09-11T00:24:20.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.801+0000 7fa274c00640 1 -- 172.21.15.40:0/3392895725 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16641 (secure 0 0 0) 0x7fa27814f580 con 0x7fa27815bcc0 2024-09-11T00:24:20.803 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:20.803 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":22,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","created":"2024-09-11T00:23:22.512139+0000","modified":"2024-09-11T00:23:49.924132+0000","last_up_change":"2024-09-11T00:23:36.842446+0000","last_in_change":"2024-09-11T00:23:26.734953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:23:37.800502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:23:46.379819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:23:47.307802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee10e123-8817-4d94-a340-73d00121af37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6801","nonce":973366008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6803","nonce":973366008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6807","nonce":973366008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6805","nonce":973366008}]},"public_addr":"172.21.15.40:6801/973366008","cluster_addr":"172.21.15.40:6803/973366008","heartbeat_back_addr":"172.21.15.40:6807/973366008","heartbeat_front_addr":"172.21.15.40:6805/973366008","state":["exists","up"]},{"osd":1,"uuid":"f90895e9-8660-42b9-8aba-3f9d4d130b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6823","nonce":2542266029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6827","nonce":2542266029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6831","nonce":2542266029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6829","nonce":2542266029}]},"public_addr":"172.21.15.40:6823/2542266029","cluster_addr":"172.21.15.40:6827/2542266029","heartbeat_back_addr":"172.21.15.40:6831/2542266029","heartbeat_front_addr":"172.21.15.40:6829/2542266029","state":["exists","up"]},{"osd":2,"uuid":"a190497a-2aba-4748-8f1d-7e372259d65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6815","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6817","nonce":559505356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6819","nonce":559505356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6826","nonce":559505356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6822","nonce":559505356}]},"public_addr":"172.21.15.40:6817/559505356","cluster_addr":"172.21.15.40:6819/559505356","heartbeat_back_addr":"172.21.15.40:6826/559505356","heartbeat_front_addr":"172.21.15.40:6822/559505356","state":["exists","up"]},{"osd":3,"uuid":"8be32ced-898a-46f2-b850-1517667766b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6809","nonce":503633839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6811","nonce":503633839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6816","nonce":503633839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6813","nonce":503633839}]},"public_addr":"172.21.15.40:6809/503633839","cluster_addr":"172.21.15.40:6811/503633839","heartbeat_back_addr":"172.21.15.40:6816/503633839","heartbeat_front_addr":"172.21.15.40:6813/503633839","state":["exists","up"]},{"osd":4,"uuid":"9867fdfc-6f93-466e-b768-b5a1da7157de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6811","nonce":2418348042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6813","nonce":2418348042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6817","nonce":2418348042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6815","nonce":2418348042}]},"public_addr":"172.21.15.175:6811/2418348042","cluster_addr":"172.21.15.175:6813/2418348042","heartbeat_back_addr":"172.21.15.175:6817/2418348042","heartbeat_front_addr":"172.21.15.175:6815/2418348042","state":["exists","up"]},{"osd":5,"uuid":"e2f6f616-b5db-466e-942f-e2762171a8ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6827","nonce":520822300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6829","nonce":520822300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6833","nonce":520822300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6831","nonce":520822300}]},"public_addr":"172.21.15.175:6827/520822300","cluster_addr":"172.21.15.175:6829/520822300","heartbeat_back_addr":"172.21.15.175:6833/520822300","heartbeat_front_addr":"172.21.15.175:6831/520822300","state":["exists","up"]},{"osd":6,"uuid":"807ac045-bf63-4ff6-9a06-7f7022f9ef32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6819","nonce":1431736593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6821","nonce":1431736593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6825","nonce":1431736593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6823","nonce":1431736593}]},"public_addr":"172.21.15.175:6819/1431736593","cluster_addr":"172.21.15.175:6821/1431736593","heartbeat_back_addr":"172.21.15.175:6825/1431736593","heartbeat_front_addr":"172.21.15.175:6823/1431736593","state":["exists","up"]},{"osd":7,"uuid":"8e0b3293-390f-4b43-b29d-babdc5e88f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6803","nonce":3300317000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6805","nonce":3300317000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6809","nonce":3300317000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6807","nonce":3300317000}]},"public_addr":"172.21.15.175:6803/3300317000","cluster_addr":"172.21.15.175:6805/3300317000","heartbeat_back_addr":"172.21.15.175:6809/3300317000","heartbeat_front_addr":"172.21.15.175:6807/3300317000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:32.967062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.266558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.063509+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.616332+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.431077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.866822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.645225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.016210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:24:20.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.803+0000 7fa27ee00640 1 -- 172.21.15.40:0/3392895725 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa254077f70 msgr2=0x7fa25407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:20.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.803+0000 7fa27ee00640 1 --2- 172.21.15.40:0/3392895725 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa254077f70 0x7fa25407a430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa268033000 tx=0x7fa268004730 comp rx=0 tx=0).stop 2024-09-11T00:24:20.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.803+0000 7fa27ee00640 1 -- 172.21.15.40:0/3392895725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa27815bcc0 msgr2=0x7fa2780b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:20.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.803+0000 7fa27ee00640 1 --2- 172.21.15.40:0/3392895725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa27815bcc0 0x7fa2780b3a30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa27000c780 tx=0x7fa27000cb80 comp rx=0 tx=0).stop 2024-09-11T00:24:20.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.803+0000 7fa27ee00640 1 -- 172.21.15.40:0/3392895725 shutdown_connections 2024-09-11T00:24:20.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.803+0000 7fa27ee00640 1 --2- 172.21.15.40:0/3392895725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa27815bcc0 0x7fa2780b3a30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:20.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.803+0000 7fa27ee00640 1 --2- 172.21.15.40:0/3392895725 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa254077f70 0x7fa25407a430 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:20.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.803+0000 7fa27ee00640 1 --2- 172.21.15.40:0/3392895725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2780cba70 0x7fa27815eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:20.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.803+0000 7fa27ee00640 1 --2- 172.21.15.40:0/3392895725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2780ca200 0x7fa27814f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:20.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.803+0000 7fa27ee00640 1 -- 172.21.15.40:0/3392895725 >> 172.21.15.40:0/3392895725 conn(0x7fa2780cfbb0 msgr2=0x7fa2780ad870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:20.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.803+0000 7fa27ee00640 1 -- 172.21.15.40:0/3392895725 shutdown_connections 2024-09-11T00:24:20.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.803+0000 7fa27ee00640 1 -- 172.21.15.40:0/3392895725 wait complete. 2024-09-11T00:24:20.821 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T00:23:37.800502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T00:23:46.379819+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T00:23:47.307802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T00:24:20.822 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T00:24:20.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.988+0000 7f863a200640 1 -- 172.21.15.40:0/2636278804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86340b2eb0 msgr2=0x7f86340d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:20.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.988+0000 7f863a200640 1 --2- 172.21.15.40:0/2636278804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86340b2eb0 0x7f86340d0020 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f861c009830 tx=0x7f861c02a3f0 comp rx=0 tx=0).stop 2024-09-11T00:24:20.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.988+0000 7f863a200640 1 -- 172.21.15.40:0/2636278804 shutdown_connections 2024-09-11T00:24:20.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.988+0000 7f863a200640 1 --2- 172.21.15.40:0/2636278804 >> v2:172.21.15.175:3300/0 conn(0x7f86340af160 0x7f86340af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:20.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.988+0000 7f863a200640 1 --2- 172.21.15.40:0/2636278804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86340b2eb0 0x7f86340d0020 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:20.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.988+0000 7f863a200640 1 -- 172.21.15.40:0/2636278804 >> 172.21.15.40:0/2636278804 conn(0x7f86340d19a0 msgr2=0x7f86340d1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:20.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.988+0000 7f863a200640 1 -- 172.21.15.40:0/2636278804 shutdown_connections 2024-09-11T00:24:20.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.988+0000 7f863a200640 1 -- 172.21.15.40:0/2636278804 wait complete. 2024-09-11T00:24:20.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.989+0000 7f863a200640 1 Processor -- start 2024-09-11T00:24:20.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.990+0000 7f863a200640 1 -- start start 2024-09-11T00:24:20.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.990+0000 7f863a200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86340af160 0x7f86340c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:20.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.990+0000 7f863a200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86340b2eb0 0x7f86341f7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.990+0000 7f863a200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f863415f010 0x7f86341f5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.990+0000 7f863a200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f863415f600 con 0x7f863415f010 2024-09-11T00:24:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.990+0000 7f863a200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f86340b2b00 con 0x7f86340af160 2024-09-11T00:24:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.990+0000 7f863a200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f86340afb50 con 0x7f86340b2eb0 2024-09-11T00:24:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.991+0000 7f8639800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f863415f010 0x7f86341f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.991+0000 7f8639800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f863415f010 0x7f86341f5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59684/0 (socket says 172.21.15.40:59684) 2024-09-11T00:24:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.991+0000 7f8639800640 1 -- 172.21.15.40:0/2421642488 learned_addr learned my addr 172.21.15.40:0/2421642488 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.991+0000 7f8638e00640 1 --2- 172.21.15.40:0/2421642488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86340af160 0x7f86340c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.991+0000 7f862be00640 1 --2- 172.21.15.40:0/2421642488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86340b2eb0 0x7f86341f7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.991+0000 7f8639800640 1 -- 172.21.15.40:0/2421642488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86340b2eb0 msgr2=0x7f86341f7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.991+0000 7f8639800640 1 --2- 172.21.15.40:0/2421642488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86340b2eb0 0x7f86341f7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:20.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.991+0000 7f8639800640 1 -- 172.21.15.40:0/2421642488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86340af160 msgr2=0x7f86340c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:20.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.991+0000 7f8639800640 1 --2- 172.21.15.40:0/2421642488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86340af160 0x7f86340c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:20.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.991+0000 7f8639800640 1 -- 172.21.15.40:0/2421642488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86341f78c0 con 0x7f863415f010 2024-09-11T00:24:20.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.991+0000 7f8639800640 1 --2- 172.21.15.40:0/2421642488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f863415f010 0x7f86341f5710 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f862c00eb10 tx=0x7f862c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:20.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.992+0000 7f8631600640 1 -- 172.21.15.40:0/2421642488 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c004b20 con 0x7f863415f010 2024-09-11T00:24:20.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.992+0000 7f8631600640 1 -- 172.21.15.40:0/2421642488 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f862c004ce0 con 0x7f863415f010 2024-09-11T00:24:20.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.992+0000 7f8631600640 1 -- 172.21.15.40:0/2421642488 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c005280 con 0x7f863415f010 2024-09-11T00:24:20.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.992+0000 7f863a200640 1 -- 172.21.15.40:0/2421642488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86341f88f0 con 0x7f863415f010 2024-09-11T00:24:20.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.992+0000 7f863a200640 1 -- 172.21.15.40:0/2421642488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f863406e0f0 con 0x7f863415f010 2024-09-11T00:24:20.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.993+0000 7f863a200640 1 -- 172.21.15.40:0/2421642488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86340af610 con 0x7f863415f010 2024-09-11T00:24:20.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.994+0000 7f8631600640 1 -- 172.21.15.40:0/2421642488 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f862c005420 con 0x7f863415f010 2024-09-11T00:24:20.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.995+0000 7f8631600640 1 --2- 172.21.15.40:0/2421642488 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8610077f70 0x7f861007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:20.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.995+0000 7f8631600640 1 -- 172.21.15.40:0/2421642488 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f862c09abc0 con 0x7f863415f010 2024-09-11T00:24:20.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.995+0000 7f8638e00640 1 --2- 172.21.15.40:0/2421642488 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8610077f70 0x7f861007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:20.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.996+0000 7f8638e00640 1 --2- 172.21.15.40:0/2421642488 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8610077f70 0x7f861007a430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8624001610 tx=0x7f8624009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:21.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:20.999+0000 7f8631600640 1 -- 172.21.15.40:0/2421642488 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f862c063590 con 0x7f863415f010 2024-09-11T00:24:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.196+0000 7f863a200640 1 -- 172.21.15.40:0/2421642488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f86340b3670 con 0x7f863415f010 2024-09-11T00:24:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.197+0000 7f8631600640 1 -- 172.21.15.40:0/2421642488 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f862c062e90 con 0x7f863415f010 2024-09-11T00:24:21.199 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-09-11T00:24:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.200+0000 7f863a200640 1 -- 172.21.15.40:0/2421642488 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8610077f70 msgr2=0x7f861007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.200+0000 7f863a200640 1 --2- 172.21.15.40:0/2421642488 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8610077f70 0x7f861007a430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8624001610 tx=0x7f8624009040 comp rx=0 tx=0).stop 2024-09-11T00:24:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.200+0000 7f863a200640 1 -- 172.21.15.40:0/2421642488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f863415f010 msgr2=0x7f86341f5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.200+0000 7f863a200640 1 --2- 172.21.15.40:0/2421642488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f863415f010 0x7f86341f5710 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f862c00eb10 tx=0x7f862c00c2d0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.200+0000 7f863a200640 1 -- 172.21.15.40:0/2421642488 shutdown_connections 2024-09-11T00:24:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.200+0000 7f863a200640 1 --2- 172.21.15.40:0/2421642488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f863415f010 0x7f86341f5710 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.200+0000 7f863a200640 1 --2- 172.21.15.40:0/2421642488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86340b2eb0 0x7f86341f7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.200+0000 7f863a200640 1 --2- 172.21.15.40:0/2421642488 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8610077f70 0x7f861007a430 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.200+0000 7f863a200640 1 --2- 172.21.15.40:0/2421642488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86340af160 0x7f86340c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.200+0000 7f863a200640 1 -- 172.21.15.40:0/2421642488 >> 172.21.15.40:0/2421642488 conn(0x7f86340d19a0 msgr2=0x7f863415e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.200+0000 7f863a200640 1 -- 172.21.15.40:0/2421642488 shutdown_connections 2024-09-11T00:24:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.200+0000 7f863a200640 1 -- 172.21.15.40:0/2421642488 wait complete. 2024-09-11T00:24:21.217 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T00:24:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.380+0000 7f9e39800640 1 -- 172.21.15.40:0/4070059916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e3406e910 msgr2=0x7f9e3406edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.380+0000 7f9e39800640 1 --2- 172.21.15.40:0/4070059916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e3406e910 0x7f9e3406edc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c005fd0 tx=0x7f9e2c02aaa0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.380+0000 7f9e39800640 1 -- 172.21.15.40:0/4070059916 shutdown_connections 2024-09-11T00:24:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.380+0000 7f9e39800640 1 --2- 172.21.15.40:0/4070059916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e3406e910 0x7f9e3406edc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.380+0000 7f9e39800640 1 --2- 172.21.15.40:0/4070059916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e3415bcc0 0x7f9e340cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.380+0000 7f9e39800640 1 -- 172.21.15.40:0/4070059916 >> 172.21.15.40:0/4070059916 conn(0x7f9e340cfbb0 msgr2=0x7f9e340cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.380+0000 7f9e39800640 1 -- 172.21.15.40:0/4070059916 shutdown_connections 2024-09-11T00:24:21.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.380+0000 7f9e39800640 1 -- 172.21.15.40:0/4070059916 wait complete. 2024-09-11T00:24:21.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.382+0000 7f9e39800640 1 Processor -- start 2024-09-11T00:24:21.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.382+0000 7f9e39800640 1 -- start start 2024-09-11T00:24:21.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.383+0000 7f9e39800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e3406e910 0x7f9e341f8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.383+0000 7f9e39800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e340cba70 0x7f9e340ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.383+0000 7f9e39800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e3415bcc0 0x7f9e340b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.383+0000 7f9e39800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3406f300 con 0x7f9e3406e910 2024-09-11T00:24:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.383+0000 7f9e39800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3415f9d0 con 0x7f9e3415bcc0 2024-09-11T00:24:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.383+0000 7f9e39800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9e3406f480 con 0x7f9e340cba70 2024-09-11T00:24:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.383+0000 7f9e32a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e3406e910 0x7f9e341f8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.383+0000 7f9e32a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e3406e910 0x7f9e341f8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59692/0 (socket says 172.21.15.40:59692) 2024-09-11T00:24:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.383+0000 7f9e32a00640 1 -- 172.21.15.40:0/198824167 learned_addr learned my addr 172.21.15.40:0/198824167 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:21.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.384+0000 7f9e2a000640 1 --2- 172.21.15.40:0/198824167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e340cba70 0x7f9e340ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.384+0000 7f9e32a00640 1 -- 172.21.15.40:0/198824167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e340cba70 msgr2=0x7f9e340ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.384+0000 7f9e32a00640 1 --2- 172.21.15.40:0/198824167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e340cba70 0x7f9e340ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.384+0000 7f9e33400640 1 --2- 172.21.15.40:0/198824167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e3415bcc0 0x7f9e340b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.384+0000 7f9e32a00640 1 -- 172.21.15.40:0/198824167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e3415bcc0 msgr2=0x7f9e340b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.384+0000 7f9e32a00640 1 --2- 172.21.15.40:0/198824167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e3415bcc0 0x7f9e340b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.384+0000 7f9e32a00640 1 -- 172.21.15.40:0/198824167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e341f45a0 con 0x7f9e3406e910 2024-09-11T00:24:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.384+0000 7f9e2a000640 1 --2- 172.21.15.40:0/198824167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e340cba70 0x7f9e340ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.384+0000 7f9e33400640 1 --2- 172.21.15.40:0/198824167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e3415bcc0 0x7f9e340b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.384+0000 7f9e32a00640 1 --2- 172.21.15.40:0/198824167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e3406e910 0x7f9e341f8610 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400e790 tx=0x7f9e2400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.384+0000 7f9e2b400640 1 -- 172.21.15.40:0/198824167 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2400eea0 con 0x7f9e3406e910 2024-09-11T00:24:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.384+0000 7f9e2b400640 1 -- 172.21.15.40:0/198824167 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e2400cd50 con 0x7f9e3406e910 2024-09-11T00:24:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.384+0000 7f9e2b400640 1 -- 172.21.15.40:0/198824167 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e24010690 con 0x7f9e3406e910 2024-09-11T00:24:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.384+0000 7f9e39800640 1 -- 172.21.15.40:0/198824167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e340cf640 con 0x7f9e3406e910 2024-09-11T00:24:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.384+0000 7f9e39800640 1 -- 172.21.15.40:0/198824167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e341f4b40 con 0x7f9e3406e910 2024-09-11T00:24:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.386+0000 7f9e39800640 1 -- 172.21.15.40:0/198824167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e3406f950 con 0x7f9e3406e910 2024-09-11T00:24:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.387+0000 7f9e2b400640 1 -- 172.21.15.40:0/198824167 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9e24010830 con 0x7f9e3406e910 2024-09-11T00:24:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.388+0000 7f9e2b400640 1 --2- 172.21.15.40:0/198824167 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9e10077f70 0x7f9e1007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.388+0000 7f9e2b400640 1 -- 172.21.15.40:0/198824167 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9e2409a710 con 0x7f9e3406e910 2024-09-11T00:24:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.388+0000 7f9e2a000640 1 --2- 172.21.15.40:0/198824167 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9e10077f70 0x7f9e1007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.389+0000 7f9e2a000640 1 --2- 172.21.15.40:0/198824167 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9e10077f70 0x7f9e1007a430 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9e34070330 tx=0x7f9e1c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.392+0000 7f9e2b400640 1 -- 172.21.15.40:0/198824167 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9e24063210 con 0x7f9e3406e910 2024-09-11T00:24:21.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.585+0000 7f9e39800640 1 -- 172.21.15.40:0/198824167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9e3415b4c0 con 0x7f9e3406e910 2024-09-11T00:24:21.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.585+0000 7f9e2b400640 1 -- 172.21.15.40:0/198824167 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f9e24062b10 con 0x7f9e3406e910 2024-09-11T00:24:21.587 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-11T00:24:21.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.588+0000 7f9e39800640 1 -- 172.21.15.40:0/198824167 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9e10077f70 msgr2=0x7f9e1007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.588+0000 7f9e39800640 1 --2- 172.21.15.40:0/198824167 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9e10077f70 0x7f9e1007a430 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9e34070330 tx=0x7f9e1c009040 comp rx=0 tx=0).stop 2024-09-11T00:24:21.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.588+0000 7f9e39800640 1 -- 172.21.15.40:0/198824167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e3406e910 msgr2=0x7f9e341f8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.588+0000 7f9e39800640 1 --2- 172.21.15.40:0/198824167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e3406e910 0x7f9e341f8610 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400e790 tx=0x7f9e2400ec50 comp rx=0 tx=0).stop 2024-09-11T00:24:21.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.588+0000 7f9e39800640 1 -- 172.21.15.40:0/198824167 shutdown_connections 2024-09-11T00:24:21.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.588+0000 7f9e39800640 1 --2- 172.21.15.40:0/198824167 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9e10077f70 0x7f9e1007a430 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.588+0000 7f9e39800640 1 --2- 172.21.15.40:0/198824167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e3415bcc0 0x7f9e340b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.588+0000 7f9e39800640 1 --2- 172.21.15.40:0/198824167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e340cba70 0x7f9e340ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.588+0000 7f9e39800640 1 --2- 172.21.15.40:0/198824167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e3406e910 0x7f9e341f8610 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.588+0000 7f9e39800640 1 -- 172.21.15.40:0/198824167 >> 172.21.15.40:0/198824167 conn(0x7f9e340cfbb0 msgr2=0x7f9e340b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:21.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.588+0000 7f9e39800640 1 -- 172.21.15.40:0/198824167 shutdown_connections 2024-09-11T00:24:21.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.588+0000 7f9e39800640 1 -- 172.21.15.40:0/198824167 wait complete. 2024-09-11T00:24:21.605 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T00:24:21.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.768+0000 7fc341800640 1 -- 172.21.15.40:0/1259235387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc33c15e100 msgr2=0x7fc33c15ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.768+0000 7fc341800640 1 --2- 172.21.15.40:0/1259235387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc33c15e100 0x7fc33c15ba60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0cc5d0 tx=0x7fc32c02a560 comp rx=0 tx=0).stop 2024-09-11T00:24:21.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.768+0000 7fc341800640 1 -- 172.21.15.40:0/1259235387 shutdown_connections 2024-09-11T00:24:21.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.768+0000 7fc341800640 1 --2- 172.21.15.40:0/1259235387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc33c0cae90 0x7fc33c15e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.768+0000 7fc341800640 1 --2- 172.21.15.40:0/1259235387 >> v2:172.21.15.175:3300/0 conn(0x7fc33c15c3b0 0x7fc33c0ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.768+0000 7fc341800640 1 --2- 172.21.15.40:0/1259235387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc33c15e100 0x7fc33c15ba60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.768+0000 7fc341800640 1 -- 172.21.15.40:0/1259235387 >> 172.21.15.40:0/1259235387 conn(0x7fc33c0cfbb0 msgr2=0x7fc33c0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:21.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.769+0000 7fc341800640 1 -- 172.21.15.40:0/1259235387 shutdown_connections 2024-09-11T00:24:21.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.769+0000 7fc341800640 1 -- 172.21.15.40:0/1259235387 wait complete. 2024-09-11T00:24:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.770+0000 7fc341800640 1 Processor -- start 2024-09-11T00:24:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.770+0000 7fc341800640 1 -- start start 2024-09-11T00:24:21.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.771+0000 7fc341800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc33c0cae90 0x7fc33c0c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.771+0000 7fc341800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc33c15c3b0 0x7fc33c148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.771+0000 7fc341800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc33c15e100 0x7fc33c1f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.771+0000 7fc341800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c15eb10 con 0x7fc33c15e100 2024-09-11T00:24:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.771+0000 7fc341800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c0ca410 con 0x7fc33c15c3b0 2024-09-11T00:24:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.771+0000 7fc341800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc33c15ec90 con 0x7fc33c0cae90 2024-09-11T00:24:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.772+0000 7fc33b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc33c15e100 0x7fc33c1f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.772+0000 7fc33b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc33c15e100 0x7fc33c1f8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59712/0 (socket says 172.21.15.40:59712) 2024-09-11T00:24:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.772+0000 7fc33b400640 1 -- 172.21.15.40:0/1101819018 learned_addr learned my addr 172.21.15.40:0/1101819018 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.772+0000 7fc33aa00640 1 --2- 172.21.15.40:0/1101819018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc33c0cae90 0x7fc33c0c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.772+0000 7fc332000640 1 --2- 172.21.15.40:0/1101819018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc33c15c3b0 0x7fc33c148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.772+0000 7fc33b400640 1 -- 172.21.15.40:0/1101819018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc33c0cae90 msgr2=0x7fc33c0c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.772+0000 7fc33b400640 1 --2- 172.21.15.40:0/1101819018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc33c0cae90 0x7fc33c0c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.772+0000 7fc33b400640 1 -- 172.21.15.40:0/1101819018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc33c15c3b0 msgr2=0x7fc33c148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.772+0000 7fc33b400640 1 --2- 172.21.15.40:0/1101819018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc33c15c3b0 0x7fc33c148040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.772+0000 7fc33b400640 1 -- 172.21.15.40:0/1101819018 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33c1f9310 con 0x7fc33c15e100 2024-09-11T00:24:21.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.772+0000 7fc33b400640 1 --2- 172.21.15.40:0/1101819018 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc33c15e100 0x7fc33c1f8dd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc33400e910 tx=0x7fc33400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:21.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.773+0000 7fc333400640 1 -- 172.21.15.40:0/1101819018 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334004d20 con 0x7fc33c15e100 2024-09-11T00:24:21.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.773+0000 7fc333400640 1 -- 172.21.15.40:0/1101819018 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc33400cb20 con 0x7fc33c15e100 2024-09-11T00:24:21.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.773+0000 7fc333400640 1 -- 172.21.15.40:0/1101819018 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334005020 con 0x7fc33c15e100 2024-09-11T00:24:21.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.773+0000 7fc341800640 1 -- 172.21.15.40:0/1101819018 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc33c159fe0 con 0x7fc33c15e100 2024-09-11T00:24:21.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.773+0000 7fc341800640 1 -- 172.21.15.40:0/1101819018 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc33c1673c0 con 0x7fc33c15e100 2024-09-11T00:24:21.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.774+0000 7fc341800640 1 -- 172.21.15.40:0/1101819018 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc33c15f220 con 0x7fc33c15e100 2024-09-11T00:24:21.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.775+0000 7fc333400640 1 -- 172.21.15.40:0/1101819018 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc33400f040 con 0x7fc33c15e100 2024-09-11T00:24:21.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.776+0000 7fc333400640 1 --2- 172.21.15.40:0/1101819018 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc318077f70 0x7fc31807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.777+0000 7fc333400640 1 -- 172.21.15.40:0/1101819018 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc33409a2b0 con 0x7fc33c15e100 2024-09-11T00:24:21.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.777+0000 7fc33aa00640 1 --2- 172.21.15.40:0/1101819018 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc318077f70 0x7fc31807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.778+0000 7fc33aa00640 1 --2- 172.21.15.40:0/1101819018 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc318077f70 0x7fc31807a430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc32c033000 tx=0x7fc32c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:21.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.781+0000 7fc333400640 1 -- 172.21.15.40:0/1101819018 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc33c1f9310 con 0x7fc33c15e100 2024-09-11T00:24:21.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.973+0000 7fc341800640 1 -- 172.21.15.40:0/1101819018 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc33c0c9a90 con 0x7fc33c15e100 2024-09-11T00:24:21.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.974+0000 7fc333400640 1 -- 172.21.15.40:0/1101819018 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fc334016030 con 0x7fc33c15e100 2024-09-11T00:24:21.975 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-09-11T00:24:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.976+0000 7fc341800640 1 -- 172.21.15.40:0/1101819018 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc318077f70 msgr2=0x7fc31807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.976+0000 7fc341800640 1 --2- 172.21.15.40:0/1101819018 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc318077f70 0x7fc31807a430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc32c033000 tx=0x7fc32c004730 comp rx=0 tx=0).stop 2024-09-11T00:24:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.976+0000 7fc341800640 1 -- 172.21.15.40:0/1101819018 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc33c15e100 msgr2=0x7fc33c1f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.976+0000 7fc341800640 1 --2- 172.21.15.40:0/1101819018 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc33c15e100 0x7fc33c1f8dd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc33400e910 tx=0x7fc33400edd0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.976+0000 7fc341800640 1 -- 172.21.15.40:0/1101819018 shutdown_connections 2024-09-11T00:24:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.976+0000 7fc341800640 1 --2- 172.21.15.40:0/1101819018 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc33c15e100 0x7fc33c1f8dd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.976+0000 7fc341800640 1 --2- 172.21.15.40:0/1101819018 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc318077f70 0x7fc31807a430 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.976+0000 7fc341800640 1 --2- 172.21.15.40:0/1101819018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc33c15c3b0 0x7fc33c148040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.976+0000 7fc341800640 1 --2- 172.21.15.40:0/1101819018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc33c0cae90 0x7fc33c0c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.976+0000 7fc341800640 1 -- 172.21.15.40:0/1101819018 >> 172.21.15.40:0/1101819018 conn(0x7fc33c0cfbb0 msgr2=0x7fc33c06f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:21.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.976+0000 7fc341800640 1 -- 172.21.15.40:0/1101819018 shutdown_connections 2024-09-11T00:24:21.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:21.976+0000 7fc341800640 1 -- 172.21.15.40:0/1101819018 wait complete. 2024-09-11T00:24:21.994 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_acls.TestACLs.test_acls' 2024-09-11T00:24:22.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.154+0000 7fc3a3200640 1 -- 172.21.15.40:0/4234559615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3a406efa0 msgr2=0x7fc3a4073830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:22.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.154+0000 7fc3a3200640 1 --2- 172.21.15.40:0/4234559615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3a406efa0 0x7fc3a4073830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc3a406e2a0 tx=0x7fc39002a530 comp rx=0 tx=0).stop 2024-09-11T00:24:22.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.154+0000 7fc3a3200640 1 -- 172.21.15.40:0/4234559615 shutdown_connections 2024-09-11T00:24:22.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.154+0000 7fc3a3200640 1 --2- 172.21.15.40:0/4234559615 >> v2:172.21.15.175:3300/0 conn(0x7fc3a40ae640 0x7fc3a4073d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:22.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.154+0000 7fc3a3200640 1 --2- 172.21.15.40:0/4234559615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3a406efa0 0x7fc3a4073830 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:22.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.154+0000 7fc3a3200640 1 -- 172.21.15.40:0/4234559615 >> 172.21.15.40:0/4234559615 conn(0x7fc3a40cf770 msgr2=0x7fc3a40cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:22.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.154+0000 7fc3a3200640 1 -- 172.21.15.40:0/4234559615 shutdown_connections 2024-09-11T00:24:22.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.154+0000 7fc3a3200640 1 -- 172.21.15.40:0/4234559615 wait complete. 2024-09-11T00:24:22.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.156+0000 7fc3a3200640 1 Processor -- start 2024-09-11T00:24:22.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.156+0000 7fc3a3200640 1 -- start start 2024-09-11T00:24:22.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.157+0000 7fc3a3200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3a406efa0 0x7fc3a41f8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:22.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.157+0000 7fc3a3200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3a40ae640 0x7fc3a40c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:22.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.157+0000 7fc3a3200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a415baa0 0x7fc3a414dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:22.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.157+0000 7fc3a3200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a415be80 con 0x7fc3a40ae640 2024-09-11T00:24:22.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.157+0000 7fc3a3200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a40d0720 con 0x7fc3a415baa0 2024-09-11T00:24:22.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.157+0000 7fc3a3200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc3a415c000 con 0x7fc3a406efa0 2024-09-11T00:24:22.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.157+0000 7fc3a1400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3a40ae640 0x7fc3a40c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:22.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.157+0000 7fc3a1400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3a40ae640 0x7fc3a40c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59728/0 (socket says 172.21.15.40:59728) 2024-09-11T00:24:22.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.157+0000 7fc3a1400640 1 -- 172.21.15.40:0/480455599 learned_addr learned my addr 172.21.15.40:0/480455599 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:22.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.157+0000 7fc3a1e00640 1 --2- 172.21.15.40:0/480455599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3a406efa0 0x7fc3a41f8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:22.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.157+0000 7fc3a2800640 1 --2- 172.21.15.40:0/480455599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a415baa0 0x7fc3a414dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:22.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.157+0000 7fc3a1400640 1 -- 172.21.15.40:0/480455599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3a406efa0 msgr2=0x7fc3a41f8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:22.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.157+0000 7fc3a1400640 1 --2- 172.21.15.40:0/480455599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3a406efa0 0x7fc3a41f8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:22.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.157+0000 7fc3a1400640 1 -- 172.21.15.40:0/480455599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a415baa0 msgr2=0x7fc3a414dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:22.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.157+0000 7fc3a1400640 1 --2- 172.21.15.40:0/480455599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a415baa0 0x7fc3a414dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:22.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.157+0000 7fc3a1400640 1 -- 172.21.15.40:0/480455599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a414e110 con 0x7fc3a40ae640 2024-09-11T00:24:22.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.158+0000 7fc3a1400640 1 --2- 172.21.15.40:0/480455599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3a40ae640 0x7fc3a40c5ce0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc390009780 tx=0x7fc390032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:22.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.158+0000 7fc39a000640 1 -- 172.21.15.40:0/480455599 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc390040070 con 0x7fc3a40ae640 2024-09-11T00:24:22.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.158+0000 7fc39a000640 1 -- 172.21.15.40:0/480455599 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc390005310 con 0x7fc3a40ae640 2024-09-11T00:24:22.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.158+0000 7fc3a3200640 1 -- 172.21.15.40:0/480455599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a40c4f20 con 0x7fc3a40ae640 2024-09-11T00:24:22.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.158+0000 7fc39a000640 1 -- 172.21.15.40:0/480455599 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc390003800 con 0x7fc3a40ae640 2024-09-11T00:24:22.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.158+0000 7fc3a3200640 1 -- 172.21.15.40:0/480455599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a40c54e0 con 0x7fc3a40ae640 2024-09-11T00:24:22.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.159+0000 7fc3a3200640 1 -- 172.21.15.40:0/480455599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3a40b4bd0 con 0x7fc3a40ae640 2024-09-11T00:24:22.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.160+0000 7fc39a000640 1 -- 172.21.15.40:0/480455599 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc39004c030 con 0x7fc3a40ae640 2024-09-11T00:24:22.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.162+0000 7fc39a000640 1 --2- 172.21.15.40:0/480455599 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc384077f70 0x7fc38407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:22.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.162+0000 7fc39a000640 1 -- 172.21.15.40:0/480455599 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc3900bae40 con 0x7fc3a40ae640 2024-09-11T00:24:22.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.162+0000 7fc3a1e00640 1 --2- 172.21.15.40:0/480455599 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc384077f70 0x7fc38407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:22.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.163+0000 7fc3a1e00640 1 --2- 172.21.15.40:0/480455599 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc384077f70 0x7fc38407a430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc394001720 tx=0x7fc394007e90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:22.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.166+0000 7fc39a000640 1 -- 172.21.15.40:0/480455599 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc3900832e0 con 0x7fc3a40ae640 2024-09-11T00:24:22.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:22.429+0000 7fc3a3200640 1 -- 172.21.15.40:0/480455599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) -- 0x7fc3a4076060 con 0x7fc3a40ae640 2024-09-11T00:24:23.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.052+0000 7fc39a000640 1 -- 172.21.15.40:0/480455599 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v55) ==== 123+0+0 (secure 0 0 0) 0x7fc390087d10 con 0x7fc3a40ae640 2024-09-11T00:24:23.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.055+0000 7fc3a3200640 1 -- 172.21.15.40:0/480455599 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc384077f70 msgr2=0x7fc38407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:23.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.055+0000 7fc3a3200640 1 --2- 172.21.15.40:0/480455599 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc384077f70 0x7fc38407a430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc394001720 tx=0x7fc394007e90 comp rx=0 tx=0).stop 2024-09-11T00:24:23.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.055+0000 7fc3a3200640 1 -- 172.21.15.40:0/480455599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3a40ae640 msgr2=0x7fc3a40c5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:23.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.055+0000 7fc3a3200640 1 --2- 172.21.15.40:0/480455599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3a40ae640 0x7fc3a40c5ce0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc390009780 tx=0x7fc390032d50 comp rx=0 tx=0).stop 2024-09-11T00:24:23.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.056+0000 7fc3a3200640 1 -- 172.21.15.40:0/480455599 shutdown_connections 2024-09-11T00:24:23.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.056+0000 7fc3a3200640 1 --2- 172.21.15.40:0/480455599 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc384077f70 0x7fc38407a430 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.056+0000 7fc3a3200640 1 --2- 172.21.15.40:0/480455599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a415baa0 0x7fc3a414dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.056+0000 7fc3a3200640 1 --2- 172.21.15.40:0/480455599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3a40ae640 0x7fc3a40c5ce0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.056+0000 7fc3a3200640 1 --2- 172.21.15.40:0/480455599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3a406efa0 0x7fc3a41f8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.056+0000 7fc3a3200640 1 -- 172.21.15.40:0/480455599 >> 172.21.15.40:0/480455599 conn(0x7fc3a40cf770 msgr2=0x7fc3a40cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:23.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.056+0000 7fc3a3200640 1 -- 172.21.15.40:0/480455599 shutdown_connections 2024-09-11T00:24:23.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.056+0000 7fc3a3200640 1 -- 172.21.15.40:0/480455599 wait complete. 2024-09-11T00:24:23.075 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-11T00:24:23.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.235+0000 7fde0a800640 1 -- 172.21.15.40:0/1047602650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde040cfda0 msgr2=0x7fde0406dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:23.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.235+0000 7fde0a800640 1 --2- 172.21.15.40:0/1047602650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde040cfda0 0x7fde0406dbe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fddfc005fd0 tx=0x7fddfc02aaa0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.235+0000 7fde0a800640 1 -- 172.21.15.40:0/1047602650 shutdown_connections 2024-09-11T00:24:23.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.235+0000 7fde0a800640 1 --2- 172.21.15.40:0/1047602650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde040cfda0 0x7fde0406dbe0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.235+0000 7fde0a800640 1 --2- 172.21.15.40:0/1047602650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde04074c30 0x7fde0406d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.235+0000 7fde0a800640 1 -- 172.21.15.40:0/1047602650 >> 172.21.15.40:0/1047602650 conn(0x7fde04074110 msgr2=0x7fde04074520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:23.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.235+0000 7fde0a800640 1 -- 172.21.15.40:0/1047602650 shutdown_connections 2024-09-11T00:24:23.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.235+0000 7fde0a800640 1 -- 172.21.15.40:0/1047602650 wait complete. 2024-09-11T00:24:23.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.237+0000 7fde0a800640 1 Processor -- start 2024-09-11T00:24:23.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.237+0000 7fde0a800640 1 -- start start 2024-09-11T00:24:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.238+0000 7fde0a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde04074c30 0x7fde041636f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.238+0000 7fde0a800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde040cf9c0 0x7fde0415e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.238+0000 7fde0a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde040cfda0 0x7fde04159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.238+0000 7fde0a800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fde0406e4b0 con 0x7fde04074c30 2024-09-11T00:24:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.238+0000 7fde0a800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fde0406e330 con 0x7fde040cfda0 2024-09-11T00:24:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.238+0000 7fde0a800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fde0415ee80 con 0x7fde040cf9c0 2024-09-11T00:24:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.238+0000 7fde03400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde04074c30 0x7fde041636f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.238+0000 7fde03400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde04074c30 0x7fde041636f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59734/0 (socket says 172.21.15.40:59734) 2024-09-11T00:24:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.238+0000 7fde03400640 1 -- 172.21.15.40:0/2951522966 learned_addr learned my addr 172.21.15.40:0/2951522966 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:23.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.238+0000 7fddfaa00640 1 --2- 172.21.15.40:0/2951522966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde040cf9c0 0x7fde0415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:23.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.239+0000 7fde03e00640 1 --2- 172.21.15.40:0/2951522966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde040cfda0 0x7fde04159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:23.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.239+0000 7fde03400640 1 -- 172.21.15.40:0/2951522966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde040cf9c0 msgr2=0x7fde0415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:23.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.239+0000 7fde03400640 1 --2- 172.21.15.40:0/2951522966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde040cf9c0 0x7fde0415e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.239+0000 7fde03400640 1 -- 172.21.15.40:0/2951522966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde040cfda0 msgr2=0x7fde04159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:23.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.239+0000 7fde03400640 1 --2- 172.21.15.40:0/2951522966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde040cfda0 0x7fde04159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.239+0000 7fde03400640 1 -- 172.21.15.40:0/2951522966 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde041f8b50 con 0x7fde04074c30 2024-09-11T00:24:23.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.239+0000 7fde03e00640 1 --2- 172.21.15.40:0/2951522966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde040cfda0 0x7fde04159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:23.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.239+0000 7fde03400640 1 --2- 172.21.15.40:0/2951522966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde04074c30 0x7fde041636f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fddf400c420 tx=0x7fddf400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:23.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.239+0000 7fddfbe00640 1 -- 172.21.15.40:0/2951522966 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf40052d0 con 0x7fde04074c30 2024-09-11T00:24:23.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.239+0000 7fddfbe00640 1 -- 172.21.15.40:0/2951522966 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fddf4007020 con 0x7fde04074c30 2024-09-11T00:24:23.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.239+0000 7fde0a800640 1 -- 172.21.15.40:0/2951522966 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde041661e0 con 0x7fde04074c30 2024-09-11T00:24:23.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.239+0000 7fddfbe00640 1 -- 172.21.15.40:0/2951522966 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf4007470 con 0x7fde04074c30 2024-09-11T00:24:23.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.239+0000 7fde0a800640 1 -- 172.21.15.40:0/2951522966 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde041f8df0 con 0x7fde04074c30 2024-09-11T00:24:23.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.240+0000 7fde0a800640 1 -- 172.21.15.40:0/2951522966 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde0406dbe0 con 0x7fde04074c30 2024-09-11T00:24:23.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.242+0000 7fddfbe00640 1 -- 172.21.15.40:0/2951522966 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fddf40067d0 con 0x7fde04074c30 2024-09-11T00:24:23.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.243+0000 7fddfbe00640 1 --2- 172.21.15.40:0/2951522966 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdde0077f70 0x7fdde007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:23.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.243+0000 7fddfbe00640 1 -- 172.21.15.40:0/2951522966 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fddf40992e0 con 0x7fde04074c30 2024-09-11T00:24:23.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.244+0000 7fddfaa00640 1 --2- 172.21.15.40:0/2951522966 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdde0077f70 0x7fdde007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:23.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.244+0000 7fddfaa00640 1 --2- 172.21.15.40:0/2951522966 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdde0077f70 0x7fdde007a430 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fddec005d80 tx=0x7fddec005c50 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:23.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.248+0000 7fddfbe00640 1 -- 172.21.15.40:0/2951522966 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fddf4061d40 con 0x7fde04074c30 2024-09-11T00:24:23.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.441+0000 7fde0a800640 1 -- 172.21.15.40:0/2951522966 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fde04073910 con 0x7fde04074c30 2024-09-11T00:24:23.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.442+0000 7fddfbe00640 1 -- 172.21.15.40:0/2951522966 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v27) ==== 59+0+1998 (secure 0 0 0) 0x7fddf4061640 con 0x7fde04074c30 2024-09-11T00:24:23.443 INFO:teuthology.orchestra.run.smithi040.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-11T00:24:23.444 INFO:teuthology.orchestra.run.smithi040.stdout:mon advanced mon_op_complaint_time 120 2024-09-11T00:24:23.444 INFO:teuthology.orchestra.run.smithi040.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-11T00:24:23.444 INFO:teuthology.orchestra.run.smithi040.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-11T00:24:23.444 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6505.182367 2024-09-11T00:24:23.444 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4101.366767 2024-09-11T00:24:23.444 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4102.256539 2024-09-11T00:24:23.444 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3977.556600 2024-09-11T00:24:23.444 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3932.633511 2024-09-11T00:24:23.444 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3913.199828 2024-09-11T00:24:23.445 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3886.638166 2024-09-11T00:24:23.445 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4277.831007 2024-09-11T00:24:23.445 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced debug_mds 20/20 2024-09-11T00:24:23.445 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced debug_mds_balancer 20/20 2024-09-11T00:24:23.445 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced debug_ms 2/2 2024-09-11T00:24:23.445 INFO:teuthology.orchestra.run.smithi040.stdout:mds dev mds_debug_frag true 2024-09-11T00:24:23.445 INFO:teuthology.orchestra.run.smithi040.stdout:mds dev mds_debug_scatterstat true 2024-09-11T00:24:23.446 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-11T00:24:23.446 INFO:teuthology.orchestra.run.smithi040.stdout:mds dev mds_verify_scatter true 2024-09-11T00:24:23.446 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-11T00:24:23.446 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced rados_mon_op_timeout 900 2024-09-11T00:24:23.446 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced rados_osd_op_timeout 900 2024-09-11T00:24:23.447 INFO:teuthology.orchestra.run.smithi040.stdout:client advanced client_mount_timeout 600 2024-09-11T00:24:23.447 INFO:teuthology.orchestra.run.smithi040.stdout:client advanced debug_client 20/20 2024-09-11T00:24:23.447 INFO:teuthology.orchestra.run.smithi040.stdout:client advanced debug_ms 1/1 2024-09-11T00:24:23.447 INFO:teuthology.orchestra.run.smithi040.stdout:client advanced rados_mon_op_timeout 900 2024-09-11T00:24:23.447 INFO:teuthology.orchestra.run.smithi040.stdout:client advanced rados_osd_op_timeout 900 2024-09-11T00:24:23.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.444+0000 7fde0a800640 1 -- 172.21.15.40:0/2951522966 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdde0077f70 msgr2=0x7fdde007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:23.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.444+0000 7fde0a800640 1 --2- 172.21.15.40:0/2951522966 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdde0077f70 0x7fdde007a430 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fddec005d80 tx=0x7fddec005c50 comp rx=0 tx=0).stop 2024-09-11T00:24:23.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.444+0000 7fde0a800640 1 -- 172.21.15.40:0/2951522966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde04074c30 msgr2=0x7fde041636f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:23.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.444+0000 7fde0a800640 1 --2- 172.21.15.40:0/2951522966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde04074c30 0x7fde041636f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fddf400c420 tx=0x7fddf400c8e0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.444+0000 7fde0a800640 1 -- 172.21.15.40:0/2951522966 shutdown_connections 2024-09-11T00:24:23.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.444+0000 7fde0a800640 1 --2- 172.21.15.40:0/2951522966 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdde0077f70 0x7fdde007a430 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.444+0000 7fde0a800640 1 --2- 172.21.15.40:0/2951522966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde040cfda0 0x7fde04159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.444+0000 7fde0a800640 1 --2- 172.21.15.40:0/2951522966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde040cf9c0 0x7fde0415e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.444+0000 7fde0a800640 1 --2- 172.21.15.40:0/2951522966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde04074c30 0x7fde041636f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.444+0000 7fde0a800640 1 -- 172.21.15.40:0/2951522966 >> 172.21.15.40:0/2951522966 conn(0x7fde04074110 msgr2=0x7fde040707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:23.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.444+0000 7fde0a800640 1 -- 172.21.15.40:0/2951522966 shutdown_connections 2024-09-11T00:24:23.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.444+0000 7fde0a800640 1 -- 172.21.15.40:0/2951522966 wait complete. 2024-09-11T00:24:23.462 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T00:24:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.624+0000 7f20d8a00640 1 -- 172.21.15.40:0/1701572796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d40d21d0 msgr2=0x7f20d4160890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.624+0000 7f20d8a00640 1 --2- 172.21.15.40:0/1701572796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d40d21d0 0x7f20d4160890 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f20cc005fd0 tx=0x7f20cc02aa90 comp rx=0 tx=0).stop 2024-09-11T00:24:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.624+0000 7f20d8a00640 1 -- 172.21.15.40:0/1701572796 shutdown_connections 2024-09-11T00:24:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.624+0000 7f20d8a00640 1 --2- 172.21.15.40:0/1701572796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d40d21d0 0x7f20d4160890 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.624+0000 7f20d8a00640 1 --2- 172.21.15.40:0/1701572796 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d40d47a0 0x7f20d40d1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.624+0000 7f20d8a00640 1 -- 172.21.15.40:0/1701572796 >> 172.21.15.40:0/1701572796 conn(0x7f20d40d3c10 msgr2=0x7f20d40d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.624+0000 7f20d8a00640 1 -- 172.21.15.40:0/1701572796 shutdown_connections 2024-09-11T00:24:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.624+0000 7f20d8a00640 1 -- 172.21.15.40:0/1701572796 wait complete. 2024-09-11T00:24:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.625+0000 7f20d8a00640 1 Processor -- start 2024-09-11T00:24:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.626+0000 7f20d8a00640 1 -- start start 2024-09-11T00:24:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.627+0000 7f20d8a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d40b5090 0x7f20d4155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.627+0000 7f20d8a00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d40d21d0 0x7f20d40d0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.627+0000 7f20d8a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20d40d47a0 0x7f20d40d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.627+0000 7f20d8a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f20d4160f50 con 0x7f20d40b5090 2024-09-11T00:24:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.627+0000 7f20d8a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f20d4160dd0 con 0x7f20d40d47a0 2024-09-11T00:24:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.627+0000 7f20d8a00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f20d41610d0 con 0x7f20d40d21d0 2024-09-11T00:24:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.627+0000 7f20d3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d40b5090 0x7f20d4155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.627+0000 7f20d3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d40b5090 0x7f20d4155f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59748/0 (socket says 172.21.15.40:59748) 2024-09-11T00:24:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.627+0000 7f20d3400640 1 -- 172.21.15.40:0/3401650953 learned_addr learned my addr 172.21.15.40:0/3401650953 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.627+0000 7f20d2a00640 1 --2- 172.21.15.40:0/3401650953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d40d21d0 0x7f20d40d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.627+0000 7f20d3e00640 1 --2- 172.21.15.40:0/3401650953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20d40d47a0 0x7f20d40d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.627+0000 7f20d3400640 1 -- 172.21.15.40:0/3401650953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d40d21d0 msgr2=0x7f20d40d0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.627+0000 7f20d3400640 1 --2- 172.21.15.40:0/3401650953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d40d21d0 0x7f20d40d0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.627+0000 7f20d3400640 1 -- 172.21.15.40:0/3401650953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20d40d47a0 msgr2=0x7f20d40d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.627+0000 7f20d3400640 1 --2- 172.21.15.40:0/3401650953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20d40d47a0 0x7f20d40d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.627+0000 7f20d3400640 1 -- 172.21.15.40:0/3401650953 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d40ca470 con 0x7f20d40b5090 2024-09-11T00:24:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.628+0000 7f20d3400640 1 --2- 172.21.15.40:0/3401650953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d40b5090 0x7f20d4155f80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f20c400c450 tx=0x7f20c400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.628+0000 7f20cb400640 1 -- 172.21.15.40:0/3401650953 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c40052d0 con 0x7f20d40b5090 2024-09-11T00:24:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.628+0000 7f20cb400640 1 -- 172.21.15.40:0/3401650953 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20c4005470 con 0x7f20d40b5090 2024-09-11T00:24:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.628+0000 7f20d8a00640 1 -- 172.21.15.40:0/3401650953 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d41f4bb0 con 0x7f20d40b5090 2024-09-11T00:24:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.628+0000 7f20cb400640 1 -- 172.21.15.40:0/3401650953 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4012870 con 0x7f20d40b5090 2024-09-11T00:24:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.628+0000 7f20d8a00640 1 -- 172.21.15.40:0/3401650953 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d41f4860 con 0x7f20d40b5090 2024-09-11T00:24:23.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.629+0000 7f20d8a00640 1 -- 172.21.15.40:0/3401650953 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d4160890 con 0x7f20d40b5090 2024-09-11T00:24:23.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.630+0000 7f20cb400640 1 -- 172.21.15.40:0/3401650953 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f20c40035f0 con 0x7f20d40b5090 2024-09-11T00:24:23.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.632+0000 7f20cb400640 1 --2- 172.21.15.40:0/3401650953 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f20b4077f70 0x7f20b407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:23.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.632+0000 7f20cb400640 1 -- 172.21.15.40:0/3401650953 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f20c4099740 con 0x7f20d40b5090 2024-09-11T00:24:23.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.632+0000 7f20d2a00640 1 --2- 172.21.15.40:0/3401650953 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f20b4077f70 0x7f20b407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:23.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.633+0000 7f20d2a00640 1 --2- 172.21.15.40:0/3401650953 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f20b4077f70 0x7f20b407a430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f20d40c9a80 tx=0x7f20c0005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:23.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.636+0000 7f20cb400640 1 -- 172.21.15.40:0/3401650953 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f20c4061be0 con 0x7f20d40b5090 2024-09-11T00:24:23.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.831+0000 7f20d8a00640 1 -- 172.21.15.40:0/3401650953 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f20d4156580 con 0x7f20d40b5090 2024-09-11T00:24:23.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.835+0000 7f20cb400640 1 -- 172.21.15.40:0/3401650953 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f20c4066610 con 0x7f20d40b5090 2024-09-11T00:24:23.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.838+0000 7f20d8a00640 1 -- 172.21.15.40:0/3401650953 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f20b4077f70 msgr2=0x7f20b407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:23.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.838+0000 7f20d8a00640 1 --2- 172.21.15.40:0/3401650953 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f20b4077f70 0x7f20b407a430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f20d40c9a80 tx=0x7f20c0005f90 comp rx=0 tx=0).stop 2024-09-11T00:24:23.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.838+0000 7f20d8a00640 1 -- 172.21.15.40:0/3401650953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d40b5090 msgr2=0x7f20d4155f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:23.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.838+0000 7f20d8a00640 1 --2- 172.21.15.40:0/3401650953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d40b5090 0x7f20d4155f80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f20c400c450 tx=0x7f20c400c910 comp rx=0 tx=0).stop 2024-09-11T00:24:23.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.838+0000 7f20d8a00640 1 -- 172.21.15.40:0/3401650953 shutdown_connections 2024-09-11T00:24:23.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.838+0000 7f20d8a00640 1 --2- 172.21.15.40:0/3401650953 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f20b4077f70 0x7f20b407a430 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.838+0000 7f20d8a00640 1 --2- 172.21.15.40:0/3401650953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20d40d47a0 0x7f20d40d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.838+0000 7f20d8a00640 1 --2- 172.21.15.40:0/3401650953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d40d21d0 0x7f20d40d0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.838+0000 7f20d8a00640 1 --2- 172.21.15.40:0/3401650953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d40b5090 0x7f20d4155f80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.838+0000 7f20d8a00640 1 -- 172.21.15.40:0/3401650953 >> 172.21.15.40:0/3401650953 conn(0x7f20d40d3c10 msgr2=0x7f20d415f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:23.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.838+0000 7f20d8a00640 1 -- 172.21.15.40:0/3401650953 shutdown_connections 2024-09-11T00:24:23.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:23.838+0000 7f20d8a00640 1 -- 172.21.15.40:0/3401650953 wait complete. 2024-09-11T00:24:23.855 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T00:24:23.855 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T00:24:23.945 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T00:24:24.047 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T00:24:24.047 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:24:24.047 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:24:24.085 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:24:24.085 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:24:24.161 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T00:24:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.364+0000 7f8fd0e00640 1 -- 172.21.15.40:0/805784312 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fcc161d90 msgr2=0x7f8fcc162170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.364+0000 7f8fd0e00640 1 --2- 172.21.15.40:0/805784312 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fcc161d90 0x7f8fcc162170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009830 tx=0x7f8fbc02a480 comp rx=0 tx=0).stop 2024-09-11T00:24:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.364+0000 7f8fd0e00640 1 -- 172.21.15.40:0/805784312 shutdown_connections 2024-09-11T00:24:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.364+0000 7f8fd0e00640 1 --2- 172.21.15.40:0/805784312 >> v2:172.21.15.175:3300/0 conn(0x7f8fcc161690 0x7f8fcc0ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.364+0000 7f8fd0e00640 1 --2- 172.21.15.40:0/805784312 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fcc161d90 0x7f8fcc162170 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.364+0000 7f8fd0e00640 1 -- 172.21.15.40:0/805784312 >> 172.21.15.40:0/805784312 conn(0x7f8fcc0d3ba0 msgr2=0x7f8fcc0d3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.364+0000 7f8fd0e00640 1 -- 172.21.15.40:0/805784312 shutdown_connections 2024-09-11T00:24:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.364+0000 7f8fd0e00640 1 -- 172.21.15.40:0/805784312 wait complete. 2024-09-11T00:24:24.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.366+0000 7f8fd0e00640 1 Processor -- start 2024-09-11T00:24:24.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.366+0000 7f8fd0e00640 1 -- start start 2024-09-11T00:24:24.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.367+0000 7f8fd0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fcc06e280 0x7f8fcc15dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.367+0000 7f8fd0e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fcc161690 0x7f8fcc0cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.367+0000 7f8fd0e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fcc161d90 0x7f8fcc1f8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.367+0000 7f8fd0e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc06d330 con 0x7f8fcc06e280 2024-09-11T00:24:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.367+0000 7f8fd0e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc06d4b0 con 0x7f8fcc161690 2024-09-11T00:24:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.367+0000 7f8fd0e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8fcc06d630 con 0x7f8fcc161d90 2024-09-11T00:24:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.367+0000 7f8fcb400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fcc06e280 0x7f8fcc15dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.367+0000 7f8fcb400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fcc06e280 0x7f8fcc15dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59754/0 (socket says 172.21.15.40:59754) 2024-09-11T00:24:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.367+0000 7f8fcb400640 1 -- 172.21.15.40:0/3469484279 learned_addr learned my addr 172.21.15.40:0/3469484279 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.367+0000 7f8fcbe00640 1 --2- 172.21.15.40:0/3469484279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fcc161d90 0x7f8fcc1f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.367+0000 7f8fcaa00640 1 --2- 172.21.15.40:0/3469484279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fcc161690 0x7f8fcc0cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.368+0000 7f8fcb400640 1 -- 172.21.15.40:0/3469484279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fcc161d90 msgr2=0x7f8fcc1f8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.368+0000 7f8fcb400640 1 --2- 172.21.15.40:0/3469484279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fcc161d90 0x7f8fcc1f8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.368+0000 7f8fcb400640 1 -- 172.21.15.40:0/3469484279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fcc161690 msgr2=0x7f8fcc0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.368+0000 7f8fcb400640 1 --2- 172.21.15.40:0/3469484279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fcc161690 0x7f8fcc0cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.368+0000 7f8fcb400640 1 -- 172.21.15.40:0/3469484279 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fcc15d110 con 0x7f8fcc06e280 2024-09-11T00:24:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.368+0000 7f8fcbe00640 1 --2- 172.21.15.40:0/3469484279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fcc161d90 0x7f8fcc1f8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.368+0000 7f8fcb400640 1 --2- 172.21.15.40:0/3469484279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fcc06e280 0x7f8fcc15dbf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc000c00 tx=0x7f8fbc033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.368+0000 7f8fc3400640 1 -- 172.21.15.40:0/3469484279 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc005c90 con 0x7f8fcc06e280 2024-09-11T00:24:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.368+0000 7f8fc3400640 1 -- 172.21.15.40:0/3469484279 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8fbc031e50 con 0x7f8fcc06e280 2024-09-11T00:24:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.368+0000 7f8fc3400640 1 -- 172.21.15.40:0/3469484279 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc0332f0 con 0x7f8fcc06e280 2024-09-11T00:24:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.368+0000 7f8fd0e00640 1 -- 172.21.15.40:0/3469484279 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fcc15d3f0 con 0x7f8fcc06e280 2024-09-11T00:24:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.368+0000 7f8fd0e00640 1 -- 172.21.15.40:0/3469484279 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fcc15cdc0 con 0x7f8fcc06e280 2024-09-11T00:24:24.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.369+0000 7f8fd0e00640 1 -- 172.21.15.40:0/3469484279 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fcc0ce5d0 con 0x7f8fcc06e280 2024-09-11T00:24:24.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.371+0000 7f8fc3400640 1 -- 172.21.15.40:0/3469484279 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8fbc033490 con 0x7f8fcc06e280 2024-09-11T00:24:24.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.371+0000 7f8fc3400640 1 --2- 172.21.15.40:0/3469484279 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8fac077f70 0x7f8fac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.372+0000 7f8fc3400640 1 -- 172.21.15.40:0/3469484279 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8fbc0baff0 con 0x7f8fcc06e280 2024-09-11T00:24:24.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.372+0000 7f8fcaa00640 1 --2- 172.21.15.40:0/3469484279 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8fac077f70 0x7f8fac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.373+0000 7f8fcaa00640 1 --2- 172.21.15.40:0/3469484279 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8fac077f70 0x7f8fac07a430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0b6630 tx=0x7f8fb8009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:24.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.376+0000 7f8fc3400640 1 -- 172.21.15.40:0/3469484279 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8fbc03f030 con 0x7f8fcc06e280 2024-09-11T00:24:24.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.581+0000 7f8fd0e00640 1 -- 172.21.15.40:0/3469484279 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8fcc08dc10 con 0x7f8fcc06e280 2024-09-11T00:24:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.581+0000 7f8fc3400640 1 -- 172.21.15.40:0/3469484279 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f8fbc083a90 con 0x7f8fcc06e280 2024-09-11T00:24:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-09-11T00:24:24.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.584+0000 7f8fd0e00640 1 -- 172.21.15.40:0/3469484279 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8fac077f70 msgr2=0x7f8fac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:24.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.584+0000 7f8fd0e00640 1 --2- 172.21.15.40:0/3469484279 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8fac077f70 0x7f8fac07a430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0b6630 tx=0x7f8fb8009040 comp rx=0 tx=0).stop 2024-09-11T00:24:24.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.584+0000 7f8fd0e00640 1 -- 172.21.15.40:0/3469484279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fcc06e280 msgr2=0x7f8fcc15dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:24.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.584+0000 7f8fd0e00640 1 --2- 172.21.15.40:0/3469484279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fcc06e280 0x7f8fcc15dbf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc000c00 tx=0x7f8fbc033c20 comp rx=0 tx=0).stop 2024-09-11T00:24:24.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.584+0000 7f8fd0e00640 1 -- 172.21.15.40:0/3469484279 shutdown_connections 2024-09-11T00:24:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.584+0000 7f8fd0e00640 1 --2- 172.21.15.40:0/3469484279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fcc161d90 0x7f8fcc1f8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.584+0000 7f8fd0e00640 1 --2- 172.21.15.40:0/3469484279 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8fac077f70 0x7f8fac07a430 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.584+0000 7f8fd0e00640 1 --2- 172.21.15.40:0/3469484279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fcc161690 0x7f8fcc0cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.584+0000 7f8fd0e00640 1 --2- 172.21.15.40:0/3469484279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fcc06e280 0x7f8fcc15dbf0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.584+0000 7f8fd0e00640 1 -- 172.21.15.40:0/3469484279 >> 172.21.15.40:0/3469484279 conn(0x7f8fcc0d3ba0 msgr2=0x7f8fcc0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.584+0000 7f8fd0e00640 1 -- 172.21.15.40:0/3469484279 shutdown_connections 2024-09-11T00:24:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.584+0000 7f8fd0e00640 1 -- 172.21.15.40:0/3469484279 wait complete. 2024-09-11T00:24:24.601 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:24:24.601 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:24:24.637 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T00:24:24.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.837+0000 7fbea4c00640 1 -- 172.21.15.40:0/401382318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe84004d40 msgr2=0x7fbe840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:24.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.837+0000 7fbea4c00640 1 --2- 172.21.15.40:0/401382318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe84004d40 0x7fbe840051c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbe98005fd0 tx=0x7fbe84005830 comp rx=0 tx=0).stop 2024-09-11T00:24:24.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.837+0000 7fbe9e800640 1 -- 172.21.15.40:0/401382318 reap_dead start 2024-09-11T00:24:24.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.838+0000 7fbea4c00640 1 -- 172.21.15.40:0/401382318 shutdown_connections 2024-09-11T00:24:24.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.838+0000 7fbea4c00640 1 -- 172.21.15.40:0/401382318 >> 172.21.15.40:0/401382318 conn(0x7fbea00cfbb0 msgr2=0x7fbea00cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:24.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.838+0000 7fbea4c00640 1 -- 172.21.15.40:0/401382318 shutdown_connections 2024-09-11T00:24:24.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.838+0000 7fbea4c00640 1 -- 172.21.15.40:0/401382318 wait complete. 2024-09-11T00:24:24.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.839+0000 7fbea4c00640 1 Processor -- start 2024-09-11T00:24:24.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.839+0000 7fbea4c00640 1 -- start start 2024-09-11T00:24:24.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.840+0000 7fbea4c00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe84004d40 0x7fbea0157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.840+0000 7fbea4c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbea014f4a0 0x7fbea0155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.840+0000 7fbea4c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbea014ebf0 0x7fbea00b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.840+0000 7fbea4c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbea0166eb0 con 0x7fbea014ebf0 2024-09-11T00:24:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.840+0000 7fbea4c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbea0166d30 con 0x7fbea014f4a0 2024-09-11T00:24:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.840+0000 7fbea4c00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbea0167030 con 0x7fbe84004d40 2024-09-11T00:24:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.841+0000 7fbe9e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbea014ebf0 0x7fbea00b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.841+0000 7fbe9e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbea014ebf0 0x7fbea00b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59768/0 (socket says 172.21.15.40:59768) 2024-09-11T00:24:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.841+0000 7fbe9e800640 1 -- 172.21.15.40:0/1965659183 learned_addr learned my addr 172.21.15.40:0/1965659183 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.841+0000 7fbe95400640 1 --2- 172.21.15.40:0/1965659183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbea014f4a0 0x7fbea0155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.841+0000 7fbe9de00640 1 --2- 172.21.15.40:0/1965659183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe84004d40 0x7fbea0157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.841+0000 7fbe9e800640 1 -- 172.21.15.40:0/1965659183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe84004d40 msgr2=0x7fbea0157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.841+0000 7fbe9e800640 1 --2- 172.21.15.40:0/1965659183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe84004d40 0x7fbea0157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.841+0000 7fbe9e800640 1 -- 172.21.15.40:0/1965659183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbea014f4a0 msgr2=0x7fbea0155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:24.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.841+0000 7fbe9e800640 1 --2- 172.21.15.40:0/1965659183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbea014f4a0 0x7fbea0155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.841+0000 7fbe9e800640 1 -- 172.21.15.40:0/1965659183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea01582b0 con 0x7fbea014ebf0 2024-09-11T00:24:24.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.841+0000 7fbe9e800640 1 --2- 172.21.15.40:0/1965659183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbea014ebf0 0x7fbea00b2b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbe9802b840 tx=0x7fbe98034c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:24.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.842+0000 7fbe96a00640 1 -- 172.21.15.40:0/1965659183 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe98043070 con 0x7fbea014ebf0 2024-09-11T00:24:24.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.842+0000 7fbe96a00640 1 -- 172.21.15.40:0/1965659183 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe98034d10 con 0x7fbea014ebf0 2024-09-11T00:24:24.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.842+0000 7fbe96a00640 1 -- 172.21.15.40:0/1965659183 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe98038040 con 0x7fbea014ebf0 2024-09-11T00:24:24.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.842+0000 7fbea4c00640 1 -- 172.21.15.40:0/1965659183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea0150dd0 con 0x7fbea014ebf0 2024-09-11T00:24:24.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.842+0000 7fbea4c00640 1 -- 172.21.15.40:0/1965659183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea0151390 con 0x7fbea014ebf0 2024-09-11T00:24:24.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.843+0000 7fbea4c00640 1 -- 172.21.15.40:0/1965659183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbea00ad870 con 0x7fbea014ebf0 2024-09-11T00:24:24.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.844+0000 7fbe96a00640 1 -- 172.21.15.40:0/1965659183 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbe9803b050 con 0x7fbea014ebf0 2024-09-11T00:24:24.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.845+0000 7fbe96a00640 1 --2- 172.21.15.40:0/1965659183 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbe7c077f70 0x7fbe7c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.845+0000 7fbe96a00640 1 -- 172.21.15.40:0/1965659183 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbe980b9ba0 con 0x7fbea014ebf0 2024-09-11T00:24:24.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.845+0000 7fbe9de00640 1 --2- 172.21.15.40:0/1965659183 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbe7c077f70 0x7fbe7c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.846+0000 7fbe9de00640 1 --2- 172.21.15.40:0/1965659183 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbe7c077f70 0x7fbe7c07a430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbe90006cd0 tx=0x7fbe90006720 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:24.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:24.849+0000 7fbe96a00640 1 -- 172.21.15.40:0/1965659183 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbe98081fb0 con 0x7fbea014ebf0 2024-09-11T00:24:25.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.056+0000 7fbea4c00640 1 -- 172.21.15.40:0/1965659183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbea0153210 con 0x7fbea014ebf0 2024-09-11T00:24:25.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.057+0000 7fbe96a00640 1 -- 172.21.15.40:0/1965659183 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fbe980869e0 con 0x7fbea014ebf0 2024-09-11T00:24:25.058 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-09-11T00:24:25.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.059+0000 7fbea4c00640 1 -- 172.21.15.40:0/1965659183 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbe7c077f70 msgr2=0x7fbe7c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:25.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.059+0000 7fbea4c00640 1 --2- 172.21.15.40:0/1965659183 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbe7c077f70 0x7fbe7c07a430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbe90006cd0 tx=0x7fbe90006720 comp rx=0 tx=0).stop 2024-09-11T00:24:25.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.059+0000 7fbea4c00640 1 -- 172.21.15.40:0/1965659183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbea014ebf0 msgr2=0x7fbea00b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:25.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.059+0000 7fbea4c00640 1 --2- 172.21.15.40:0/1965659183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbea014ebf0 0x7fbea00b2b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbe9802b840 tx=0x7fbe98034c20 comp rx=0 tx=0).stop 2024-09-11T00:24:25.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.059+0000 7fbea4c00640 1 -- 172.21.15.40:0/1965659183 shutdown_connections 2024-09-11T00:24:25.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.059+0000 7fbea4c00640 1 --2- 172.21.15.40:0/1965659183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbea014ebf0 0x7fbea00b2b00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:25.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.059+0000 7fbea4c00640 1 --2- 172.21.15.40:0/1965659183 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbe7c077f70 0x7fbe7c07a430 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:25.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.059+0000 7fbea4c00640 1 --2- 172.21.15.40:0/1965659183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbea014f4a0 0x7fbea0155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:25.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.059+0000 7fbea4c00640 1 --2- 172.21.15.40:0/1965659183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe84004d40 0x7fbea0157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:25.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.059+0000 7fbea4c00640 1 -- 172.21.15.40:0/1965659183 >> 172.21.15.40:0/1965659183 conn(0x7fbea00cfbb0 msgr2=0x7fbea00cb240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:25.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.059+0000 7fbea4c00640 1 -- 172.21.15.40:0/1965659183 shutdown_connections 2024-09-11T00:24:25.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.059+0000 7fbea4c00640 1 -- 172.21.15.40:0/1965659183 wait complete. 2024-09-11T00:24:25.078 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2024-09-11T00:24:25.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:25.078 DEBUG:teuthology.orchestra.run.smithi040:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-11T00:24:25.136 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:24:25.136 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T00:24:25.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:25.137 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T00:24:25.178 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:24:25.178 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:24:25.219 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:24:25.219 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:24:25.299 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T00:24:25.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.459+0000 7fe0e3e00640 1 -- 172.21.15.40:0/1713770855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0e415baa0 msgr2=0x7fe0e406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:25.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.459+0000 7fe0e3e00640 1 --2- 172.21.15.40:0/1713770855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0e415baa0 0x7fe0e406e890 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4005fd0 tx=0x7fe0d402a490 comp rx=0 tx=0).stop 2024-09-11T00:24:25.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.459+0000 7fe0e3e00640 1 -- 172.21.15.40:0/1713770855 shutdown_connections 2024-09-11T00:24:25.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.459+0000 7fe0e3e00640 1 --2- 172.21.15.40:0/1713770855 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0e40ae640 0x7fe0e406edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:25.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.459+0000 7fe0e3e00640 1 --2- 172.21.15.40:0/1713770855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0e415baa0 0x7fe0e406e890 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:25.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.459+0000 7fe0e3e00640 1 -- 172.21.15.40:0/1713770855 >> 172.21.15.40:0/1713770855 conn(0x7fe0e40cf770 msgr2=0x7fe0e40cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:25.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.460+0000 7fe0e3e00640 1 -- 172.21.15.40:0/1713770855 shutdown_connections 2024-09-11T00:24:25.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.460+0000 7fe0e3e00640 1 -- 172.21.15.40:0/1713770855 wait complete. 2024-09-11T00:24:25.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.461+0000 7fe0e3e00640 1 Processor -- start 2024-09-11T00:24:25.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.461+0000 7fe0e3e00640 1 -- start start 2024-09-11T00:24:25.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.462+0000 7fe0e3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0e4073830 0x7fe0e4155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:25.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.462+0000 7fe0e3e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0e40ae640 0x7fe0e40c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:25.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.462+0000 7fe0e3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0e415baa0 0x7fe0e40c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:25.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.462+0000 7fe0e3e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e415be80 con 0x7fe0e415baa0 2024-09-11T00:24:25.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.462+0000 7fe0e3e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e40b5760 con 0x7fe0e4073830 2024-09-11T00:24:25.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.462+0000 7fe0e3e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e415c000 con 0x7fe0e40ae640 2024-09-11T00:24:25.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.463+0000 7fe0e3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0e415baa0 0x7fe0e40c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:25.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.463+0000 7fe0e3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0e415baa0 0x7fe0e40c4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59782/0 (socket says 172.21.15.40:59782) 2024-09-11T00:24:25.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.463+0000 7fe0e3400640 1 -- 172.21.15.40:0/2676775170 learned_addr learned my addr 172.21.15.40:0/2676775170 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:25.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.463+0000 7fe0e2a00640 1 --2- 172.21.15.40:0/2676775170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0e4073830 0x7fe0e4155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:25.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.463+0000 7fe0da000640 1 --2- 172.21.15.40:0/2676775170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0e40ae640 0x7fe0e40c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:25.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.463+0000 7fe0e3400640 1 -- 172.21.15.40:0/2676775170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0e40ae640 msgr2=0x7fe0e40c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:25.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.463+0000 7fe0e3400640 1 --2- 172.21.15.40:0/2676775170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0e40ae640 0x7fe0e40c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:25.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.463+0000 7fe0e3400640 1 -- 172.21.15.40:0/2676775170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0e4073830 msgr2=0x7fe0e4155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:25.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.463+0000 7fe0e3400640 1 --2- 172.21.15.40:0/2676775170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0e4073830 0x7fe0e4155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:25.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.463+0000 7fe0e3400640 1 -- 172.21.15.40:0/2676775170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e40c3cb0 con 0x7fe0e415baa0 2024-09-11T00:24:25.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.463+0000 7fe0e3400640 1 --2- 172.21.15.40:0/2676775170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0e415baa0 0x7fe0e40c4de0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00c780 tx=0x7fe0dc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:25.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.464+0000 7fe0db400640 1 -- 172.21.15.40:0/2676775170 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc004b60 con 0x7fe0e415baa0 2024-09-11T00:24:25.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.464+0000 7fe0db400640 1 -- 172.21.15.40:0/2676775170 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0dc004df0 con 0x7fe0e415baa0 2024-09-11T00:24:25.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.464+0000 7fe0db400640 1 -- 172.21.15.40:0/2676775170 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc00aa70 con 0x7fe0e415baa0 2024-09-11T00:24:25.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.464+0000 7fe0e3e00640 1 -- 172.21.15.40:0/2676775170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e40c3f90 con 0x7fe0e415baa0 2024-09-11T00:24:25.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.464+0000 7fe0e3e00640 1 -- 172.21.15.40:0/2676775170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e40c68e0 con 0x7fe0e415baa0 2024-09-11T00:24:25.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.465+0000 7fe0e3e00640 1 -- 172.21.15.40:0/2676775170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e406c750 con 0x7fe0e415baa0 2024-09-11T00:24:25.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.466+0000 7fe0db400640 1 -- 172.21.15.40:0/2676775170 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe0dc00ac10 con 0x7fe0e415baa0 2024-09-11T00:24:25.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.467+0000 7fe0db400640 1 --2- 172.21.15.40:0/2676775170 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe0c0077f70 0x7fe0c007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:25.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.467+0000 7fe0db400640 1 -- 172.21.15.40:0/2676775170 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe0dc099ff0 con 0x7fe0e415baa0 2024-09-11T00:24:25.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.467+0000 7fe0e2a00640 1 --2- 172.21.15.40:0/2676775170 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe0c0077f70 0x7fe0c007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:25.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.468+0000 7fe0e2a00640 1 --2- 172.21.15.40:0/2676775170 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe0c0077f70 0x7fe0c007a430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4033000 tx=0x7fe0d4004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:25.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.471+0000 7fe0db400640 1 -- 172.21.15.40:0/2676775170 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe0e406c750 con 0x7fe0e415baa0 2024-09-11T00:24:25.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.678+0000 7fe0e3e00640 1 -- 172.21.15.40:0/2676775170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe0e40c4160 con 0x7fe0e415baa0 2024-09-11T00:24:25.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.678+0000 7fe0db400640 1 -- 172.21.15.40:0/2676775170 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fe0dc020070 con 0x7fe0e415baa0 2024-09-11T00:24:25.680 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-09-11T00:24:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.680+0000 7fe0e3e00640 1 -- 172.21.15.40:0/2676775170 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe0c0077f70 msgr2=0x7fe0c007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.680+0000 7fe0e3e00640 1 --2- 172.21.15.40:0/2676775170 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe0c0077f70 0x7fe0c007a430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4033000 tx=0x7fe0d4004730 comp rx=0 tx=0).stop 2024-09-11T00:24:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.680+0000 7fe0e3e00640 1 -- 172.21.15.40:0/2676775170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0e415baa0 msgr2=0x7fe0e40c4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.680+0000 7fe0e3e00640 1 --2- 172.21.15.40:0/2676775170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0e415baa0 0x7fe0e40c4de0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00c780 tx=0x7fe0dc00cc40 comp rx=0 tx=0).stop 2024-09-11T00:24:25.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.680+0000 7fe0e3e00640 1 -- 172.21.15.40:0/2676775170 shutdown_connections 2024-09-11T00:24:25.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.680+0000 7fe0e3e00640 1 --2- 172.21.15.40:0/2676775170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0e415baa0 0x7fe0e40c4de0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:25.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.680+0000 7fe0e3e00640 1 --2- 172.21.15.40:0/2676775170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0e40ae640 0x7fe0e40c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:25.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.680+0000 7fe0e3e00640 1 --2- 172.21.15.40:0/2676775170 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe0c0077f70 0x7fe0c007a430 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:25.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.680+0000 7fe0e3e00640 1 --2- 172.21.15.40:0/2676775170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0e4073830 0x7fe0e4155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:25.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.680+0000 7fe0e3e00640 1 -- 172.21.15.40:0/2676775170 >> 172.21.15.40:0/2676775170 conn(0x7fe0e40cf770 msgr2=0x7fe0e415a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:25.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.681+0000 7fe0e3e00640 1 -- 172.21.15.40:0/2676775170 shutdown_connections 2024-09-11T00:24:25.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.681+0000 7fe0e3e00640 1 -- 172.21.15.40:0/2676775170 wait complete. 2024-09-11T00:24:25.697 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:24:25.697 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:24:25.738 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T00:24:25.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.897+0000 7f3060a00640 1 -- 172.21.15.40:0/3018028007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f305c15ec70 msgr2=0x7f305c15e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.897+0000 7f3060a00640 1 --2- 172.21.15.40:0/3018028007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f305c15ec70 0x7f305c15e3b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f305c0721b0 tx=0x7f304c02a580 comp rx=0 tx=0).stop 2024-09-11T00:24:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.897+0000 7f3060a00640 1 -- 172.21.15.40:0/3018028007 shutdown_connections 2024-09-11T00:24:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.897+0000 7f3060a00640 1 --2- 172.21.15.40:0/3018028007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305c0cd780 0x7f305c0cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.897+0000 7f3060a00640 1 --2- 172.21.15.40:0/3018028007 >> v2:172.21.15.175:3300/0 conn(0x7f305c15f050 0x7f305c0ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.897+0000 7f3060a00640 1 --2- 172.21.15.40:0/3018028007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f305c15ec70 0x7f305c15e3b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.897+0000 7f3060a00640 1 -- 172.21.15.40:0/3018028007 >> 172.21.15.40:0/3018028007 conn(0x7f305c0cfbb0 msgr2=0x7f305c0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.898+0000 7f3060a00640 1 -- 172.21.15.40:0/3018028007 shutdown_connections 2024-09-11T00:24:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.898+0000 7f3060a00640 1 -- 172.21.15.40:0/3018028007 wait complete. 2024-09-11T00:24:25.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.899+0000 7f3060a00640 1 Processor -- start 2024-09-11T00:24:25.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.899+0000 7f3060a00640 1 -- start start 2024-09-11T00:24:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.900+0000 7f3060a00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305c0cd780 0x7f305c153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.900+0000 7f3060a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f305c15ec70 0x7f305c0b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.900+0000 7f3060a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f305c15f050 0x7f305c0cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.900+0000 7f3060a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f305c161b20 con 0x7f305c15ec70 2024-09-11T00:24:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.900+0000 7f3060a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f305c1619a0 con 0x7f305c15f050 2024-09-11T00:24:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.900+0000 7f3060a00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f305c161ca0 con 0x7f305c0cd780 2024-09-11T00:24:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.900+0000 7f3051400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f305c15ec70 0x7f305c0b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.900+0000 7f3051400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f305c15ec70 0x7f305c0b5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59798/0 (socket says 172.21.15.40:59798) 2024-09-11T00:24:25.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.900+0000 7f3051400640 1 -- 172.21.15.40:0/3388785935 learned_addr learned my addr 172.21.15.40:0/3388785935 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:25.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.901+0000 7f3059e00640 1 --2- 172.21.15.40:0/3388785935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305c0cd780 0x7f305c153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:25.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.901+0000 7f305a800640 1 --2- 172.21.15.40:0/3388785935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f305c15f050 0x7f305c0cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:25.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.901+0000 7f3051400640 1 -- 172.21.15.40:0/3388785935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305c0cd780 msgr2=0x7f305c153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:25.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.901+0000 7f3051400640 1 --2- 172.21.15.40:0/3388785935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305c0cd780 0x7f305c153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:25.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.901+0000 7f3051400640 1 -- 172.21.15.40:0/3388785935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f305c15f050 msgr2=0x7f305c0cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:25.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.901+0000 7f3051400640 1 --2- 172.21.15.40:0/3388785935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f305c15f050 0x7f305c0cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:25.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.901+0000 7f3051400640 1 -- 172.21.15.40:0/3388785935 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305c0c9a80 con 0x7f305c15ec70 2024-09-11T00:24:25.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.901+0000 7f305a800640 1 --2- 172.21.15.40:0/3388785935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f305c15f050 0x7f305c0cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:25.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.901+0000 7f3051400640 1 --2- 172.21.15.40:0/3388785935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f305c15ec70 0x7f305c0b5250 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f304400d740 tx=0x7f304400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:25.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.901+0000 7f3052a00640 1 -- 172.21.15.40:0/3388785935 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3044017070 con 0x7f305c15ec70 2024-09-11T00:24:25.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.901+0000 7f3052a00640 1 -- 172.21.15.40:0/3388785935 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3044009cc0 con 0x7f305c15ec70 2024-09-11T00:24:25.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.902+0000 7f3060a00640 1 -- 172.21.15.40:0/3388785935 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f305c1f8080 con 0x7f305c15ec70 2024-09-11T00:24:25.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.902+0000 7f3052a00640 1 -- 172.21.15.40:0/3388785935 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30440106c0 con 0x7f305c15ec70 2024-09-11T00:24:25.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.902+0000 7f3060a00640 1 -- 172.21.15.40:0/3388785935 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f305c1f8640 con 0x7f305c15ec70 2024-09-11T00:24:25.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.903+0000 7f3060a00640 1 -- 172.21.15.40:0/3388785935 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f305c0cdbb0 con 0x7f305c15ec70 2024-09-11T00:24:25.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.904+0000 7f3052a00640 1 -- 172.21.15.40:0/3388785935 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3044010860 con 0x7f305c15ec70 2024-09-11T00:24:25.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.905+0000 7f3052a00640 1 --2- 172.21.15.40:0/3388785935 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f3038077f70 0x7f303807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:25.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.905+0000 7f3052a00640 1 -- 172.21.15.40:0/3388785935 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f304409a070 con 0x7f305c15ec70 2024-09-11T00:24:25.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.905+0000 7f3059e00640 1 --2- 172.21.15.40:0/3388785935 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f3038077f70 0x7f303807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:25.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.906+0000 7f3059e00640 1 --2- 172.21.15.40:0/3388785935 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f3038077f70 0x7f303807a430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f304c033000 tx=0x7f304c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:25.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:25.909+0000 7f3052a00640 1 -- 172.21.15.40:0/3388785935 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3044062510 con 0x7f305c15ec70 2024-09-11T00:24:26.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.114+0000 7f3060a00640 1 -- 172.21.15.40:0/3388785935 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f305c160860 con 0x7f305c15ec70 2024-09-11T00:24:26.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.115+0000 7f3052a00640 1 -- 172.21.15.40:0/3388785935 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f3044066f40 con 0x7f305c15ec70 2024-09-11T00:24:26.116 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-09-11T00:24:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.117+0000 7f3060a00640 1 -- 172.21.15.40:0/3388785935 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f3038077f70 msgr2=0x7f303807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.117+0000 7f3060a00640 1 --2- 172.21.15.40:0/3388785935 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f3038077f70 0x7f303807a430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f304c033000 tx=0x7f304c004730 comp rx=0 tx=0).stop 2024-09-11T00:24:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.117+0000 7f3060a00640 1 -- 172.21.15.40:0/3388785935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f305c15ec70 msgr2=0x7f305c0b5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.117+0000 7f3060a00640 1 --2- 172.21.15.40:0/3388785935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f305c15ec70 0x7f305c0b5250 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f304400d740 tx=0x7f304400dc00 comp rx=0 tx=0).stop 2024-09-11T00:24:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.117+0000 7f3060a00640 1 -- 172.21.15.40:0/3388785935 shutdown_connections 2024-09-11T00:24:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.117+0000 7f3060a00640 1 --2- 172.21.15.40:0/3388785935 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f3038077f70 0x7f303807a430 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:26.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.117+0000 7f3060a00640 1 --2- 172.21.15.40:0/3388785935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f305c15f050 0x7f305c0cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:26.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.117+0000 7f3060a00640 1 --2- 172.21.15.40:0/3388785935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f305c15ec70 0x7f305c0b5250 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:26.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.117+0000 7f3060a00640 1 --2- 172.21.15.40:0/3388785935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305c0cd780 0x7f305c153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:26.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.117+0000 7f3060a00640 1 -- 172.21.15.40:0/3388785935 >> 172.21.15.40:0/3388785935 conn(0x7f305c0cfbb0 msgr2=0x7f305c0b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:26.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.117+0000 7f3060a00640 1 -- 172.21.15.40:0/3388785935 shutdown_connections 2024-09-11T00:24:26.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.117+0000 7f3060a00640 1 -- 172.21.15.40:0/3388785935 wait complete. 2024-09-11T00:24:26.135 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi175.front.sepia.ceph.com... 2024-09-11T00:24:26.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:26.135 DEBUG:teuthology.orchestra.run.smithi175:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-11T00:24:26.198 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:24:26.198 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-09-11T00:24:26.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:26.199 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T00:24:26.246 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:24:26.246 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:24:26.282 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:24:26.282 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:24:26.358 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T00:24:26.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.560+0000 7f7742e00640 1 -- 172.21.15.40:0/3029762011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f773c0cba70 msgr2=0x7f773c0cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:26.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.560+0000 7f7742e00640 1 --2- 172.21.15.40:0/3029762011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f773c0cba70 0x7f773c0cbec0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7728005fd0 tx=0x7f772802a620 comp rx=0 tx=0).stop 2024-09-11T00:24:26.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.560+0000 7f7742e00640 1 -- 172.21.15.40:0/3029762011 shutdown_connections 2024-09-11T00:24:26.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.560+0000 7f7742e00640 1 --2- 172.21.15.40:0/3029762011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f773c0cba70 0x7f773c0cbec0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:26.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.560+0000 7f7742e00640 1 --2- 172.21.15.40:0/3029762011 >> v2:172.21.15.175:3300/0 conn(0x7f773c15bcc0 0x7f773c0cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:26.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.560+0000 7f7742e00640 1 -- 172.21.15.40:0/3029762011 >> 172.21.15.40:0/3029762011 conn(0x7f773c0cfbb0 msgr2=0x7f773c0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:26.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.560+0000 7f7742e00640 1 -- 172.21.15.40:0/3029762011 shutdown_connections 2024-09-11T00:24:26.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.560+0000 7f7742e00640 1 -- 172.21.15.40:0/3029762011 wait complete. 2024-09-11T00:24:26.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.562+0000 7f7742e00640 1 Processor -- start 2024-09-11T00:24:26.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.562+0000 7f7742e00640 1 -- start start 2024-09-11T00:24:26.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.563+0000 7f7742e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f773c0ca200 0x7f773c1581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:26.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.563+0000 7f7742e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f773c0cba70 0x7f773c06e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:26.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.563+0000 7f7742e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f773c15bcc0 0x7f773c06edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:26.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.563+0000 7f7742e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f773c15f940 con 0x7f773c15bcc0 2024-09-11T00:24:26.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.563+0000 7f7742e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f773c15f7c0 con 0x7f773c0ca200 2024-09-11T00:24:26.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.563+0000 7f7742e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f773c0cad60 con 0x7f773c0cba70 2024-09-11T00:24:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.563+0000 7f7740e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f773c15bcc0 0x7f773c06edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.563+0000 7f7740e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f773c15bcc0 0x7f773c06edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59814/0 (socket says 172.21.15.40:59814) 2024-09-11T00:24:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.563+0000 7f7740e00640 1 -- 172.21.15.40:0/492011792 learned_addr learned my addr 172.21.15.40:0/492011792 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.564+0000 7f773b400640 1 --2- 172.21.15.40:0/492011792 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f773c0cba70 0x7f773c06e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.564+0000 7f773be00640 1 --2- 172.21.15.40:0/492011792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f773c0ca200 0x7f773c1581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.564+0000 7f7740e00640 1 -- 172.21.15.40:0/492011792 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f773c0cba70 msgr2=0x7f773c06e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.564+0000 7f7740e00640 1 --2- 172.21.15.40:0/492011792 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f773c0cba70 0x7f773c06e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.564+0000 7f7740e00640 1 -- 172.21.15.40:0/492011792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f773c0ca200 msgr2=0x7f773c1581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.564+0000 7f7740e00640 1 --2- 172.21.15.40:0/492011792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f773c0ca200 0x7f773c1581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:26.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.564+0000 7f7740e00640 1 -- 172.21.15.40:0/492011792 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f773c158710 con 0x7f773c15bcc0 2024-09-11T00:24:26.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.564+0000 7f7740e00640 1 --2- 172.21.15.40:0/492011792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f773c15bcc0 0x7f773c06edc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f773400c770 tx=0x7f773400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:26.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.564+0000 7f7733e00640 1 -- 172.21.15.40:0/492011792 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7734003da0 con 0x7f773c15bcc0 2024-09-11T00:24:26.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.564+0000 7f7733e00640 1 -- 172.21.15.40:0/492011792 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7734005070 con 0x7f773c15bcc0 2024-09-11T00:24:26.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.564+0000 7f7742e00640 1 -- 172.21.15.40:0/492011792 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f773c1f3a40 con 0x7f773c15bcc0 2024-09-11T00:24:26.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.565+0000 7f7733e00640 1 -- 172.21.15.40:0/492011792 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7734005500 con 0x7f773c15bcc0 2024-09-11T00:24:26.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.565+0000 7f7742e00640 1 -- 172.21.15.40:0/492011792 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f773c1f4000 con 0x7f773c15bcc0 2024-09-11T00:24:26.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.566+0000 7f7742e00640 1 -- 172.21.15.40:0/492011792 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f773c0cbec0 con 0x7f773c15bcc0 2024-09-11T00:24:26.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.567+0000 7f7733e00640 1 -- 172.21.15.40:0/492011792 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f773400a5e0 con 0x7f773c15bcc0 2024-09-11T00:24:26.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.568+0000 7f7733e00640 1 --2- 172.21.15.40:0/492011792 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f771c077f70 0x7f771c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:26.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.568+0000 7f7733e00640 1 -- 172.21.15.40:0/492011792 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7734099c00 con 0x7f773c15bcc0 2024-09-11T00:24:26.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.568+0000 7f773be00640 1 --2- 172.21.15.40:0/492011792 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f771c077f70 0x7f771c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:26.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.569+0000 7f773be00640 1 --2- 172.21.15.40:0/492011792 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f771c077f70 0x7f771c07a430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f772c009ac0 tx=0x7f772c005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.572+0000 7f7733e00640 1 -- 172.21.15.40:0/492011792 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7734062670 con 0x7f773c15bcc0 2024-09-11T00:24:26.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.776+0000 7f7742e00640 1 -- 172.21.15.40:0/492011792 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f773c15b1b0 con 0x7f773c15bcc0 2024-09-11T00:24:26.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.776+0000 7f7733e00640 1 -- 172.21.15.40:0/492011792 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f7734061f70 con 0x7f773c15bcc0 2024-09-11T00:24:26.778 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-09-11T00:24:26.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.778+0000 7f7742e00640 1 -- 172.21.15.40:0/492011792 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f771c077f70 msgr2=0x7f771c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:26.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.778+0000 7f7742e00640 1 --2- 172.21.15.40:0/492011792 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f771c077f70 0x7f771c07a430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f772c009ac0 tx=0x7f772c005f90 comp rx=0 tx=0).stop 2024-09-11T00:24:26.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.778+0000 7f7742e00640 1 -- 172.21.15.40:0/492011792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f773c15bcc0 msgr2=0x7f773c06edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:26.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.778+0000 7f7742e00640 1 --2- 172.21.15.40:0/492011792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f773c15bcc0 0x7f773c06edc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f773400c770 tx=0x7f773400cc30 comp rx=0 tx=0).stop 2024-09-11T00:24:26.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.778+0000 7f7742e00640 1 -- 172.21.15.40:0/492011792 shutdown_connections 2024-09-11T00:24:26.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.778+0000 7f7742e00640 1 --2- 172.21.15.40:0/492011792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f773c15bcc0 0x7f773c06edc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:26.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.778+0000 7f7742e00640 1 --2- 172.21.15.40:0/492011792 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f773c0cba70 0x7f773c06e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:26.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.778+0000 7f7742e00640 1 --2- 172.21.15.40:0/492011792 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f771c077f70 0x7f771c07a430 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:26.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.778+0000 7f7742e00640 1 --2- 172.21.15.40:0/492011792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f773c0ca200 0x7f773c1581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:26.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.778+0000 7f7742e00640 1 -- 172.21.15.40:0/492011792 >> 172.21.15.40:0/492011792 conn(0x7f773c0cfbb0 msgr2=0x7f773c0b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:26.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.778+0000 7f7742e00640 1 -- 172.21.15.40:0/492011792 shutdown_connections 2024-09-11T00:24:26.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:26.779+0000 7f7742e00640 1 -- 172.21.15.40:0/492011792 wait complete. 2024-09-11T00:24:26.795 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:24:26.795 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:24:26.831 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T00:24:27.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.031+0000 7f0d25a00640 1 -- 172.21.15.40:0/2033913641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d200cb420 msgr2=0x7f0d2006f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:27.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.031+0000 7f0d25a00640 1 --2- 172.21.15.40:0/2033913641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d200cb420 0x7f0d2006f020 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0d18005fd0 tx=0x7f0d1802a940 comp rx=0 tx=0).stop 2024-09-11T00:24:27.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.032+0000 7f0d25a00640 1 -- 172.21.15.40:0/2033913641 shutdown_connections 2024-09-11T00:24:27.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.032+0000 7f0d25a00640 1 --2- 172.21.15.40:0/2033913641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d200cb420 0x7f0d2006f020 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.032+0000 7f0d25a00640 1 -- 172.21.15.40:0/2033913641 >> 172.21.15.40:0/2033913641 conn(0x7f0d200cfbb0 msgr2=0x7f0d200cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:27.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.032+0000 7f0d25a00640 1 -- 172.21.15.40:0/2033913641 shutdown_connections 2024-09-11T00:24:27.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.032+0000 7f0d25a00640 1 -- 172.21.15.40:0/2033913641 wait complete. 2024-09-11T00:24:27.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.033+0000 7f0d25a00640 1 Processor -- start 2024-09-11T00:24:27.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.033+0000 7f0d25a00640 1 -- start start 2024-09-11T00:24:27.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.034+0000 7f0d25a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d200cb420 0x7f0d201f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.034+0000 7f0d25a00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d200cc180 0x7f0d20159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.034+0000 7f0d25a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d2015bcc0 0x7f0d200c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.034+0000 7f0d25a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2006f560 con 0x7f0d200cb420 2024-09-11T00:24:27.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.034+0000 7f0d25a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2015f9d0 con 0x7f0d2015bcc0 2024-09-11T00:24:27.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.034+0000 7f0d25a00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0d2006f6e0 con 0x7f0d200cc180 2024-09-11T00:24:27.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.035+0000 7f0d1ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d200cb420 0x7f0d201f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.035+0000 7f0d1ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d200cb420 0x7f0d201f5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59822/0 (socket says 172.21.15.40:59822) 2024-09-11T00:24:27.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.035+0000 7f0d1ea00640 1 -- 172.21.15.40:0/1627496641 learned_addr learned my addr 172.21.15.40:0/1627496641 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:27.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.035+0000 7f0d16000640 1 --2- 172.21.15.40:0/1627496641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d200cc180 0x7f0d20159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.035+0000 7f0d1f400640 1 --2- 172.21.15.40:0/1627496641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d2015bcc0 0x7f0d200c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.035+0000 7f0d1ea00640 1 -- 172.21.15.40:0/1627496641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d200cc180 msgr2=0x7f0d20159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:27.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.035+0000 7f0d1ea00640 1 --2- 172.21.15.40:0/1627496641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d200cc180 0x7f0d20159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.035+0000 7f0d1ea00640 1 -- 172.21.15.40:0/1627496641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d2015bcc0 msgr2=0x7f0d200c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:27.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.035+0000 7f0d1ea00640 1 --2- 172.21.15.40:0/1627496641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d2015bcc0 0x7f0d200c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.035+0000 7f0d1ea00640 1 -- 172.21.15.40:0/1627496641 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d200b1070 con 0x7f0d200cb420 2024-09-11T00:24:27.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.035+0000 7f0d1f400640 1 --2- 172.21.15.40:0/1627496641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d2015bcc0 0x7f0d200c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:27.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.035+0000 7f0d1ea00640 1 --2- 172.21.15.40:0/1627496641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d200cb420 0x7f0d201f5270 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0d1000c430 tx=0x7f0d1000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:27.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.036+0000 7f0d17400640 1 -- 172.21.15.40:0/1627496641 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d10017070 con 0x7f0d200cb420 2024-09-11T00:24:27.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.036+0000 7f0d17400640 1 -- 172.21.15.40:0/1627496641 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d100053e0 con 0x7f0d200cb420 2024-09-11T00:24:27.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.036+0000 7f0d17400640 1 -- 172.21.15.40:0/1627496641 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d10003850 con 0x7f0d200cb420 2024-09-11T00:24:27.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.036+0000 7f0d25a00640 1 -- 172.21.15.40:0/1627496641 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d200b1350 con 0x7f0d200cb420 2024-09-11T00:24:27.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.036+0000 7f0d25a00640 1 -- 172.21.15.40:0/1627496641 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d201f4d50 con 0x7f0d200cb420 2024-09-11T00:24:27.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.037+0000 7f0d25a00640 1 -- 172.21.15.40:0/1627496641 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d2006fb90 con 0x7f0d200cb420 2024-09-11T00:24:27.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.038+0000 7f0d17400640 1 -- 172.21.15.40:0/1627496641 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0d100039f0 con 0x7f0d200cb420 2024-09-11T00:24:27.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.039+0000 7f0d17400640 1 --2- 172.21.15.40:0/1627496641 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0cfc077f70 0x7f0cfc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.039+0000 7f0d17400640 1 -- 172.21.15.40:0/1627496641 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0d100993c0 con 0x7f0d200cb420 2024-09-11T00:24:27.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.039+0000 7f0d16000640 1 --2- 172.21.15.40:0/1627496641 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0cfc077f70 0x7f0cfc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.040+0000 7f0d16000640 1 --2- 172.21.15.40:0/1627496641 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0cfc077f70 0x7f0cfc07a430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0d08007fd0 tx=0x7f0d08007eb0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:27.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.043+0000 7f0d17400640 1 -- 172.21.15.40:0/1627496641 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0d10061860 con 0x7f0d200cb420 2024-09-11T00:24:27.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.248+0000 7f0d25a00640 1 -- 172.21.15.40:0/1627496641 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0d20074e00 con 0x7f0d200cb420 2024-09-11T00:24:27.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.248+0000 7f0d17400640 1 -- 172.21.15.40:0/1627496641 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f0d10066290 con 0x7f0d200cb420 2024-09-11T00:24:27.251 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-09-11T00:24:27.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.251+0000 7f0d25a00640 1 -- 172.21.15.40:0/1627496641 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0cfc077f70 msgr2=0x7f0cfc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:27.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.251+0000 7f0d25a00640 1 --2- 172.21.15.40:0/1627496641 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0cfc077f70 0x7f0cfc07a430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0d08007fd0 tx=0x7f0d08007eb0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.251+0000 7f0d25a00640 1 -- 172.21.15.40:0/1627496641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d200cb420 msgr2=0x7f0d201f5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:27.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.251+0000 7f0d25a00640 1 --2- 172.21.15.40:0/1627496641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d200cb420 0x7f0d201f5270 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0d1000c430 tx=0x7f0d1000c8f0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.251+0000 7f0d25a00640 1 -- 172.21.15.40:0/1627496641 shutdown_connections 2024-09-11T00:24:27.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.251+0000 7f0d25a00640 1 --2- 172.21.15.40:0/1627496641 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0cfc077f70 0x7f0cfc07a430 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.251+0000 7f0d25a00640 1 --2- 172.21.15.40:0/1627496641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d2015bcc0 0x7f0d200c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.251+0000 7f0d25a00640 1 --2- 172.21.15.40:0/1627496641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d200cc180 0x7f0d20159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.251+0000 7f0d25a00640 1 --2- 172.21.15.40:0/1627496641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d200cb420 0x7f0d201f5270 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.251+0000 7f0d25a00640 1 -- 172.21.15.40:0/1627496641 >> 172.21.15.40:0/1627496641 conn(0x7f0d200cfbb0 msgr2=0x7f0d200b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:27.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.251+0000 7f0d25a00640 1 -- 172.21.15.40:0/1627496641 shutdown_connections 2024-09-11T00:24:27.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.251+0000 7f0d25a00640 1 -- 172.21.15.40:0/1627496641 wait complete. 2024-09-11T00:24:27.269 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2024-09-11T00:24:27.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:27.270 DEBUG:teuthology.orchestra.run.smithi040:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-11T00:24:27.327 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:24:27.327 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T00:24:27.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:27.327 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-11T00:24:27.363 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:24:27.363 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:24:27.402 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:24:27.402 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:24:27.478 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T00:24:27.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.637+0000 7f523c800640 1 -- 172.21.15.40:0/3421031663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f523415a410 msgr2=0x7f52340724f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:27.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.637+0000 7f523c800640 1 --2- 172.21.15.40:0/3421031663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f523415a410 0x7f52340724f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5224009830 tx=0x7f522402a530 comp rx=0 tx=0).stop 2024-09-11T00:24:27.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.637+0000 7f523c800640 1 -- 172.21.15.40:0/3421031663 shutdown_connections 2024-09-11T00:24:27.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.637+0000 7f523c800640 1 --2- 172.21.15.40:0/3421031663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52340d06d0 0x7f52340cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.637+0000 7f523c800640 1 --2- 172.21.15.40:0/3421031663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f523415a410 0x7f52340724f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.637+0000 7f523c800640 1 -- 172.21.15.40:0/3421031663 >> 172.21.15.40:0/3421031663 conn(0x7f52340cfbb0 msgr2=0x7f52340cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:27.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.637+0000 7f523c800640 1 -- 172.21.15.40:0/3421031663 shutdown_connections 2024-09-11T00:24:27.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.637+0000 7f523c800640 1 -- 172.21.15.40:0/3421031663 wait complete. 2024-09-11T00:24:27.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.639+0000 7f523c800640 1 Processor -- start 2024-09-11T00:24:27.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.639+0000 7f523c800640 1 -- start start 2024-09-11T00:24:27.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.640+0000 7f523c800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52340ca350 0x7f5234155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.640+0000 7f523c800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52340d06d0 0x7f52341f80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.640+0000 7f523c800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523415a410 0x7f52340b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.640+0000 7f523c800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5234072ae0 con 0x7f523415a410 2024-09-11T00:24:27.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.640+0000 7f523c800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f523415df80 con 0x7f52340d06d0 2024-09-11T00:24:27.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.640+0000 7f523c800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f52340cefb0 con 0x7f52340ca350 2024-09-11T00:24:27.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.640+0000 7f523a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523415a410 0x7f52340b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.640+0000 7f523a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523415a410 0x7f52340b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59828/0 (socket says 172.21.15.40:59828) 2024-09-11T00:24:27.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.640+0000 7f523a800640 1 -- 172.21.15.40:0/3492765126 learned_addr learned my addr 172.21.15.40:0/3492765126 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:27.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.640+0000 7f5239400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52340d06d0 0x7f52341f80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.640+0000 7f5239e00640 1 --2- 172.21.15.40:0/3492765126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52340ca350 0x7f5234155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.641+0000 7f523a800640 1 -- 172.21.15.40:0/3492765126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52340ca350 msgr2=0x7f5234155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:27.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.641+0000 7f523a800640 1 --2- 172.21.15.40:0/3492765126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52340ca350 0x7f5234155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.641+0000 7f523a800640 1 -- 172.21.15.40:0/3492765126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52340d06d0 msgr2=0x7f52341f80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:27.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.641+0000 7f523a800640 1 --2- 172.21.15.40:0/3492765126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52340d06d0 0x7f52341f80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.641+0000 7f523a800640 1 -- 172.21.15.40:0/3492765126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52340b52d0 con 0x7f523415a410 2024-09-11T00:24:27.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.641+0000 7f5239400640 1 --2- 172.21.15.40:0/3492765126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52340d06d0 0x7f52341f80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:24:27.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.641+0000 7f523a800640 1 --2- 172.21.15.40:0/3492765126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523415a410 0x7f52340b3c90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5230009fd0 tx=0x7f523000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:27.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.641+0000 7f522e000640 1 -- 172.21.15.40:0/3492765126 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5230004b20 con 0x7f523415a410 2024-09-11T00:24:27.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.641+0000 7f522e000640 1 -- 172.21.15.40:0/3492765126 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5230004dd0 con 0x7f523415a410 2024-09-11T00:24:27.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.642+0000 7f523c800640 1 -- 172.21.15.40:0/3492765126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52340b4d70 con 0x7f523415a410 2024-09-11T00:24:27.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.642+0000 7f522e000640 1 -- 172.21.15.40:0/3492765126 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5230003bd0 con 0x7f523415a410 2024-09-11T00:24:27.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.642+0000 7f523c800640 1 -- 172.21.15.40:0/3492765126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52340b3770 con 0x7f523415a410 2024-09-11T00:24:27.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.643+0000 7f523c800640 1 -- 172.21.15.40:0/3492765126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52340cf540 con 0x7f523415a410 2024-09-11T00:24:27.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.644+0000 7f522e000640 1 -- 172.21.15.40:0/3492765126 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f523000b040 con 0x7f523415a410 2024-09-11T00:24:27.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.645+0000 7f522e000640 1 --2- 172.21.15.40:0/3492765126 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5218077f70 0x7f521807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.645+0000 7f522e000640 1 -- 172.21.15.40:0/3492765126 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f523009a3d0 con 0x7f523415a410 2024-09-11T00:24:27.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.645+0000 7f5239e00640 1 --2- 172.21.15.40:0/3492765126 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5218077f70 0x7f521807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.646+0000 7f5239e00640 1 --2- 172.21.15.40:0/3492765126 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5218077f70 0x7f521807a430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f52340b4640 tx=0x7f5228009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:27.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.649+0000 7f522e000640 1 -- 172.21.15.40:0/3492765126 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f52340b4d70 con 0x7f523415a410 2024-09-11T00:24:27.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.857+0000 7f523c800640 1 -- 172.21.15.40:0/3492765126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f52340cd500 con 0x7f523415a410 2024-09-11T00:24:27.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.858+0000 7f522e000640 1 -- 172.21.15.40:0/3492765126 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f5230062870 con 0x7f523415a410 2024-09-11T00:24:27.860 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-09-11T00:24:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.860+0000 7f523c800640 1 -- 172.21.15.40:0/3492765126 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5218077f70 msgr2=0x7f521807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.860+0000 7f523c800640 1 --2- 172.21.15.40:0/3492765126 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5218077f70 0x7f521807a430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f52340b4640 tx=0x7f5228009040 comp rx=0 tx=0).stop 2024-09-11T00:24:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.860+0000 7f523c800640 1 -- 172.21.15.40:0/3492765126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523415a410 msgr2=0x7f52340b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.860+0000 7f523c800640 1 --2- 172.21.15.40:0/3492765126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523415a410 0x7f52340b3c90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5230009fd0 tx=0x7f523000c800 comp rx=0 tx=0).stop 2024-09-11T00:24:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.860+0000 7f523c800640 1 -- 172.21.15.40:0/3492765126 shutdown_connections 2024-09-11T00:24:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.860+0000 7f523c800640 1 --2- 172.21.15.40:0/3492765126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523415a410 0x7f52340b3c90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.860+0000 7f523c800640 1 --2- 172.21.15.40:0/3492765126 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5218077f70 0x7f521807a430 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.860+0000 7f523c800640 1 --2- 172.21.15.40:0/3492765126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52340d06d0 0x7f52341f80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.860+0000 7f523c800640 1 --2- 172.21.15.40:0/3492765126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52340ca350 0x7f5234155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.860+0000 7f523c800640 1 -- 172.21.15.40:0/3492765126 >> 172.21.15.40:0/3492765126 conn(0x7f52340cfbb0 msgr2=0x7f52340ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.860+0000 7f523c800640 1 -- 172.21.15.40:0/3492765126 shutdown_connections 2024-09-11T00:24:27.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:27.860+0000 7f523c800640 1 -- 172.21.15.40:0/3492765126 wait complete. 2024-09-11T00:24:27.879 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:24:27.879 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:24:27.919 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T00:24:28.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.081+0000 7f02cb200640 1 -- 172.21.15.40:0/1082569603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02cc0d09e0 msgr2=0x7f02cc06cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:28.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.081+0000 7f02cb200640 1 --2- 172.21.15.40:0/1082569603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02cc0d09e0 0x7f02cc06cfc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0b2cb0 tx=0x7f02c402a950 comp rx=0 tx=0).stop 2024-09-11T00:24:28.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.081+0000 7f02cb200640 1 -- 172.21.15.40:0/1082569603 shutdown_connections 2024-09-11T00:24:28.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.081+0000 7f02cb200640 1 --2- 172.21.15.40:0/1082569603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02cc0d09e0 0x7f02cc06cfc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:28.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.081+0000 7f02cb200640 1 --2- 172.21.15.40:0/1082569603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02cc15dd10 0x7f02cc0d4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:28.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.081+0000 7f02cb200640 1 -- 172.21.15.40:0/1082569603 >> 172.21.15.40:0/1082569603 conn(0x7f02cc0d3c20 msgr2=0x7f02cc0d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:28.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.081+0000 7f02cb200640 1 -- 172.21.15.40:0/1082569603 shutdown_connections 2024-09-11T00:24:28.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.081+0000 7f02cb200640 1 -- 172.21.15.40:0/1082569603 wait complete. 2024-09-11T00:24:28.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.083+0000 7f02cb200640 1 Processor -- start 2024-09-11T00:24:28.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.083+0000 7f02cb200640 1 -- start start 2024-09-11T00:24:28.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.084+0000 7f02cb200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02cc0b2d20 0x7f02cc0b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:28.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.084+0000 7f02cb200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02cc0d09e0 0x7f02cc0c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:28.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.084+0000 7f02cb200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02cc15dd10 0x7f02cc0ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:28.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.084+0000 7f02cb200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc06d910 con 0x7f02cc0b2d20 2024-09-11T00:24:28.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.084+0000 7f02cb200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc06d790 con 0x7f02cc15dd10 2024-09-11T00:24:28.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.084+0000 7f02cb200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f02cc06da90 con 0x7f02cc0d09e0 2024-09-11T00:24:28.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.084+0000 7f02c9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02cc0b2d20 0x7f02cc0b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:28.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.084+0000 7f02c9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02cc0b2d20 0x7f02cc0b0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47754/0 (socket says 172.21.15.40:47754) 2024-09-11T00:24:28.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.084+0000 7f02c9e00640 1 -- 172.21.15.40:0/2358789744 learned_addr learned my addr 172.21.15.40:0/2358789744 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:28.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.084+0000 7f02c9400640 1 --2- 172.21.15.40:0/2358789744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02cc0d09e0 0x7f02cc0c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:28.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.084+0000 7f02ca800640 1 --2- 172.21.15.40:0/2358789744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02cc15dd10 0x7f02cc0ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:28.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.085+0000 7f02c9e00640 1 -- 172.21.15.40:0/2358789744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02cc0d09e0 msgr2=0x7f02cc0c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:28.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.085+0000 7f02c9e00640 1 --2- 172.21.15.40:0/2358789744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02cc0d09e0 0x7f02cc0c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:28.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.085+0000 7f02c9e00640 1 -- 172.21.15.40:0/2358789744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02cc15dd10 msgr2=0x7f02cc0ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:28.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.085+0000 7f02c9e00640 1 --2- 172.21.15.40:0/2358789744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02cc15dd10 0x7f02cc0ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:28.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.085+0000 7f02c9e00640 1 -- 172.21.15.40:0/2358789744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02cc1f4c80 con 0x7f02cc0b2d20 2024-09-11T00:24:28.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.085+0000 7f02c9e00640 1 --2- 172.21.15.40:0/2358789744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02cc0b2d20 0x7f02cc0b0bb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00b410 tx=0x7f02bc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:28.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.085+0000 7f02c2000640 1 -- 172.21.15.40:0/2358789744 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc015020 con 0x7f02cc0b2d20 2024-09-11T00:24:28.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.085+0000 7f02c2000640 1 -- 172.21.15.40:0/2358789744 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02bc011940 con 0x7f02cc0b2d20 2024-09-11T00:24:28.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.085+0000 7f02c2000640 1 -- 172.21.15.40:0/2358789744 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc011d90 con 0x7f02cc0b2d20 2024-09-11T00:24:28.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.085+0000 7f02cb200640 1 -- 172.21.15.40:0/2358789744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02cc0b3670 con 0x7f02cc0b2d20 2024-09-11T00:24:28.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.085+0000 7f02cb200640 1 -- 172.21.15.40:0/2358789744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02cc1f5220 con 0x7f02cc0b2d20 2024-09-11T00:24:28.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.087+0000 7f02cb200640 1 -- 172.21.15.40:0/2358789744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02cc06e000 con 0x7f02cc0b2d20 2024-09-11T00:24:28.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.088+0000 7f02c2000640 1 -- 172.21.15.40:0/2358789744 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f02bc01a400 con 0x7f02cc0b2d20 2024-09-11T00:24:28.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.089+0000 7f02c2000640 1 --2- 172.21.15.40:0/2358789744 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f02ac077f70 0x7f02ac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:28.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.089+0000 7f02c2000640 1 -- 172.21.15.40:0/2358789744 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f02bc099f40 con 0x7f02cc0b2d20 2024-09-11T00:24:28.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.089+0000 7f02c9400640 1 --2- 172.21.15.40:0/2358789744 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f02ac077f70 0x7f02ac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:28.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.090+0000 7f02c9400640 1 --2- 172.21.15.40:0/2358789744 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f02ac077f70 0x7f02ac07a430 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f02cc151d60 tx=0x7f02b8009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:28.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.093+0000 7f02c2000640 1 -- 172.21.15.40:0/2358789744 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f02bc01f020 con 0x7f02cc0b2d20 2024-09-11T00:24:28.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.299+0000 7f02cb200640 1 -- 172.21.15.40:0/2358789744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f02cc15cc60 con 0x7f02cc0b2d20 2024-09-11T00:24:28.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.299+0000 7f02c2000640 1 -- 172.21.15.40:0/2358789744 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f02bc062360 con 0x7f02cc0b2d20 2024-09-11T00:24:28.302 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-09-11T00:24:28.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.302+0000 7f02cb200640 1 -- 172.21.15.40:0/2358789744 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f02ac077f70 msgr2=0x7f02ac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:28.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.302+0000 7f02cb200640 1 --2- 172.21.15.40:0/2358789744 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f02ac077f70 0x7f02ac07a430 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f02cc151d60 tx=0x7f02b8009040 comp rx=0 tx=0).stop 2024-09-11T00:24:28.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.302+0000 7f02cb200640 1 -- 172.21.15.40:0/2358789744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02cc0b2d20 msgr2=0x7f02cc0b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:28.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.302+0000 7f02cb200640 1 --2- 172.21.15.40:0/2358789744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02cc0b2d20 0x7f02cc0b0bb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00b410 tx=0x7f02bc00b8d0 comp rx=0 tx=0).stop 2024-09-11T00:24:28.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.302+0000 7f02cb200640 1 -- 172.21.15.40:0/2358789744 shutdown_connections 2024-09-11T00:24:28.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.302+0000 7f02cb200640 1 --2- 172.21.15.40:0/2358789744 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f02ac077f70 0x7f02ac07a430 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:28.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.302+0000 7f02cb200640 1 --2- 172.21.15.40:0/2358789744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02cc15dd10 0x7f02cc0ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:28.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.302+0000 7f02cb200640 1 --2- 172.21.15.40:0/2358789744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02cc0d09e0 0x7f02cc0c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:28.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.302+0000 7f02cb200640 1 --2- 172.21.15.40:0/2358789744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02cc0b2d20 0x7f02cc0b0bb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:28.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.302+0000 7f02cb200640 1 -- 172.21.15.40:0/2358789744 >> 172.21.15.40:0/2358789744 conn(0x7f02cc0d3c20 msgr2=0x7f02cc15bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:28.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.302+0000 7f02cb200640 1 -- 172.21.15.40:0/2358789744 shutdown_connections 2024-09-11T00:24:28.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.302+0000 7f02cb200640 1 -- 172.21.15.40:0/2358789744 wait complete. 2024-09-11T00:24:28.320 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi175.front.sepia.ceph.com... 2024-09-11T00:24:28.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:28.320 DEBUG:teuthology.orchestra.run.smithi175:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-09-11T00:24:28.382 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:24:28.382 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-09-11T00:24:28.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:28.382 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-11T00:24:28.422 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T00:24:28.422 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:24:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.583+0000 7f6a86400640 1 -- 172.21.15.40:0/1792178023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8015bcc0 msgr2=0x7f6a800cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.583+0000 7f6a86400640 1 --2- 172.21.15.40:0/1792178023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8015bcc0 0x7f6a800cb420 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6a70005fd0 tx=0x7f6a7002a620 comp rx=0 tx=0).stop 2024-09-11T00:24:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.583+0000 7f6a86400640 1 -- 172.21.15.40:0/1792178023 shutdown_connections 2024-09-11T00:24:28.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.583+0000 7f6a86400640 1 --2- 172.21.15.40:0/1792178023 >> v2:172.21.15.175:3300/0 conn(0x7f6a8006f920 0x7f6a800cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:28.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.583+0000 7f6a86400640 1 --2- 172.21.15.40:0/1792178023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8015bcc0 0x7f6a800cb420 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:28.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.583+0000 7f6a86400640 1 -- 172.21.15.40:0/1792178023 >> 172.21.15.40:0/1792178023 conn(0x7f6a800cfbb0 msgr2=0x7f6a800cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:28.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.583+0000 7f6a86400640 1 -- 172.21.15.40:0/1792178023 shutdown_connections 2024-09-11T00:24:28.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.583+0000 7f6a86400640 1 -- 172.21.15.40:0/1792178023 wait complete. 2024-09-11T00:24:28.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.585+0000 7f6a86400640 1 Processor -- start 2024-09-11T00:24:28.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.585+0000 7f6a86400640 1 -- start start 2024-09-11T00:24:28.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.586+0000 7f6a86400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a8006f920 0x7f6a801f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:28.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.586+0000 7f6a86400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a800cba70 0x7f6a800c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:28.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.586+0000 7f6a86400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a8015bcc0 0x7f6a8015a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:28.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.586+0000 7f6a86400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8015f940 con 0x7f6a800cba70 2024-09-11T00:24:28.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.586+0000 7f6a86400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8015f7c0 con 0x7f6a8006f920 2024-09-11T00:24:28.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.586+0000 7f6a86400640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6a800ca910 con 0x7f6a8015bcc0 2024-09-11T00:24:28.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.586+0000 7f6a76a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a800cba70 0x7f6a800c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:28.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.586+0000 7f6a7f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a8006f920 0x7f6a801f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:28.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.586+0000 7f6a7fe00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a8015bcc0 0x7f6a8015a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:28.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.586+0000 7f6a7f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a8006f920 0x7f6a801f50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.40:47068/0 (socket says 172.21.15.40:47068) 2024-09-11T00:24:28.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.586+0000 7f6a7f400640 1 -- 172.21.15.40:0/355822671 learned_addr learned my addr 172.21.15.40:0/355822671 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:28.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.587+0000 7f6a7f400640 1 -- 172.21.15.40:0/355822671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a8015bcc0 msgr2=0x7f6a8015a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:28.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.587+0000 7f6a7f400640 1 --2- 172.21.15.40:0/355822671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a8015bcc0 0x7f6a8015a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:28.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.587+0000 7f6a7f400640 1 -- 172.21.15.40:0/355822671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a800cba70 msgr2=0x7f6a800c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:28.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.587+0000 7f6a7f400640 1 --2- 172.21.15.40:0/355822671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a800cba70 0x7f6a800c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:28.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.587+0000 7f6a7f400640 1 -- 172.21.15.40:0/355822671 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a800c9720 con 0x7f6a8006f920 2024-09-11T00:24:28.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.587+0000 7f6a76a00640 1 --2- 172.21.15.40:0/355822671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a800cba70 0x7f6a800c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:24:28.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.587+0000 7f6a7f400640 1 --2- 172.21.15.40:0/355822671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a8006f920 0x7f6a801f50e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6a70034040 tx=0x7f6a7002ae70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:28.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.587+0000 7f6a77e00640 1 -- 172.21.15.40:0/355822671 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7003e030 con 0x7f6a8006f920 2024-09-11T00:24:28.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.587+0000 7f6a77e00640 1 -- 172.21.15.40:0/355822671 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a70004b20 con 0x7f6a8006f920 2024-09-11T00:24:28.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.587+0000 7f6a77e00640 1 -- 172.21.15.40:0/355822671 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a70035040 con 0x7f6a8006f920 2024-09-11T00:24:28.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.587+0000 7f6a86400640 1 -- 172.21.15.40:0/355822671 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a800c9a00 con 0x7f6a8006f920 2024-09-11T00:24:28.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.587+0000 7f6a86400640 1 -- 172.21.15.40:0/355822671 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a800c8ed0 con 0x7f6a8006f920 2024-09-11T00:24:28.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.588+0000 7f6a86400640 1 -- 172.21.15.40:0/355822671 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a800c9bd0 con 0x7f6a8006f920 2024-09-11T00:24:28.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.590+0000 7f6a77e00640 1 -- 172.21.15.40:0/355822671 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6a70004f10 con 0x7f6a8006f920 2024-09-11T00:24:28.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.591+0000 7f6a77e00640 1 --2- 172.21.15.40:0/355822671 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6a5c077f70 0x7f6a5c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:28.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.591+0000 7f6a77e00640 1 -- 172.21.15.40:0/355822671 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f6a700ba570 con 0x7f6a8006f920 2024-09-11T00:24:28.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.591+0000 7f6a76a00640 1 --2- 172.21.15.40:0/355822671 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6a5c077f70 0x7f6a5c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:28.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.592+0000 7f6a76a00640 1 --2- 172.21.15.40:0/355822671 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6a5c077f70 0x7f6a5c07a430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6a800ae3f0 tx=0x7f6a68009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:28.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.595+0000 7f6a77e00640 1 -- 172.21.15.40:0/355822671 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6a800c9bd0 con 0x7f6a8006f920 2024-09-11T00:24:28.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.825+0000 7f6a86400640 1 -- 172.21.15.40:0/355822671 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a8015c240 con 0x7f6a8006f920 2024-09-11T00:24:28.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.826+0000 7f6a77e00640 1 -- 172.21.15.40:0/355822671 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7f6a70082900 con 0x7f6a8006f920 2024-09-11T00:24:28.829 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:28.832 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"btime":"2024-09-11T00:23:51:938503+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3825015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3825015784},{"type":"v1","addr":"172.21.15.175:6836","nonce":3825015784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4334,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1127011821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1127011821},{"type":"v1","addr":"172.21.15.175:6837","nonce":1127011821}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2724658296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2724658296},{"type":"v1","addr":"172.21.15.40:6833","nonce":2724658296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:23:48.351685+0000","modified":"2024-09-11T00:23:51.368958+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4356":{"gid":4356,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3237981730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3237981730},{"type":"v1","addr":"172.21.15.40:6835","nonce":3237981730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4356,"qdb_cluster":[4356]},"id":1}]} 2024-09-11T00:24:28.833 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-11T00:24:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.829+0000 7f6a86400640 1 -- 172.21.15.40:0/355822671 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6a5c077f70 msgr2=0x7f6a5c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.829+0000 7f6a86400640 1 --2- 172.21.15.40:0/355822671 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6a5c077f70 0x7f6a5c07a430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6a800ae3f0 tx=0x7f6a68009040 comp rx=0 tx=0).stop 2024-09-11T00:24:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.829+0000 7f6a86400640 1 -- 172.21.15.40:0/355822671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a8006f920 msgr2=0x7f6a801f50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.829+0000 7f6a86400640 1 --2- 172.21.15.40:0/355822671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a8006f920 0x7f6a801f50e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6a70034040 tx=0x7f6a7002ae70 comp rx=0 tx=0).stop 2024-09-11T00:24:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.829+0000 7f6a86400640 1 -- 172.21.15.40:0/355822671 shutdown_connections 2024-09-11T00:24:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.829+0000 7f6a86400640 1 --2- 172.21.15.40:0/355822671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a8015bcc0 0x7f6a8015a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.829+0000 7f6a86400640 1 --2- 172.21.15.40:0/355822671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a800cba70 0x7f6a800c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.829+0000 7f6a86400640 1 --2- 172.21.15.40:0/355822671 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6a5c077f70 0x7f6a5c07a430 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.829+0000 7f6a86400640 1 --2- 172.21.15.40:0/355822671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a8006f920 0x7f6a801f50e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.829+0000 7f6a86400640 1 -- 172.21.15.40:0/355822671 >> 172.21.15.40:0/355822671 conn(0x7f6a800cfbb0 msgr2=0x7f6a800b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.829+0000 7f6a86400640 1 -- 172.21.15.40:0/355822671 shutdown_connections 2024-09-11T00:24:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:28.829+0000 7f6a86400640 1 -- 172.21.15.40:0/355822671 wait complete. 2024-09-11T00:24:28.847 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:24:29.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.009+0000 7ff8e7600640 1 -- 172.21.15.40:0/754352827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e00cba70 msgr2=0x7ff8e00cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.009+0000 7ff8e7600640 1 --2- 172.21.15.40:0/754352827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e00cba70 0x7ff8e00cbe90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8005fd0 tx=0x7ff8c802a5d0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.009+0000 7ff8e7600640 1 -- 172.21.15.40:0/754352827 shutdown_connections 2024-09-11T00:24:29.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.009+0000 7ff8e7600640 1 --2- 172.21.15.40:0/754352827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e00cba70 0x7ff8e00cbe90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.009+0000 7ff8e7600640 1 --2- 172.21.15.40:0/754352827 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8e015bcc0 0x7ff8e00cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.009+0000 7ff8e7600640 1 -- 172.21.15.40:0/754352827 >> 172.21.15.40:0/754352827 conn(0x7ff8e00cfbb0 msgr2=0x7ff8e00cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:29.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.009+0000 7ff8e7600640 1 -- 172.21.15.40:0/754352827 shutdown_connections 2024-09-11T00:24:29.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.009+0000 7ff8e7600640 1 -- 172.21.15.40:0/754352827 wait complete. 2024-09-11T00:24:29.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.011+0000 7ff8e7600640 1 Processor -- start 2024-09-11T00:24:29.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.011+0000 7ff8e7600640 1 -- start start 2024-09-11T00:24:29.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.012+0000 7ff8e7600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8e00ca200 0x7ff8e014c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.012+0000 7ff8e7600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8e00cba70 0x7ff8e00ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.012+0000 7ff8e7600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e015bcc0 0x7ff8e00cede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.012+0000 7ff8e7600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e015f940 con 0x7ff8e015bcc0 2024-09-11T00:24:29.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.012+0000 7ff8e7600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e015f7c0 con 0x7ff8e00cba70 2024-09-11T00:24:29.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.012+0000 7ff8e7600640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e00cadc0 con 0x7ff8e00ca200 2024-09-11T00:24:29.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.012+0000 7ff8e5600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e015bcc0 0x7ff8e00cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.012+0000 7ff8e4c00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8e00ca200 0x7ff8e014c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.012+0000 7ff8e5600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e015bcc0 0x7ff8e00cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47786/0 (socket says 172.21.15.40:47786) 2024-09-11T00:24:29.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.012+0000 7ff8e5600640 1 -- 172.21.15.40:0/201050140 learned_addr learned my addr 172.21.15.40:0/201050140 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:29.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.012+0000 7ff8d7e00640 1 --2- 172.21.15.40:0/201050140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8e00cba70 0x7ff8e00ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.012+0000 7ff8e5600640 1 -- 172.21.15.40:0/201050140 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8e00ca200 msgr2=0x7ff8e014c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.012+0000 7ff8e5600640 1 --2- 172.21.15.40:0/201050140 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8e00ca200 0x7ff8e014c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.012+0000 7ff8e5600640 1 -- 172.21.15.40:0/201050140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8e00cba70 msgr2=0x7ff8e00ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.012+0000 7ff8e5600640 1 --2- 172.21.15.40:0/201050140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8e00cba70 0x7ff8e00ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.012+0000 7ff8e5600640 1 -- 172.21.15.40:0/201050140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e015ef50 con 0x7ff8e015bcc0 2024-09-11T00:24:29.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.013+0000 7ff8e5600640 1 --2- 172.21.15.40:0/201050140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e015bcc0 0x7ff8e00cede0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800c6b0 tx=0x7ff8d800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:29.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.013+0000 7ff8dd600640 1 -- 172.21.15.40:0/201050140 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8003b70 con 0x7ff8e015bcc0 2024-09-11T00:24:29.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.013+0000 7ff8dd600640 1 -- 172.21.15.40:0/201050140 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8d8003d30 con 0x7ff8e015bcc0 2024-09-11T00:24:29.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.013+0000 7ff8dd600640 1 -- 172.21.15.40:0/201050140 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8005330 con 0x7ff8e015bcc0 2024-09-11T00:24:29.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.013+0000 7ff8e7600640 1 -- 172.21.15.40:0/201050140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e014cee0 con 0x7ff8e015bcc0 2024-09-11T00:24:29.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.013+0000 7ff8e7600640 1 -- 172.21.15.40:0/201050140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e014f720 con 0x7ff8e015bcc0 2024-09-11T00:24:29.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.014+0000 7ff8e7600640 1 -- 172.21.15.40:0/201050140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e006fa00 con 0x7ff8e015bcc0 2024-09-11T00:24:29.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.015+0000 7ff8dd600640 1 -- 172.21.15.40:0/201050140 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff8d80054d0 con 0x7ff8e015bcc0 2024-09-11T00:24:29.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.016+0000 7ff8dd600640 1 --2- 172.21.15.40:0/201050140 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff8bc077f70 0x7ff8bc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.016+0000 7ff8dd600640 1 -- 172.21.15.40:0/201050140 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7ff8d8099b40 con 0x7ff8e015bcc0 2024-09-11T00:24:29.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.017+0000 7ff8e4c00640 1 --2- 172.21.15.40:0/201050140 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff8bc077f70 0x7ff8bc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.017+0000 7ff8e4c00640 1 --2- 172.21.15.40:0/201050140 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff8bc077f70 0x7ff8bc07a430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000bbe0 tx=0x7ff8d000b390 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:29.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.020+0000 7ff8dd600640 1 -- 172.21.15.40:0/201050140 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff8e015ef50 con 0x7ff8e015bcc0 2024-09-11T00:24:29.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.255+0000 7ff8e7600640 1 -- 172.21.15.40:0/201050140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8e00b4f60 con 0x7ff8e015bcc0 2024-09-11T00:24:29.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.256+0000 7ff8dd600640 1 -- 172.21.15.40:0/201050140 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7ff8d80057f0 con 0x7ff8e015bcc0 2024-09-11T00:24:29.259 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:29.259 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"btime":"2024-09-11T00:23:51:938503+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3825015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3825015784},{"type":"v1","addr":"172.21.15.175:6836","nonce":3825015784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4334,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1127011821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1127011821},{"type":"v1","addr":"172.21.15.175:6837","nonce":1127011821}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2724658296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2724658296},{"type":"v1","addr":"172.21.15.40:6833","nonce":2724658296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:23:48.351685+0000","modified":"2024-09-11T00:23:51.368958+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4356":{"gid":4356,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3237981730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3237981730},{"type":"v1","addr":"172.21.15.40:6835","nonce":3237981730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4356,"qdb_cluster":[4356]},"id":1}]} 2024-09-11T00:24:29.259 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-11T00:24:29.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.258+0000 7ff8e7600640 1 -- 172.21.15.40:0/201050140 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff8bc077f70 msgr2=0x7ff8bc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.258+0000 7ff8e7600640 1 --2- 172.21.15.40:0/201050140 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff8bc077f70 0x7ff8bc07a430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000bbe0 tx=0x7ff8d000b390 comp rx=0 tx=0).stop 2024-09-11T00:24:29.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.258+0000 7ff8e7600640 1 -- 172.21.15.40:0/201050140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e015bcc0 msgr2=0x7ff8e00cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.258+0000 7ff8e7600640 1 --2- 172.21.15.40:0/201050140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e015bcc0 0x7ff8e00cede0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800c6b0 tx=0x7ff8d800cb70 comp rx=0 tx=0).stop 2024-09-11T00:24:29.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.259+0000 7ff8e7600640 1 -- 172.21.15.40:0/201050140 shutdown_connections 2024-09-11T00:24:29.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.259+0000 7ff8e7600640 1 --2- 172.21.15.40:0/201050140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e015bcc0 0x7ff8e00cede0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.259+0000 7ff8e7600640 1 --2- 172.21.15.40:0/201050140 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff8bc077f70 0x7ff8bc07a430 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.259+0000 7ff8e7600640 1 --2- 172.21.15.40:0/201050140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8e00cba70 0x7ff8e00ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.259+0000 7ff8e7600640 1 --2- 172.21.15.40:0/201050140 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8e00ca200 0x7ff8e014c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.259+0000 7ff8e7600640 1 -- 172.21.15.40:0/201050140 >> 172.21.15.40:0/201050140 conn(0x7ff8e00cfbb0 msgr2=0x7ff8e00ca690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:29.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.259+0000 7ff8e7600640 1 -- 172.21.15.40:0/201050140 shutdown_connections 2024-09-11T00:24:29.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.259+0000 7ff8e7600640 1 -- 172.21.15.40:0/201050140 wait complete. 2024-09-11T00:24:29.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:24:29.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.436+0000 7ff5b9c00640 1 -- 172.21.15.40:0/2033777715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b40d09e0 msgr2=0x7ff5b406cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.436+0000 7ff5b9c00640 1 --2- 172.21.15.40:0/2033777715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b40d09e0 0x7ff5b406cfc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac005fd0 tx=0x7ff5ac02a820 comp rx=0 tx=0).stop 2024-09-11T00:24:29.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.436+0000 7ff5b9c00640 1 -- 172.21.15.40:0/2033777715 shutdown_connections 2024-09-11T00:24:29.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.436+0000 7ff5b9c00640 1 --2- 172.21.15.40:0/2033777715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b40d09e0 0x7ff5b406cfc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.436+0000 7ff5b9c00640 1 --2- 172.21.15.40:0/2033777715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b415dd10 0x7ff5b40d4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.436+0000 7ff5b9c00640 1 -- 172.21.15.40:0/2033777715 >> 172.21.15.40:0/2033777715 conn(0x7ff5b40d3c20 msgr2=0x7ff5b40d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.436+0000 7ff5b9c00640 1 -- 172.21.15.40:0/2033777715 shutdown_connections 2024-09-11T00:24:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.437+0000 7ff5b9c00640 1 -- 172.21.15.40:0/2033777715 wait complete. 2024-09-11T00:24:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.438+0000 7ff5b9c00640 1 Processor -- start 2024-09-11T00:24:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.438+0000 7ff5b9c00640 1 -- start start 2024-09-11T00:24:29.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.439+0000 7ff5b9c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b40b2d20 0x7ff5b41eb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.439+0000 7ff5b9c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b40d09e0 0x7ff5b40cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.439+0000 7ff5b9c00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b415dd10 0x7ff5b40cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.439+0000 7ff5b9c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b406d890 con 0x7ff5b40d09e0 2024-09-11T00:24:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.439+0000 7ff5b9c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b406d710 con 0x7ff5b40b2d20 2024-09-11T00:24:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.439+0000 7ff5b9c00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b406da10 con 0x7ff5b415dd10 2024-09-11T00:24:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.440+0000 7ff5b3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b40d09e0 0x7ff5b40cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.440+0000 7ff5b3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b40d09e0 0x7ff5b40cc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47790/0 (socket says 172.21.15.40:47790) 2024-09-11T00:24:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.440+0000 7ff5b3400640 1 -- 172.21.15.40:0/2848457114 learned_addr learned my addr 172.21.15.40:0/2848457114 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.440+0000 7ff5b3e00640 1 --2- 172.21.15.40:0/2848457114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b40b2d20 0x7ff5b41eb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.440+0000 7ff5b9200640 1 --2- 172.21.15.40:0/2848457114 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b415dd10 0x7ff5b40cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.440+0000 7ff5b3400640 1 -- 172.21.15.40:0/2848457114 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b415dd10 msgr2=0x7ff5b40cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.440+0000 7ff5b3400640 1 --2- 172.21.15.40:0/2848457114 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b415dd10 0x7ff5b40cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.440+0000 7ff5b3400640 1 -- 172.21.15.40:0/2848457114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b40b2d20 msgr2=0x7ff5b41eb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.440+0000 7ff5b3400640 1 --2- 172.21.15.40:0/2848457114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b40b2d20 0x7ff5b41eb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.440+0000 7ff5b3400640 1 -- 172.21.15.40:0/2848457114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b41eba10 con 0x7ff5b40d09e0 2024-09-11T00:24:29.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.440+0000 7ff5b3400640 1 --2- 172.21.15.40:0/2848457114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b40d09e0 0x7ff5b40cc200 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000c4d0 tx=0x7ff5a000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:29.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.441+0000 7ff5abe00640 1 -- 172.21.15.40:0/2848457114 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0016020 con 0x7ff5b40d09e0 2024-09-11T00:24:29.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.441+0000 7ff5abe00640 1 -- 172.21.15.40:0/2848457114 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5a0012920 con 0x7ff5b40d09e0 2024-09-11T00:24:29.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.441+0000 7ff5abe00640 1 -- 172.21.15.40:0/2848457114 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0012d70 con 0x7ff5b40d09e0 2024-09-11T00:24:29.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.441+0000 7ff5b9c00640 1 -- 172.21.15.40:0/2848457114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b40cb160 con 0x7ff5b40d09e0 2024-09-11T00:24:29.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.441+0000 7ff5b9c00640 1 -- 172.21.15.40:0/2848457114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b40cb720 con 0x7ff5b40d09e0 2024-09-11T00:24:29.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.442+0000 7ff5b9c00640 1 -- 172.21.15.40:0/2848457114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b406cfc0 con 0x7ff5b40d09e0 2024-09-11T00:24:29.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.443+0000 7ff5abe00640 1 -- 172.21.15.40:0/2848457114 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff5a001b400 con 0x7ff5b40d09e0 2024-09-11T00:24:29.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.444+0000 7ff5abe00640 1 --2- 172.21.15.40:0/2848457114 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff594077f70 0x7ff59407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.444+0000 7ff5abe00640 1 -- 172.21.15.40:0/2848457114 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7ff5a0099ce0 con 0x7ff5b40d09e0 2024-09-11T00:24:29.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.445+0000 7ff5b3e00640 1 --2- 172.21.15.40:0/2848457114 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff594077f70 0x7ff59407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.445+0000 7ff5b3e00640 1 --2- 172.21.15.40:0/2848457114 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff594077f70 0x7ff59407a430 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40095f0 tx=0x7ff5a4005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:29.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.448+0000 7ff5abe00640 1 -- 172.21.15.40:0/2848457114 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff5a0020030 con 0x7ff5b40d09e0 2024-09-11T00:24:29.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.642+0000 7ff5b9c00640 1 -- 172.21.15.40:0/2848457114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5b415c8b0 con 0x7ff5b40d09e0 2024-09-11T00:24:29.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.643+0000 7ff5abe00640 1 -- 172.21.15.40:0/2848457114 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16891 (secure 0 0 0) 0x7ff5b41eba10 con 0x7ff5b40d09e0 2024-09-11T00:24:29.649 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:29.649 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":24,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","created":"2024-09-11T00:23:22.512139+0000","modified":"2024-09-11T00:24:29.076647+0000","last_up_change":"2024-09-11T00:23:36.842446+0000","last_in_change":"2024-09-11T00:23:26.734953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:23:37.800502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:23:46.379819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:23:47.307802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee10e123-8817-4d94-a340-73d00121af37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6801","nonce":973366008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6803","nonce":973366008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6807","nonce":973366008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6805","nonce":973366008}]},"public_addr":"172.21.15.40:6801/973366008","cluster_addr":"172.21.15.40:6803/973366008","heartbeat_back_addr":"172.21.15.40:6807/973366008","heartbeat_front_addr":"172.21.15.40:6805/973366008","state":["exists","up"]},{"osd":1,"uuid":"f90895e9-8660-42b9-8aba-3f9d4d130b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6823","nonce":2542266029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6827","nonce":2542266029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6831","nonce":2542266029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6829","nonce":2542266029}]},"public_addr":"172.21.15.40:6823/2542266029","cluster_addr":"172.21.15.40:6827/2542266029","heartbeat_back_addr":"172.21.15.40:6831/2542266029","heartbeat_front_addr":"172.21.15.40:6829/2542266029","state":["exists","up"]},{"osd":2,"uuid":"a190497a-2aba-4748-8f1d-7e372259d65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6815","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6817","nonce":559505356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6819","nonce":559505356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6826","nonce":559505356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6822","nonce":559505356}]},"public_addr":"172.21.15.40:6817/559505356","cluster_addr":"172.21.15.40:6819/559505356","heartbeat_back_addr":"172.21.15.40:6826/559505356","heartbeat_front_addr":"172.21.15.40:6822/559505356","state":["exists","up"]},{"osd":3,"uuid":"8be32ced-898a-46f2-b850-1517667766b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6809","nonce":503633839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6811","nonce":503633839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6816","nonce":503633839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6813","nonce":503633839}]},"public_addr":"172.21.15.40:6809/503633839","cluster_addr":"172.21.15.40:6811/503633839","heartbeat_back_addr":"172.21.15.40:6816/503633839","heartbeat_front_addr":"172.21.15.40:6813/503633839","state":["exists","up"]},{"osd":4,"uuid":"9867fdfc-6f93-466e-b768-b5a1da7157de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6811","nonce":2418348042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6813","nonce":2418348042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6817","nonce":2418348042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6815","nonce":2418348042}]},"public_addr":"172.21.15.175:6811/2418348042","cluster_addr":"172.21.15.175:6813/2418348042","heartbeat_back_addr":"172.21.15.175:6817/2418348042","heartbeat_front_addr":"172.21.15.175:6815/2418348042","state":["exists","up"]},{"osd":5,"uuid":"e2f6f616-b5db-466e-942f-e2762171a8ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6827","nonce":520822300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6829","nonce":520822300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6833","nonce":520822300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6831","nonce":520822300}]},"public_addr":"172.21.15.175:6827/520822300","cluster_addr":"172.21.15.175:6829/520822300","heartbeat_back_addr":"172.21.15.175:6833/520822300","heartbeat_front_addr":"172.21.15.175:6831/520822300","state":["exists","up"]},{"osd":6,"uuid":"807ac045-bf63-4ff6-9a06-7f7022f9ef32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6819","nonce":1431736593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6821","nonce":1431736593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6825","nonce":1431736593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6823","nonce":1431736593}]},"public_addr":"172.21.15.175:6819/1431736593","cluster_addr":"172.21.15.175:6821/1431736593","heartbeat_back_addr":"172.21.15.175:6825/1431736593","heartbeat_front_addr":"172.21.15.175:6823/1431736593","state":["exists","up"]},{"osd":7,"uuid":"8e0b3293-390f-4b43-b29d-babdc5e88f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6803","nonce":3300317000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6805","nonce":3300317000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6809","nonce":3300317000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6807","nonce":3300317000}]},"public_addr":"172.21.15.175:6803/3300317000","cluster_addr":"172.21.15.175:6805/3300317000","heartbeat_back_addr":"172.21.15.175:6809/3300317000","heartbeat_front_addr":"172.21.15.175:6807/3300317000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:32.967062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.266558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.063509+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.616332+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.431077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.866822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.645225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.016210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:24:29.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.646+0000 7ff5b9c00640 1 -- 172.21.15.40:0/2848457114 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff594077f70 msgr2=0x7ff59407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.646+0000 7ff5b9c00640 1 --2- 172.21.15.40:0/2848457114 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff594077f70 0x7ff59407a430 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40095f0 tx=0x7ff5a4005f90 comp rx=0 tx=0).stop 2024-09-11T00:24:29.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.646+0000 7ff5b9c00640 1 -- 172.21.15.40:0/2848457114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b40d09e0 msgr2=0x7ff5b40cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.646+0000 7ff5b9c00640 1 --2- 172.21.15.40:0/2848457114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b40d09e0 0x7ff5b40cc200 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000c4d0 tx=0x7ff5a000c990 comp rx=0 tx=0).stop 2024-09-11T00:24:29.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.646+0000 7ff5b9c00640 1 -- 172.21.15.40:0/2848457114 shutdown_connections 2024-09-11T00:24:29.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.646+0000 7ff5b9c00640 1 --2- 172.21.15.40:0/2848457114 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b415dd10 0x7ff5b40cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.646+0000 7ff5b9c00640 1 --2- 172.21.15.40:0/2848457114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b40d09e0 0x7ff5b40cc200 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.646+0000 7ff5b9c00640 1 --2- 172.21.15.40:0/2848457114 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff594077f70 0x7ff59407a430 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.646+0000 7ff5b9c00640 1 --2- 172.21.15.40:0/2848457114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b40b2d20 0x7ff5b41eb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.646+0000 7ff5b9c00640 1 -- 172.21.15.40:0/2848457114 >> 172.21.15.40:0/2848457114 conn(0x7ff5b40d3c20 msgr2=0x7ff5b40b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:29.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.646+0000 7ff5b9c00640 1 -- 172.21.15.40:0/2848457114 shutdown_connections 2024-09-11T00:24:29.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.646+0000 7ff5b9c00640 1 -- 172.21.15.40:0/2848457114 wait complete. 2024-09-11T00:24:29.665 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T00:24:29.666 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:24:29.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.824+0000 7fef95800640 1 -- 172.21.15.40:0/3738219448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef900d09e0 msgr2=0x7fef900d4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.824+0000 7fef95800640 1 --2- 172.21.15.40:0/3738219448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef900d09e0 0x7fef900d4740 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fef900766c0 tx=0x7fef7802a490 comp rx=0 tx=0).stop 2024-09-11T00:24:29.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.825+0000 7fef95800640 1 -- 172.21.15.40:0/3738219448 shutdown_connections 2024-09-11T00:24:29.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.825+0000 7fef95800640 1 --2- 172.21.15.40:0/3738219448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef900b2d20 0x7fef9006cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.825+0000 7fef95800640 1 --2- 172.21.15.40:0/3738219448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef900d09e0 0x7fef900d4740 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.825+0000 7fef95800640 1 -- 172.21.15.40:0/3738219448 >> 172.21.15.40:0/3738219448 conn(0x7fef900d3c20 msgr2=0x7fef900d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:29.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.825+0000 7fef95800640 1 -- 172.21.15.40:0/3738219448 shutdown_connections 2024-09-11T00:24:29.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.825+0000 7fef95800640 1 -- 172.21.15.40:0/3738219448 wait complete. 2024-09-11T00:24:29.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.826+0000 7fef95800640 1 Processor -- start 2024-09-11T00:24:29.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.826+0000 7fef95800640 1 -- start start 2024-09-11T00:24:29.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.827+0000 7fef95800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef900b2d20 0x7fef900c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.827+0000 7fef95800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef900d09e0 0x7fef900ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.827+0000 7fef95800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef9015dd10 0x7fef9014ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.827+0000 7fef95800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fef9006d890 con 0x7fef900b2d20 2024-09-11T00:24:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.827+0000 7fef95800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fef9006d710 con 0x7fef900d09e0 2024-09-11T00:24:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.827+0000 7fef95800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fef9006da10 con 0x7fef9015dd10 2024-09-11T00:24:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.828+0000 7fef8fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef900b2d20 0x7fef900c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.828+0000 7fef8fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef900b2d20 0x7fef900c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47818/0 (socket says 172.21.15.40:47818) 2024-09-11T00:24:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.828+0000 7fef8fe00640 1 -- 172.21.15.40:0/2378766414 learned_addr learned my addr 172.21.15.40:0/2378766414 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.828+0000 7fef94e00640 1 --2- 172.21.15.40:0/2378766414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef9015dd10 0x7fef9014ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.828+0000 7fef8f400640 1 --2- 172.21.15.40:0/2378766414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef900d09e0 0x7fef900ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.828+0000 7fef8fe00640 1 -- 172.21.15.40:0/2378766414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef9015dd10 msgr2=0x7fef9014ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.828+0000 7fef8fe00640 1 --2- 172.21.15.40:0/2378766414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef9015dd10 0x7fef9014ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.828+0000 7fef8fe00640 1 -- 172.21.15.40:0/2378766414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef900d09e0 msgr2=0x7fef900ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.828+0000 7fef8fe00640 1 --2- 172.21.15.40:0/2378766414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef900d09e0 0x7fef900ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.828+0000 7fef8fe00640 1 -- 172.21.15.40:0/2378766414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef900b61e0 con 0x7fef900b2d20 2024-09-11T00:24:29.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.828+0000 7fef8fe00640 1 --2- 172.21.15.40:0/2378766414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef900b2d20 0x7fef900c9c20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fef8000ba50 tx=0x7fef8000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:29.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.829+0000 7fef87e00640 1 -- 172.21.15.40:0/2378766414 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80019070 con 0x7fef900b2d20 2024-09-11T00:24:29.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.829+0000 7fef87e00640 1 -- 172.21.15.40:0/2378766414 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef8000cd00 con 0x7fef900b2d20 2024-09-11T00:24:29.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.829+0000 7fef87e00640 1 -- 172.21.15.40:0/2378766414 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef800146a0 con 0x7fef900b2d20 2024-09-11T00:24:29.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.829+0000 7fef95800640 1 -- 172.21.15.40:0/2378766414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef900cd2a0 con 0x7fef900b2d20 2024-09-11T00:24:29.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.829+0000 7fef95800640 1 -- 172.21.15.40:0/2378766414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef900cd860 con 0x7fef900b2d20 2024-09-11T00:24:29.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.830+0000 7fef95800640 1 -- 172.21.15.40:0/2378766414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef900cd0b0 con 0x7fef900b2d20 2024-09-11T00:24:29.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.831+0000 7fef87e00640 1 -- 172.21.15.40:0/2378766414 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fef8001d3b0 con 0x7fef900b2d20 2024-09-11T00:24:29.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.832+0000 7fef87e00640 1 --2- 172.21.15.40:0/2378766414 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fef6c077f70 0x7fef6c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.832+0000 7fef87e00640 1 -- 172.21.15.40:0/2378766414 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fef80099ee0 con 0x7fef900b2d20 2024-09-11T00:24:29.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.832+0000 7fef8f400640 1 --2- 172.21.15.40:0/2378766414 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fef6c077f70 0x7fef6c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.833+0000 7fef8f400640 1 --2- 172.21.15.40:0/2378766414 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fef6c077f70 0x7fef6c07a430 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fef78033000 tx=0x7fef78004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:29.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:29.836+0000 7fef87e00640 1 -- 172.21.15.40:0/2378766414 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fef80062270 con 0x7fef900b2d20 2024-09-11T00:24:30.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.066+0000 7fef95800640 1 -- 172.21.15.40:0/2378766414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef900cafc0 con 0x7fef900b2d20 2024-09-11T00:24:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.067+0000 7fef87e00640 1 -- 172.21.15.40:0/2378766414 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7fef80066ca0 con 0x7fef900b2d20 2024-09-11T00:24:30.069 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:30.069 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"btime":"2024-09-11T00:23:51:938503+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3825015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3825015784},{"type":"v1","addr":"172.21.15.175:6836","nonce":3825015784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4334,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1127011821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1127011821},{"type":"v1","addr":"172.21.15.175:6837","nonce":1127011821}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2724658296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2724658296},{"type":"v1","addr":"172.21.15.40:6833","nonce":2724658296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:23:48.351685+0000","modified":"2024-09-11T00:23:51.368958+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4356":{"gid":4356,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3237981730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3237981730},{"type":"v1","addr":"172.21.15.40:6835","nonce":3237981730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4356,"qdb_cluster":[4356]},"id":1}]} 2024-09-11T00:24:30.070 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-11T00:24:30.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.069+0000 7fef95800640 1 -- 172.21.15.40:0/2378766414 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fef6c077f70 msgr2=0x7fef6c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:30.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.069+0000 7fef95800640 1 --2- 172.21.15.40:0/2378766414 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fef6c077f70 0x7fef6c07a430 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fef78033000 tx=0x7fef78004730 comp rx=0 tx=0).stop 2024-09-11T00:24:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.069+0000 7fef95800640 1 -- 172.21.15.40:0/2378766414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef900b2d20 msgr2=0x7fef900c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.069+0000 7fef95800640 1 --2- 172.21.15.40:0/2378766414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef900b2d20 0x7fef900c9c20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fef8000ba50 tx=0x7fef8000bf10 comp rx=0 tx=0).stop 2024-09-11T00:24:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.069+0000 7fef95800640 1 -- 172.21.15.40:0/2378766414 shutdown_connections 2024-09-11T00:24:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.069+0000 7fef95800640 1 --2- 172.21.15.40:0/2378766414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef9015dd10 0x7fef9014ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.069+0000 7fef95800640 1 --2- 172.21.15.40:0/2378766414 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fef6c077f70 0x7fef6c07a430 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.069+0000 7fef95800640 1 --2- 172.21.15.40:0/2378766414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef900d09e0 0x7fef900ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.069+0000 7fef95800640 1 --2- 172.21.15.40:0/2378766414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef900b2d20 0x7fef900c9c20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.069+0000 7fef95800640 1 -- 172.21.15.40:0/2378766414 >> 172.21.15.40:0/2378766414 conn(0x7fef900d3c20 msgr2=0x7fef90157dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.069+0000 7fef95800640 1 -- 172.21.15.40:0/2378766414 shutdown_connections 2024-09-11T00:24:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.069+0000 7fef95800640 1 -- 172.21.15.40:0/2378766414 wait complete. 2024-09-11T00:24:30.087 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:24:30.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.244+0000 7f7f2fe00640 1 -- 172.21.15.40:0/2999664319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f300b2d20 msgr2=0x7f7f300d02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:30.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.244+0000 7f7f2fe00640 1 --2- 172.21.15.40:0/2999664319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f300b2d20 0x7f7f300d02d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7f300d2020 tx=0x7f7f1c02a540 comp rx=0 tx=0).stop 2024-09-11T00:24:30.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.245+0000 7f7f2fe00640 1 -- 172.21.15.40:0/2999664319 shutdown_connections 2024-09-11T00:24:30.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.245+0000 7f7f2fe00640 1 --2- 172.21.15.40:0/2999664319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f300b2d20 0x7f7f300d02d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.245+0000 7f7f2fe00640 1 --2- 172.21.15.40:0/2999664319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f3015dd10 0x7f7f300d4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.245+0000 7f7f2fe00640 1 -- 172.21.15.40:0/2999664319 >> 172.21.15.40:0/2999664319 conn(0x7f7f300d3c20 msgr2=0x7f7f300d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:30.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.245+0000 7f7f2fe00640 1 -- 172.21.15.40:0/2999664319 shutdown_connections 2024-09-11T00:24:30.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.245+0000 7f7f2fe00640 1 -- 172.21.15.40:0/2999664319 wait complete. 2024-09-11T00:24:30.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.246+0000 7f7f2fe00640 1 Processor -- start 2024-09-11T00:24:30.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.246+0000 7f7f2fe00640 1 -- start start 2024-09-11T00:24:30.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.247+0000 7f7f2fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f300b2d20 0x7f7f300cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:30.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.247+0000 7f7f2fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f300d0810 0x7f7f301f48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:30.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.247+0000 7f7f2fe00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f3015dd10 0x7f7f300b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:30.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.247+0000 7f7f2fe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7f300cee40 con 0x7f7f300d0810 2024-09-11T00:24:30.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.247+0000 7f7f2fe00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3006e1e0 con 0x7f7f300b2d20 2024-09-11T00:24:30.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.247+0000 7f7f2fe00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7f300cefc0 con 0x7f7f3015dd10 2024-09-11T00:24:30.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.248+0000 7f7f2e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f300d0810 0x7f7f301f48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:30.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.248+0000 7f7f2e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f300d0810 0x7f7f301f48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47834/0 (socket says 172.21.15.40:47834) 2024-09-11T00:24:30.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.248+0000 7f7f2e000640 1 -- 172.21.15.40:0/2555714610 learned_addr learned my addr 172.21.15.40:0/2555714610 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:30.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.248+0000 7f7f2ea00640 1 --2- 172.21.15.40:0/2555714610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f300b2d20 0x7f7f300cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:30.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.248+0000 7f7f2f400640 1 --2- 172.21.15.40:0/2555714610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f3015dd10 0x7f7f300b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:30.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.248+0000 7f7f2e000640 1 -- 172.21.15.40:0/2555714610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f3015dd10 msgr2=0x7f7f300b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:30.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.248+0000 7f7f2e000640 1 --2- 172.21.15.40:0/2555714610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f3015dd10 0x7f7f300b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.248+0000 7f7f2e000640 1 -- 172.21.15.40:0/2555714610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f300b2d20 msgr2=0x7f7f300cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:30.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.248+0000 7f7f2e000640 1 --2- 172.21.15.40:0/2555714610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f300b2d20 0x7f7f300cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.248+0000 7f7f2e000640 1 -- 172.21.15.40:0/2555714610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f301f5850 con 0x7f7f300d0810 2024-09-11T00:24:30.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.248+0000 7f7f2e000640 1 --2- 172.21.15.40:0/2555714610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f300d0810 0x7f7f301f48d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0099c0 tx=0x7f7f1c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:30.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.249+0000 7f7f27400640 1 -- 172.21.15.40:0/2555714610 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c03f070 con 0x7f7f300d0810 2024-09-11T00:24:30.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.249+0000 7f7f27400640 1 -- 172.21.15.40:0/2555714610 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f1c004890 con 0x7f7f300d0810 2024-09-11T00:24:30.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.249+0000 7f7f27400640 1 -- 172.21.15.40:0/2555714610 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c035030 con 0x7f7f300d0810 2024-09-11T00:24:30.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.249+0000 7f7f2fe00640 1 -- 172.21.15.40:0/2555714610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f301f5570 con 0x7f7f300d0810 2024-09-11T00:24:30.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.249+0000 7f7f2fe00640 1 -- 172.21.15.40:0/2555714610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f300c9790 con 0x7f7f300d0810 2024-09-11T00:24:30.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.250+0000 7f7f2fe00640 1 -- 172.21.15.40:0/2555714610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f300cf4e0 con 0x7f7f300d0810 2024-09-11T00:24:30.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.251+0000 7f7f27400640 1 -- 172.21.15.40:0/2555714610 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7f1c004ce0 con 0x7f7f300d0810 2024-09-11T00:24:30.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.252+0000 7f7f27400640 1 --2- 172.21.15.40:0/2555714610 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7f10077f70 0x7f7f1007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:30.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.253+0000 7f7f27400640 1 -- 172.21.15.40:0/2555714610 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f7f1c0baf60 con 0x7f7f300d0810 2024-09-11T00:24:30.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.253+0000 7f7f2ea00640 1 --2- 172.21.15.40:0/2555714610 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7f10077f70 0x7f7f1007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:30.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.254+0000 7f7f2ea00640 1 --2- 172.21.15.40:0/2555714610 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7f10077f70 0x7f7f1007a430 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7f20004630 tx=0x7f7f2000b2e0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.257+0000 7f7f27400640 1 -- 172.21.15.40:0/2555714610 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7f1c0832f0 con 0x7f7f300d0810 2024-09-11T00:24:30.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.484+0000 7f7f2fe00640 1 -- 172.21.15.40:0/2555714610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f3015c5e0 con 0x7f7f300d0810 2024-09-11T00:24:30.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.485+0000 7f7f27400640 1 -- 172.21.15.40:0/2555714610 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7f7f1c087d20 con 0x7f7f300d0810 2024-09-11T00:24:30.487 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:30.488 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"btime":"2024-09-11T00:23:51:938503+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/3825015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3825015784},{"type":"v1","addr":"172.21.15.175:6836","nonce":3825015784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4334,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1127011821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1127011821},{"type":"v1","addr":"172.21.15.175:6837","nonce":1127011821}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2724658296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2724658296},{"type":"v1","addr":"172.21.15.40:6833","nonce":2724658296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:23:48.351685+0000","modified":"2024-09-11T00:23:51.368958+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4356":{"gid":4356,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3237981730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3237981730},{"type":"v1","addr":"172.21.15.40:6835","nonce":3237981730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4356,"qdb_cluster":[4356]},"id":1}]} 2024-09-11T00:24:30.488 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-11T00:24:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.487+0000 7f7f2fe00640 1 -- 172.21.15.40:0/2555714610 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7f10077f70 msgr2=0x7f7f1007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.487+0000 7f7f2fe00640 1 --2- 172.21.15.40:0/2555714610 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7f10077f70 0x7f7f1007a430 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7f20004630 tx=0x7f7f2000b2e0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.487+0000 7f7f2fe00640 1 -- 172.21.15.40:0/2555714610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f300d0810 msgr2=0x7f7f301f48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.487+0000 7f7f2fe00640 1 --2- 172.21.15.40:0/2555714610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f300d0810 0x7f7f301f48d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0099c0 tx=0x7f7f1c0039e0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.487+0000 7f7f2fe00640 1 -- 172.21.15.40:0/2555714610 shutdown_connections 2024-09-11T00:24:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.487+0000 7f7f2fe00640 1 --2- 172.21.15.40:0/2555714610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f3015dd10 0x7f7f300b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.487+0000 7f7f2fe00640 1 --2- 172.21.15.40:0/2555714610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f300d0810 0x7f7f301f48d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.487+0000 7f7f2fe00640 1 --2- 172.21.15.40:0/2555714610 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7f10077f70 0x7f7f1007a430 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.487+0000 7f7f2fe00640 1 --2- 172.21.15.40:0/2555714610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f300b2d20 0x7f7f300cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.487+0000 7f7f2fe00640 1 -- 172.21.15.40:0/2555714610 >> 172.21.15.40:0/2555714610 conn(0x7f7f300d3c20 msgr2=0x7f7f300cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:30.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.487+0000 7f7f2fe00640 1 -- 172.21.15.40:0/2555714610 shutdown_connections 2024-09-11T00:24:30.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.487+0000 7f7f2fe00640 1 -- 172.21.15.40:0/2555714610 wait complete. 2024-09-11T00:24:30.506 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:24:30.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.663+0000 7f2b9f200640 1 -- 172.21.15.40:0/4278218602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b9815bcc0 msgr2=0x7f2b980cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:30.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.663+0000 7f2b9f200640 1 --2- 172.21.15.40:0/4278218602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b9815bcc0 0x7f2b980cb420 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2b88005fd0 tx=0x7f2b8802a620 comp rx=0 tx=0).stop 2024-09-11T00:24:30.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.663+0000 7f2b9f200640 1 -- 172.21.15.40:0/4278218602 shutdown_connections 2024-09-11T00:24:30.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.663+0000 7f2b9f200640 1 --2- 172.21.15.40:0/4278218602 >> v2:172.21.15.175:3300/0 conn(0x7f2b980cba70 0x7f2b980cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.664+0000 7f2b9f200640 1 --2- 172.21.15.40:0/4278218602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b9815bcc0 0x7f2b980cb420 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.664+0000 7f2b9f200640 1 -- 172.21.15.40:0/4278218602 >> 172.21.15.40:0/4278218602 conn(0x7f2b980cfbb0 msgr2=0x7f2b980cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:30.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.664+0000 7f2b9f200640 1 -- 172.21.15.40:0/4278218602 shutdown_connections 2024-09-11T00:24:30.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.664+0000 7f2b9f200640 1 -- 172.21.15.40:0/4278218602 wait complete. 2024-09-11T00:24:30.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.665+0000 7f2b9f200640 1 Processor -- start 2024-09-11T00:24:30.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.665+0000 7f2b9f200640 1 -- start start 2024-09-11T00:24:30.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.666+0000 7f2b9f200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b980ca200 0x7f2b980c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:30.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.666+0000 7f2b9f200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b980cba70 0x7f2b980c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:30.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.666+0000 7f2b9f200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b9815bcc0 0x7f2b980aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:30.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.666+0000 7f2b9f200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9815f940 con 0x7f2b9815bcc0 2024-09-11T00:24:30.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.666+0000 7f2b9f200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9815f7c0 con 0x7f2b980cba70 2024-09-11T00:24:30.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.666+0000 7f2b9f200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2b980cad60 con 0x7f2b980ca200 2024-09-11T00:24:30.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.667+0000 7f2b9d200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b9815bcc0 0x7f2b980aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:30.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.667+0000 7f2b9d200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b9815bcc0 0x7f2b980aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47842/0 (socket says 172.21.15.40:47842) 2024-09-11T00:24:30.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.667+0000 7f2b9d200640 1 -- 172.21.15.40:0/4119257307 learned_addr learned my addr 172.21.15.40:0/4119257307 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:30.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.667+0000 7f2b97e00640 1 --2- 172.21.15.40:0/4119257307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b980ca200 0x7f2b980c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:30.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.667+0000 7f2b8fe00640 1 --2- 172.21.15.40:0/4119257307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b980cba70 0x7f2b980c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:30.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.667+0000 7f2b9d200640 1 -- 172.21.15.40:0/4119257307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b980ca200 msgr2=0x7f2b980c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:30.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.667+0000 7f2b9d200640 1 --2- 172.21.15.40:0/4119257307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b980ca200 0x7f2b980c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.667+0000 7f2b9d200640 1 -- 172.21.15.40:0/4119257307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b980cba70 msgr2=0x7f2b980c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:30.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.667+0000 7f2b9d200640 1 --2- 172.21.15.40:0/4119257307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b980cba70 0x7f2b980c96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.667+0000 7f2b9d200640 1 -- 172.21.15.40:0/4119257307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b980c8600 con 0x7f2b9815bcc0 2024-09-11T00:24:30.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.667+0000 7f2b9d200640 1 --2- 172.21.15.40:0/4119257307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b9815bcc0 0x7f2b980aedb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2b9000c7a0 tx=0x7f2b9000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:30.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.667+0000 7f2b94c00640 1 -- 172.21.15.40:0/4119257307 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b90003b70 con 0x7f2b9815bcc0 2024-09-11T00:24:30.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.668+0000 7f2b94c00640 1 -- 172.21.15.40:0/4119257307 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b90003d10 con 0x7f2b9815bcc0 2024-09-11T00:24:30.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.668+0000 7f2b94c00640 1 -- 172.21.15.40:0/4119257307 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b9000aab0 con 0x7f2b9815bcc0 2024-09-11T00:24:30.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.668+0000 7f2b9f200640 1 -- 172.21.15.40:0/4119257307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b980c8c00 con 0x7f2b9815bcc0 2024-09-11T00:24:30.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.668+0000 7f2b9f200640 1 -- 172.21.15.40:0/4119257307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b980c91c0 con 0x7f2b9815bcc0 2024-09-11T00:24:30.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.669+0000 7f2b9f200640 1 -- 172.21.15.40:0/4119257307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b980cbec0 con 0x7f2b9815bcc0 2024-09-11T00:24:30.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.670+0000 7f2b94c00640 1 -- 172.21.15.40:0/4119257307 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2b9000ac50 con 0x7f2b9815bcc0 2024-09-11T00:24:30.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.671+0000 7f2b94c00640 1 --2- 172.21.15.40:0/4119257307 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2b74077f70 0x7f2b7407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:30.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.671+0000 7f2b94c00640 1 -- 172.21.15.40:0/4119257307 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f2b90099b30 con 0x7f2b9815bcc0 2024-09-11T00:24:30.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.671+0000 7f2b97e00640 1 --2- 172.21.15.40:0/4119257307 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2b74077f70 0x7f2b7407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:30.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.672+0000 7f2b97e00640 1 --2- 172.21.15.40:0/4119257307 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2b74077f70 0x7f2b7407a430 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2b88033000 tx=0x7f2b88004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:30.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.675+0000 7f2b94c00640 1 -- 172.21.15.40:0/4119257307 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2b90061f50 con 0x7f2b9815bcc0 2024-09-11T00:24:30.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.873+0000 7f2b9f200640 1 -- 172.21.15.40:0/4119257307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b981587d0 con 0x7f2b9815bcc0 2024-09-11T00:24:30.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.874+0000 7f2b94c00640 1 -- 172.21.15.40:0/4119257307 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16891 (secure 0 0 0) 0x7f2b90066980 con 0x7f2b9815bcc0 2024-09-11T00:24:30.876 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:30.877 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":24,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","created":"2024-09-11T00:23:22.512139+0000","modified":"2024-09-11T00:24:29.076647+0000","last_up_change":"2024-09-11T00:23:36.842446+0000","last_in_change":"2024-09-11T00:23:26.734953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:23:37.800502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:23:46.379819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:23:47.307802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee10e123-8817-4d94-a340-73d00121af37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6801","nonce":973366008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6803","nonce":973366008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6807","nonce":973366008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6805","nonce":973366008}]},"public_addr":"172.21.15.40:6801/973366008","cluster_addr":"172.21.15.40:6803/973366008","heartbeat_back_addr":"172.21.15.40:6807/973366008","heartbeat_front_addr":"172.21.15.40:6805/973366008","state":["exists","up"]},{"osd":1,"uuid":"f90895e9-8660-42b9-8aba-3f9d4d130b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6823","nonce":2542266029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6827","nonce":2542266029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6831","nonce":2542266029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6829","nonce":2542266029}]},"public_addr":"172.21.15.40:6823/2542266029","cluster_addr":"172.21.15.40:6827/2542266029","heartbeat_back_addr":"172.21.15.40:6831/2542266029","heartbeat_front_addr":"172.21.15.40:6829/2542266029","state":["exists","up"]},{"osd":2,"uuid":"a190497a-2aba-4748-8f1d-7e372259d65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6815","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6817","nonce":559505356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6819","nonce":559505356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6826","nonce":559505356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6822","nonce":559505356}]},"public_addr":"172.21.15.40:6817/559505356","cluster_addr":"172.21.15.40:6819/559505356","heartbeat_back_addr":"172.21.15.40:6826/559505356","heartbeat_front_addr":"172.21.15.40:6822/559505356","state":["exists","up"]},{"osd":3,"uuid":"8be32ced-898a-46f2-b850-1517667766b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6809","nonce":503633839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6811","nonce":503633839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6816","nonce":503633839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6813","nonce":503633839}]},"public_addr":"172.21.15.40:6809/503633839","cluster_addr":"172.21.15.40:6811/503633839","heartbeat_back_addr":"172.21.15.40:6816/503633839","heartbeat_front_addr":"172.21.15.40:6813/503633839","state":["exists","up"]},{"osd":4,"uuid":"9867fdfc-6f93-466e-b768-b5a1da7157de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6811","nonce":2418348042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6813","nonce":2418348042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6817","nonce":2418348042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6815","nonce":2418348042}]},"public_addr":"172.21.15.175:6811/2418348042","cluster_addr":"172.21.15.175:6813/2418348042","heartbeat_back_addr":"172.21.15.175:6817/2418348042","heartbeat_front_addr":"172.21.15.175:6815/2418348042","state":["exists","up"]},{"osd":5,"uuid":"e2f6f616-b5db-466e-942f-e2762171a8ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6827","nonce":520822300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6829","nonce":520822300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6833","nonce":520822300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6831","nonce":520822300}]},"public_addr":"172.21.15.175:6827/520822300","cluster_addr":"172.21.15.175:6829/520822300","heartbeat_back_addr":"172.21.15.175:6833/520822300","heartbeat_front_addr":"172.21.15.175:6831/520822300","state":["exists","up"]},{"osd":6,"uuid":"807ac045-bf63-4ff6-9a06-7f7022f9ef32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6819","nonce":1431736593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6821","nonce":1431736593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6825","nonce":1431736593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6823","nonce":1431736593}]},"public_addr":"172.21.15.175:6819/1431736593","cluster_addr":"172.21.15.175:6821/1431736593","heartbeat_back_addr":"172.21.15.175:6825/1431736593","heartbeat_front_addr":"172.21.15.175:6823/1431736593","state":["exists","up"]},{"osd":7,"uuid":"8e0b3293-390f-4b43-b29d-babdc5e88f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6803","nonce":3300317000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6805","nonce":3300317000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6809","nonce":3300317000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6807","nonce":3300317000}]},"public_addr":"172.21.15.175:6803/3300317000","cluster_addr":"172.21.15.175:6805/3300317000","heartbeat_back_addr":"172.21.15.175:6809/3300317000","heartbeat_front_addr":"172.21.15.175:6807/3300317000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:32.967062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.266558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.063509+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.616332+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.431077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.866822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.645225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.016210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:24:30.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.876+0000 7f2b9f200640 1 -- 172.21.15.40:0/4119257307 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2b74077f70 msgr2=0x7f2b7407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:30.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.876+0000 7f2b9f200640 1 --2- 172.21.15.40:0/4119257307 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2b74077f70 0x7f2b7407a430 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2b88033000 tx=0x7f2b88004730 comp rx=0 tx=0).stop 2024-09-11T00:24:30.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.876+0000 7f2b9f200640 1 -- 172.21.15.40:0/4119257307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b9815bcc0 msgr2=0x7f2b980aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:30.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.876+0000 7f2b9f200640 1 --2- 172.21.15.40:0/4119257307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b9815bcc0 0x7f2b980aedb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2b9000c7a0 tx=0x7f2b9000cc60 comp rx=0 tx=0).stop 2024-09-11T00:24:30.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.877+0000 7f2b9f200640 1 -- 172.21.15.40:0/4119257307 shutdown_connections 2024-09-11T00:24:30.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.877+0000 7f2b9f200640 1 --2- 172.21.15.40:0/4119257307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b9815bcc0 0x7f2b980aedb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.877+0000 7f2b9f200640 1 --2- 172.21.15.40:0/4119257307 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2b74077f70 0x7f2b7407a430 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.877+0000 7f2b9f200640 1 --2- 172.21.15.40:0/4119257307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b980cba70 0x7f2b980c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.877+0000 7f2b9f200640 1 --2- 172.21.15.40:0/4119257307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b980ca200 0x7f2b980c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:30.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.877+0000 7f2b9f200640 1 -- 172.21.15.40:0/4119257307 >> 172.21.15.40:0/4119257307 conn(0x7f2b980cfbb0 msgr2=0x7f2b98075840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:30.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.877+0000 7f2b9f200640 1 -- 172.21.15.40:0/4119257307 shutdown_connections 2024-09-11T00:24:30.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:30.877+0000 7f2b9f200640 1 -- 172.21.15.40:0/4119257307 wait complete. 2024-09-11T00:24:30.896 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T00:24:31.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.055+0000 7f7d7fe00640 1 -- 172.21.15.40:0/1201617778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d8006efa0 msgr2=0x7f7d80073830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:31.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.055+0000 7f7d7fe00640 1 --2- 172.21.15.40:0/1201617778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d8006efa0 0x7f7d80073830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c005fd0 tx=0x7f7d6c02a5d0 comp rx=0 tx=0).stop 2024-09-11T00:24:31.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.055+0000 7f7d7fe00640 1 -- 172.21.15.40:0/1201617778 shutdown_connections 2024-09-11T00:24:31.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.055+0000 7f7d7fe00640 1 --2- 172.21.15.40:0/1201617778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d8006efa0 0x7f7d80073830 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:31.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.055+0000 7f7d7fe00640 1 -- 172.21.15.40:0/1201617778 >> 172.21.15.40:0/1201617778 conn(0x7f7d800cf770 msgr2=0x7f7d800cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:31.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.055+0000 7f7d7fe00640 1 -- 172.21.15.40:0/1201617778 shutdown_connections 2024-09-11T00:24:31.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.055+0000 7f7d7fe00640 1 -- 172.21.15.40:0/1201617778 wait complete. 2024-09-11T00:24:31.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.056+0000 7f7d7fe00640 1 Processor -- start 2024-09-11T00:24:31.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.056+0000 7f7d7fe00640 1 -- start start 2024-09-11T00:24:31.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.057+0000 7f7d7fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d8006efa0 0x7f7d80159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:31.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.057+0000 7f7d7fe00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d800ae640 0x7f7d800cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:31.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.057+0000 7f7d7fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d8015baa0 0x7f7d800c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:31.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.057+0000 7f7d7fe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8015c750 con 0x7f7d8006efa0 2024-09-11T00:24:31.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.057+0000 7f7d7fe00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8015c5d0 con 0x7f7d8015baa0 2024-09-11T00:24:31.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.057+0000 7f7d7fe00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8015c8d0 con 0x7f7d800ae640 2024-09-11T00:24:31.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.058+0000 7f7d7ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d8006efa0 0x7f7d80159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:31.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.058+0000 7f7d7ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d8006efa0 0x7f7d80159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47868/0 (socket says 172.21.15.40:47868) 2024-09-11T00:24:31.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.058+0000 7f7d7ea00640 1 -- 172.21.15.40:0/603525771 learned_addr learned my addr 172.21.15.40:0/603525771 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:31.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.058+0000 7f7d7e000640 1 --2- 172.21.15.40:0/603525771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d800ae640 0x7f7d800cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:31.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.058+0000 7f7d7f400640 1 --2- 172.21.15.40:0/603525771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d8015baa0 0x7f7d800c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:31.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.058+0000 7f7d7ea00640 1 -- 172.21.15.40:0/603525771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d800ae640 msgr2=0x7f7d800cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:31.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.058+0000 7f7d7ea00640 1 --2- 172.21.15.40:0/603525771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d800ae640 0x7f7d800cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:31.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.058+0000 7f7d7ea00640 1 -- 172.21.15.40:0/603525771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d8015baa0 msgr2=0x7f7d800c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:31.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.058+0000 7f7d7ea00640 1 --2- 172.21.15.40:0/603525771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d8015baa0 0x7f7d800c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:31.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.058+0000 7f7d7ea00640 1 -- 172.21.15.40:0/603525771 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d800c4750 con 0x7f7d8006efa0 2024-09-11T00:24:31.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.059+0000 7f7d7ea00640 1 --2- 172.21.15.40:0/603525771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d8006efa0 0x7f7d80159cb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7d7000c3a0 tx=0x7f7d7000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:31.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.059+0000 7f7d76a00640 1 -- 172.21.15.40:0/603525771 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d70017070 con 0x7f7d8006efa0 2024-09-11T00:24:31.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.059+0000 7f7d76a00640 1 -- 172.21.15.40:0/603525771 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d700053c0 con 0x7f7d8006efa0 2024-09-11T00:24:31.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.059+0000 7f7d76a00640 1 -- 172.21.15.40:0/603525771 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d70003850 con 0x7f7d8006efa0 2024-09-11T00:24:31.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.059+0000 7f7d7fe00640 1 -- 172.21.15.40:0/603525771 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d800c4470 con 0x7f7d8006efa0 2024-09-11T00:24:31.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.059+0000 7f7d7fe00640 1 -- 172.21.15.40:0/603525771 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d8015a1f0 con 0x7f7d8006efa0 2024-09-11T00:24:31.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.060+0000 7f7d7fe00640 1 -- 172.21.15.40:0/603525771 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d80074010 con 0x7f7d8006efa0 2024-09-11T00:24:31.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.061+0000 7f7d76a00640 1 -- 172.21.15.40:0/603525771 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7d700039f0 con 0x7f7d8006efa0 2024-09-11T00:24:31.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.062+0000 7f7d76a00640 1 --2- 172.21.15.40:0/603525771 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7d60077f70 0x7f7d6007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:31.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.062+0000 7f7d76a00640 1 -- 172.21.15.40:0/603525771 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f7d700994a0 con 0x7f7d8006efa0 2024-09-11T00:24:31.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.063+0000 7f7d7e000640 1 --2- 172.21.15.40:0/603525771 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7d60077f70 0x7f7d6007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:31.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.063+0000 7f7d7e000640 1 --2- 172.21.15.40:0/603525771 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7d60077f70 0x7f7d6007a430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c033000 tx=0x7f7d6c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:31.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.066+0000 7f7d76a00640 1 -- 172.21.15.40:0/603525771 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7d700617a0 con 0x7f7d8006efa0 2024-09-11T00:24:31.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.295+0000 7f7d7fe00640 1 -- 172.21.15.40:0/603525771 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7d800696c0 con 0x7f7d8006efa0 2024-09-11T00:24:31.298 INFO:tasks.ceph.mon.a.smithi040.stderr:2024-09-11T00:24:31.296+0000 7f9b63c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:24:31.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.299+0000 7f7d76a00640 1 -- 172.21.15.40:0/603525771 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f7d700661d0 con 0x7f7d8006efa0 2024-09-11T00:24:31.302 INFO:teuthology.orchestra.run.smithi040.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T00:24:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.301+0000 7f7d7fe00640 1 -- 172.21.15.40:0/603525771 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7d60077f70 msgr2=0x7f7d6007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.301+0000 7f7d7fe00640 1 --2- 172.21.15.40:0/603525771 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7d60077f70 0x7f7d6007a430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c033000 tx=0x7f7d6c004730 comp rx=0 tx=0).stop 2024-09-11T00:24:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.302+0000 7f7d7fe00640 1 -- 172.21.15.40:0/603525771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d8006efa0 msgr2=0x7f7d80159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.302+0000 7f7d7fe00640 1 --2- 172.21.15.40:0/603525771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d8006efa0 0x7f7d80159cb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7d7000c3a0 tx=0x7f7d7000c860 comp rx=0 tx=0).stop 2024-09-11T00:24:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.302+0000 7f7d7fe00640 1 -- 172.21.15.40:0/603525771 shutdown_connections 2024-09-11T00:24:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.302+0000 7f7d7fe00640 1 --2- 172.21.15.40:0/603525771 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7d60077f70 0x7f7d6007a430 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.302+0000 7f7d7fe00640 1 --2- 172.21.15.40:0/603525771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d8015baa0 0x7f7d800c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.302+0000 7f7d7fe00640 1 --2- 172.21.15.40:0/603525771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d800ae640 0x7f7d800cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.302+0000 7f7d7fe00640 1 --2- 172.21.15.40:0/603525771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d8006efa0 0x7f7d80159cb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.302+0000 7f7d7fe00640 1 -- 172.21.15.40:0/603525771 >> 172.21.15.40:0/603525771 conn(0x7f7d800cf770 msgr2=0x7f7d800af970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.302+0000 7f7d7fe00640 1 -- 172.21.15.40:0/603525771 shutdown_connections 2024-09-11T00:24:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.302+0000 7f7d7fe00640 1 -- 172.21.15.40:0/603525771 wait complete. 2024-09-11T00:24:31.311 INFO:tasks.ceph.mds.c.smithi040.stderr: -2620> 2024-09-11T00:23:53.889+0000 7f908b000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T00:24:31.321 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T00:24:31.358 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2024-09-11T00:24:31.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.483+0000 7fc875600640 1 -- 172.21.15.40:0/1602504820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc87015f100 msgr2=0x7fc8700b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:31.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.483+0000 7fc875600640 1 --2- 172.21.15.40:0/1602504820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc87015f100 0x7fc8700b2950 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc87006a0e0 tx=0x7fc86002a580 comp rx=0 tx=0).stop 2024-09-11T00:24:31.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.483+0000 7fc875600640 1 -- 172.21.15.40:0/1602504820 shutdown_connections 2024-09-11T00:24:31.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.483+0000 7fc875600640 1 --2- 172.21.15.40:0/1602504820 >> v2:172.21.15.175:3300/0 conn(0x7fc8701602c0 0x7fc8700ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:31.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.483+0000 7fc875600640 1 --2- 172.21.15.40:0/1602504820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc87015f100 0x7fc8700b2950 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:31.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.483+0000 7fc875600640 1 -- 172.21.15.40:0/1602504820 >> 172.21.15.40:0/1602504820 conn(0x7fc8700d1a20 msgr2=0x7fc8700d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:31.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.483+0000 7fc875600640 1 -- 172.21.15.40:0/1602504820 shutdown_connections 2024-09-11T00:24:31.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.483+0000 7fc875600640 1 -- 172.21.15.40:0/1602504820 wait complete. 2024-09-11T00:24:31.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.484+0000 7fc875600640 1 Processor -- start 2024-09-11T00:24:31.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.485+0000 7fc875600640 1 -- start start 2024-09-11T00:24:31.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.485+0000 7fc875600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc87015f100 0x7fc8700b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:31.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.486+0000 7fc875600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc87015f720 0x7fc8700c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:31.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.486+0000 7fc875600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8701602c0 0x7fc87014bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:31.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.486+0000 7fc875600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc8700aedd0 con 0x7fc87015f100 2024-09-11T00:24:31.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.486+0000 7fc875600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc8700aec50 con 0x7fc87015f720 2024-09-11T00:24:31.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.486+0000 7fc875600640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc8700aef50 con 0x7fc8701602c0 2024-09-11T00:24:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.486+0000 7fc86fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc87015f100 0x7fc8700b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.486+0000 7fc86fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc87015f100 0x7fc8700b5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47910/0 (socket says 172.21.15.40:47910) 2024-09-11T00:24:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.486+0000 7fc86fe00640 1 -- 172.21.15.40:0/1124283250 learned_addr learned my addr 172.21.15.40:0/1124283250 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.486+0000 7fc86f400640 1 --2- 172.21.15.40:0/1124283250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc87015f720 0x7fc8700c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.486+0000 7fc874c00640 1 --2- 172.21.15.40:0/1124283250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8701602c0 0x7fc87014bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.486+0000 7fc86fe00640 1 -- 172.21.15.40:0/1124283250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8701602c0 msgr2=0x7fc87014bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.486+0000 7fc86fe00640 1 --2- 172.21.15.40:0/1124283250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8701602c0 0x7fc87014bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.486+0000 7fc86fe00640 1 -- 172.21.15.40:0/1124283250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc87015f720 msgr2=0x7fc8700c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.486+0000 7fc86fe00640 1 --2- 172.21.15.40:0/1124283250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc87015f720 0x7fc8700c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.486+0000 7fc86fe00640 1 -- 172.21.15.40:0/1124283250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8700c8750 con 0x7fc87015f100 2024-09-11T00:24:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.486+0000 7fc874c00640 1 --2- 172.21.15.40:0/1124283250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8701602c0 0x7fc87014bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.486+0000 7fc86fe00640 1 --2- 172.21.15.40:0/1124283250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc87015f100 0x7fc8700b5f10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc860009850 tx=0x7fc8600039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.487+0000 7fc867e00640 1 -- 172.21.15.40:0/1124283250 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86003f070 con 0x7fc87015f100 2024-09-11T00:24:31.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.487+0000 7fc867e00640 1 -- 172.21.15.40:0/1124283250 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc860004890 con 0x7fc87015f100 2024-09-11T00:24:31.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.487+0000 7fc867e00640 1 -- 172.21.15.40:0/1124283250 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc860035030 con 0x7fc87015f100 2024-09-11T00:24:31.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.487+0000 7fc875600640 1 -- 172.21.15.40:0/1124283250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8700c7bd0 con 0x7fc87015f100 2024-09-11T00:24:31.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.487+0000 7fc875600640 1 -- 172.21.15.40:0/1124283250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8700c8190 con 0x7fc87015f100 2024-09-11T00:24:31.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.488+0000 7fc875600640 1 -- 172.21.15.40:0/1124283250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8700b2950 con 0x7fc87015f100 2024-09-11T00:24:31.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.489+0000 7fc867e00640 1 -- 172.21.15.40:0/1124283250 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc860004ca0 con 0x7fc87015f100 2024-09-11T00:24:31.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.490+0000 7fc867e00640 1 --2- 172.21.15.40:0/1124283250 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc850077f70 0x7fc85007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:31.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.490+0000 7fc867e00640 1 -- 172.21.15.40:0/1124283250 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5911+0+0 (secure 0 0 0) 0x7fc8600bb170 con 0x7fc87015f100 2024-09-11T00:24:31.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.490+0000 7fc86f400640 1 --2- 172.21.15.40:0/1124283250 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc850077f70 0x7fc85007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:31.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.491+0000 7fc86f400640 1 --2- 172.21.15.40:0/1124283250 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc850077f70 0x7fc85007a430 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc870152c50 tx=0x7fc85c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:31.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.494+0000 7fc867e00640 1 -- 172.21.15.40:0/1124283250 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc860083b00 con 0x7fc87015f100 2024-09-11T00:24:31.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:31.728+0000 7fc875600640 1 -- 172.21.15.40:0/1124283250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc870075040 con 0x7fc87015f100 2024-09-11T00:24:32.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.307+0000 7fc867e00640 1 -- 172.21.15.40:0/1124283250 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fc860083400 con 0x7fc87015f100 2024-09-11T00:24:32.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.310+0000 7fc875600640 1 -- 172.21.15.40:0/1124283250 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc850077f70 msgr2=0x7fc85007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:32.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.310+0000 7fc875600640 1 --2- 172.21.15.40:0/1124283250 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc850077f70 0x7fc85007a430 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc870152c50 tx=0x7fc85c009040 comp rx=0 tx=0).stop 2024-09-11T00:24:32.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.310+0000 7fc875600640 1 -- 172.21.15.40:0/1124283250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc87015f100 msgr2=0x7fc8700b5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:32.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.310+0000 7fc875600640 1 --2- 172.21.15.40:0/1124283250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc87015f100 0x7fc8700b5f10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc860009850 tx=0x7fc8600039e0 comp rx=0 tx=0).stop 2024-09-11T00:24:32.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.310+0000 7fc875600640 1 -- 172.21.15.40:0/1124283250 shutdown_connections 2024-09-11T00:24:32.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.310+0000 7fc875600640 1 --2- 172.21.15.40:0/1124283250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8701602c0 0x7fc87014bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:32.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.310+0000 7fc875600640 1 --2- 172.21.15.40:0/1124283250 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc850077f70 0x7fc85007a430 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:32.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.310+0000 7fc875600640 1 --2- 172.21.15.40:0/1124283250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc87015f720 0x7fc8700c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:32.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.310+0000 7fc875600640 1 --2- 172.21.15.40:0/1124283250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc87015f100 0x7fc8700b5f10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:32.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.310+0000 7fc875600640 1 -- 172.21.15.40:0/1124283250 >> 172.21.15.40:0/1124283250 conn(0x7fc8700d1a20 msgr2=0x7fc87006dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:32.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.310+0000 7fc875600640 1 -- 172.21.15.40:0/1124283250 shutdown_connections 2024-09-11T00:24:32.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.310+0000 7fc875600640 1 -- 172.21.15.40:0/1124283250 wait complete. 2024-09-11T00:24:32.331 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T00:24:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.535+0000 7f9666200640 1 -- 172.21.15.40:0/1356550502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f966015e010 msgr2=0x7f96600688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.535+0000 7f9666200640 1 --2- 172.21.15.40:0/1356550502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f966015e010 0x7f96600688e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f96600d00f0 tx=0x7f965002a4d0 comp rx=0 tx=0).stop 2024-09-11T00:24:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.535+0000 7f9666200640 1 -- 172.21.15.40:0/1356550502 shutdown_connections 2024-09-11T00:24:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.535+0000 7f9666200640 1 --2- 172.21.15.40:0/1356550502 >> v2:172.21.15.175:3300/0 conn(0x7f96600b5860 0x7f96600cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.535+0000 7f9666200640 1 --2- 172.21.15.40:0/1356550502 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96600b4ee0 0x7f96600b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.535+0000 7f9666200640 1 --2- 172.21.15.40:0/1356550502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f966015e010 0x7f96600688e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.535+0000 7f9666200640 1 -- 172.21.15.40:0/1356550502 >> 172.21.15.40:0/1356550502 conn(0x7f96600d0210 msgr2=0x7f96600d0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.536+0000 7f9666200640 1 -- 172.21.15.40:0/1356550502 shutdown_connections 2024-09-11T00:24:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.536+0000 7f9666200640 1 -- 172.21.15.40:0/1356550502 wait complete. 2024-09-11T00:24:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.537+0000 7f9666200640 1 Processor -- start 2024-09-11T00:24:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.537+0000 7f9666200640 1 -- start start 2024-09-11T00:24:32.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.538+0000 7f9666200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96600b4ee0 0x7f9660157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:32.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.538+0000 7f9666200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96600b5860 0x7f96600c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:32.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.538+0000 7f9666200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f966015e010 0x7f96600ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:32.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.538+0000 7f9666200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f96600cd150 con 0x7f966015e010 2024-09-11T00:24:32.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.538+0000 7f9666200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96600ccfd0 con 0x7f96600b5860 2024-09-11T00:24:32.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.538+0000 7f9666200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f96600cd2d0 con 0x7f96600b4ee0 2024-09-11T00:24:32.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.538+0000 7f965fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f966015e010 0x7f96600ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:32.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.539+0000 7f965fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f966015e010 0x7f96600ca1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47934/0 (socket says 172.21.15.40:47934) 2024-09-11T00:24:32.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.539+0000 7f965fe00640 1 -- 172.21.15.40:0/3348076386 learned_addr learned my addr 172.21.15.40:0/3348076386 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:32.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.539+0000 7f965f400640 1 --2- 172.21.15.40:0/3348076386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96600b4ee0 0x7f9660157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:32.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.539+0000 7f9657e00640 1 --2- 172.21.15.40:0/3348076386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96600b5860 0x7f96600c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:32.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.539+0000 7f965fe00640 1 -- 172.21.15.40:0/3348076386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96600b4ee0 msgr2=0x7f9660157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:32.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.539+0000 7f965fe00640 1 --2- 172.21.15.40:0/3348076386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96600b4ee0 0x7f9660157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:32.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.539+0000 7f965fe00640 1 -- 172.21.15.40:0/3348076386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96600b5860 msgr2=0x7f96600c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:32.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.539+0000 7f965fe00640 1 --2- 172.21.15.40:0/3348076386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96600b5860 0x7f96600c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:32.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.539+0000 7f965fe00640 1 -- 172.21.15.40:0/3348076386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9660157f70 con 0x7f966015e010 2024-09-11T00:24:32.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.539+0000 7f965fe00640 1 --2- 172.21.15.40:0/3348076386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f966015e010 0x7f96600ca1d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f965800eb10 tx=0x7f965800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:32.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.540+0000 7f9657400640 1 -- 172.21.15.40:0/3348076386 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658004b20 con 0x7f966015e010 2024-09-11T00:24:32.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.540+0000 7f9657400640 1 -- 172.21.15.40:0/3348076386 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9658004ce0 con 0x7f966015e010 2024-09-11T00:24:32.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.540+0000 7f9657400640 1 -- 172.21.15.40:0/3348076386 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658005280 con 0x7f966015e010 2024-09-11T00:24:32.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.540+0000 7f9666200640 1 -- 172.21.15.40:0/3348076386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f966015b260 con 0x7f966015e010 2024-09-11T00:24:32.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.540+0000 7f9666200640 1 -- 172.21.15.40:0/3348076386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96600967d0 con 0x7f966015e010 2024-09-11T00:24:32.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.541+0000 7f9666200640 1 -- 172.21.15.40:0/3348076386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96600b5300 con 0x7f966015e010 2024-09-11T00:24:32.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.542+0000 7f9657400640 1 -- 172.21.15.40:0/3348076386 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9658005420 con 0x7f966015e010 2024-09-11T00:24:32.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.543+0000 7f9657400640 1 --2- 172.21.15.40:0/3348076386 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f963c077fa0 0x7f963c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:32.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.543+0000 7f9657400640 1 -- 172.21.15.40:0/3348076386 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5911+0+0 (secure 0 0 0) 0x7f965809aa60 con 0x7f966015e010 2024-09-11T00:24:32.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.543+0000 7f965f400640 1 --2- 172.21.15.40:0/3348076386 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f963c077fa0 0x7f963c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:32.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.544+0000 7f965f400640 1 --2- 172.21.15.40:0/3348076386 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f963c077fa0 0x7f963c07a460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9650033000 tx=0x7f9650004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:32.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.547+0000 7f9657400640 1 -- 172.21.15.40:0/3348076386 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f96600b5300 con 0x7f966015e010 2024-09-11T00:24:32.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:32.740+0000 7f9666200640 1 -- 172.21.15.40:0/3348076386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f96600cd830 con 0x7f966015e010 2024-09-11T00:24:33.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.309+0000 7f9657400640 1 -- 172.21.15.40:0/3348076386 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) ==== 181+0+0 (secure 0 0 0) 0x7f9658062da0 con 0x7f966015e010 2024-09-11T00:24:33.312 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' removed 2024-09-11T00:24:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.313+0000 7f9666200640 1 -- 172.21.15.40:0/3348076386 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f963c077fa0 msgr2=0x7f963c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.313+0000 7f9666200640 1 --2- 172.21.15.40:0/3348076386 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f963c077fa0 0x7f963c07a460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9650033000 tx=0x7f9650004730 comp rx=0 tx=0).stop 2024-09-11T00:24:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.313+0000 7f9666200640 1 -- 172.21.15.40:0/3348076386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f966015e010 msgr2=0x7f96600ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.313+0000 7f9666200640 1 --2- 172.21.15.40:0/3348076386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f966015e010 0x7f96600ca1d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f965800eb10 tx=0x7f965800c2d0 comp rx=0 tx=0).stop 2024-09-11T00:24:33.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.313+0000 7f9666200640 1 -- 172.21.15.40:0/3348076386 shutdown_connections 2024-09-11T00:24:33.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.313+0000 7f9666200640 1 --2- 172.21.15.40:0/3348076386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f966015e010 0x7f96600ca1d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:33.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.313+0000 7f9666200640 1 --2- 172.21.15.40:0/3348076386 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f963c077fa0 0x7f963c07a460 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:33.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.313+0000 7f9666200640 1 --2- 172.21.15.40:0/3348076386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96600b5860 0x7f96600c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:33.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.313+0000 7f9666200640 1 --2- 172.21.15.40:0/3348076386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96600b4ee0 0x7f9660157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:33.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.313+0000 7f9666200640 1 -- 172.21.15.40:0/3348076386 >> 172.21.15.40:0/3348076386 conn(0x7f96600d0210 msgr2=0x7f966006f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:33.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.313+0000 7f9666200640 1 -- 172.21.15.40:0/3348076386 shutdown_connections 2024-09-11T00:24:33.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.313+0000 7f9666200640 1 -- 172.21.15.40:0/3348076386 wait complete. 2024-09-11T00:24:33.335 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T00:24:33.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.500+0000 7f5924c00640 1 -- 172.21.15.40:0/1978188922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59200704c0 msgr2=0x7f5920159e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:33.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.500+0000 7f5924c00640 1 --2- 172.21.15.40:0/1978188922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59200704c0 0x7f5920159e90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f591000a940 tx=0x7f591002b840 comp rx=0 tx=0).stop 2024-09-11T00:24:33.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.501+0000 7f5924c00640 1 -- 172.21.15.40:0/1978188922 shutdown_connections 2024-09-11T00:24:33.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.501+0000 7f5924c00640 1 --2- 172.21.15.40:0/1978188922 >> v2:172.21.15.175:3300/0 conn(0x7f59200cefb0 0x7f59200aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:33.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.501+0000 7f5924c00640 1 --2- 172.21.15.40:0/1978188922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59200704c0 0x7f5920159e90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:33.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.501+0000 7f5924c00640 1 -- 172.21.15.40:0/1978188922 >> 172.21.15.40:0/1978188922 conn(0x7f59200cf950 msgr2=0x7f59200cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:33.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.501+0000 7f5924c00640 1 -- 172.21.15.40:0/1978188922 shutdown_connections 2024-09-11T00:24:33.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.501+0000 7f5924c00640 1 -- 172.21.15.40:0/1978188922 wait complete. 2024-09-11T00:24:33.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.502+0000 7f5924c00640 1 Processor -- start 2024-09-11T00:24:33.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.503+0000 7f5924c00640 1 -- start start 2024-09-11T00:24:33.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.503+0000 7f5924c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59200704c0 0x7f59201f80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:33.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.503+0000 7f5924c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59200ce410 0x7f59200afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:33.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.504+0000 7f5924c00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59200cefb0 0x7f59200c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:33.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.504+0000 7f5924c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f59200cec50 con 0x7f59200ce410 2024-09-11T00:24:33.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.504+0000 7f5924c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59200cead0 con 0x7f59200704c0 2024-09-11T00:24:33.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.504+0000 7f5924c00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f59200cedd0 con 0x7f59200cefb0 2024-09-11T00:24:33.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.504+0000 7f5915400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59200ce410 0x7f59200afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:33.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.504+0000 7f5915400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59200ce410 0x7f59200afcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47946/0 (socket says 172.21.15.40:47946) 2024-09-11T00:24:33.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.504+0000 7f5915400640 1 -- 172.21.15.40:0/3084593167 learned_addr learned my addr 172.21.15.40:0/3084593167 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:33.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.504+0000 7f591de00640 1 --2- 172.21.15.40:0/3084593167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59200704c0 0x7f59201f80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:33.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.504+0000 7f591e800640 1 --2- 172.21.15.40:0/3084593167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59200cefb0 0x7f59200c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:33.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.504+0000 7f5915400640 1 -- 172.21.15.40:0/3084593167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59200cefb0 msgr2=0x7f59200c5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:33.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.504+0000 7f5915400640 1 --2- 172.21.15.40:0/3084593167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59200cefb0 0x7f59200c5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:33.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.504+0000 7f5915400640 1 -- 172.21.15.40:0/3084593167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59200704c0 msgr2=0x7f59201f80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:33.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.504+0000 7f5915400640 1 --2- 172.21.15.40:0/3084593167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59200704c0 0x7f59201f80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:33.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.504+0000 7f5915400640 1 -- 172.21.15.40:0/3084593167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59201f4220 con 0x7f59200ce410 2024-09-11T00:24:33.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.505+0000 7f5915400640 1 --2- 172.21.15.40:0/3084593167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59200ce410 0x7f59200afcd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f590800e940 tx=0x7f590800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:33.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.505+0000 7f5916a00640 1 -- 172.21.15.40:0/3084593167 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590800cd20 con 0x7f59200ce410 2024-09-11T00:24:33.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.505+0000 7f5916a00640 1 -- 172.21.15.40:0/3084593167 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5908010430 con 0x7f59200ce410 2024-09-11T00:24:33.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.505+0000 7f5924c00640 1 -- 172.21.15.40:0/3084593167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59201f4500 con 0x7f59200ce410 2024-09-11T00:24:33.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.505+0000 7f5916a00640 1 -- 172.21.15.40:0/3084593167 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5908010880 con 0x7f59200ce410 2024-09-11T00:24:33.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.505+0000 7f5924c00640 1 -- 172.21.15.40:0/3084593167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59201f4ac0 con 0x7f59200ce410 2024-09-11T00:24:33.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.506+0000 7f5924c00640 1 -- 172.21.15.40:0/3084593167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5920159e90 con 0x7f59200ce410 2024-09-11T00:24:33.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.507+0000 7f5916a00640 1 -- 172.21.15.40:0/3084593167 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5908010a20 con 0x7f59200ce410 2024-09-11T00:24:33.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.509+0000 7f5916a00640 1 --2- 172.21.15.40:0/3084593167 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f58fc077f70 0x7f58fc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:33.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.509+0000 7f5916a00640 1 -- 172.21.15.40:0/3084593167 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5473+0+0 (secure 0 0 0) 0x7f590809a6d0 con 0x7f59200ce410 2024-09-11T00:24:33.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.509+0000 7f591de00640 1 --2- 172.21.15.40:0/3084593167 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f58fc077f70 0x7f58fc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:33.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.510+0000 7f591de00640 1 --2- 172.21.15.40:0/3084593167 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f58fc077f70 0x7f58fc07a430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5910036000 tx=0x7f5910004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:33.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.513+0000 7f5916a00640 1 -- 172.21.15.40:0/3084593167 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5908062bd0 con 0x7f59200ce410 2024-09-11T00:24:33.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:33.706+0000 7f5924c00640 1 -- 172.21.15.40:0/3084593167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5920076110 con 0x7f59200ce410 2024-09-11T00:24:34.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.315+0000 7f5916a00640 1 -- 172.21.15.40:0/3084593167 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) ==== 169+0+0 (secure 0 0 0) 0x7f5908067600 con 0x7f59200ce410 2024-09-11T00:24:34.318 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' removed 2024-09-11T00:24:34.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.319+0000 7f5924c00640 1 -- 172.21.15.40:0/3084593167 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f58fc077f70 msgr2=0x7f58fc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:34.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.319+0000 7f5924c00640 1 --2- 172.21.15.40:0/3084593167 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f58fc077f70 0x7f58fc07a430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5910036000 tx=0x7f5910004730 comp rx=0 tx=0).stop 2024-09-11T00:24:34.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.319+0000 7f5924c00640 1 -- 172.21.15.40:0/3084593167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59200ce410 msgr2=0x7f59200afcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:34.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.319+0000 7f5924c00640 1 --2- 172.21.15.40:0/3084593167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59200ce410 0x7f59200afcd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f590800e940 tx=0x7f590800ee00 comp rx=0 tx=0).stop 2024-09-11T00:24:34.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.320+0000 7f5924c00640 1 -- 172.21.15.40:0/3084593167 shutdown_connections 2024-09-11T00:24:34.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.320+0000 7f5924c00640 1 --2- 172.21.15.40:0/3084593167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59200cefb0 0x7f59200c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:34.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.320+0000 7f5924c00640 1 --2- 172.21.15.40:0/3084593167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59200ce410 0x7f59200afcd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:34.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.320+0000 7f5924c00640 1 --2- 172.21.15.40:0/3084593167 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f58fc077f70 0x7f58fc07a430 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:34.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.320+0000 7f5924c00640 1 --2- 172.21.15.40:0/3084593167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59200704c0 0x7f59201f80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:34.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.320+0000 7f5924c00640 1 -- 172.21.15.40:0/3084593167 >> 172.21.15.40:0/3084593167 conn(0x7f59200cf950 msgr2=0x7f59200c6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:34.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.320+0000 7f5924c00640 1 -- 172.21.15.40:0/3084593167 shutdown_connections 2024-09-11T00:24:34.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.320+0000 7f5924c00640 1 -- 172.21.15.40:0/3084593167 wait complete. 2024-09-11T00:24:34.342 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T00:24:34.342 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T00:24:34.342 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T00:24:34.343 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:24:34.343 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T00:24:34.343 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T00:24:34.343 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T00:24:34.343 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:24:34.343 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T00:24:34.343 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T00:24:34.344 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T00:24:34.344 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:24:34.344 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T00:24:34.344 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T00:24:34.344 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T00:24:34.344 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:24:34.357 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T00:24:34.357 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T00:24:34.358 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T00:24:34.358 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T00:24:34.359 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T00:24:34.360 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T00:24:34.360 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T00:24:34.361 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T00:24:34.401 INFO:tasks.ceph.mds.a:Started 2024-09-11T00:24:34.402 DEBUG:teuthology.parallel:result is None 2024-09-11T00:24:34.404 INFO:tasks.ceph.mds.c:Started 2024-09-11T00:24:34.404 DEBUG:teuthology.parallel:result is None 2024-09-11T00:24:34.404 INFO:tasks.ceph.mds.b:Started 2024-09-11T00:24:34.405 DEBUG:teuthology.parallel:result is None 2024-09-11T00:24:34.406 INFO:tasks.ceph.mds.d:Started 2024-09-11T00:24:34.406 DEBUG:teuthology.parallel:result is None 2024-09-11T00:24:34.407 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T00:24:34.536 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2024-09-11T00:24:34.536 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2024-09-11T00:24:34.539 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2024-09-11T00:24:34.539 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2024-09-11T00:24:34.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.573+0000 7feedf200640 1 -- 172.21.15.40:0/1667609832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feee00d09e0 msgr2=0x7feee00d4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:34.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.573+0000 7feedf200640 1 --2- 172.21.15.40:0/1667609832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feee00d09e0 0x7feee00d4740 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feec8009830 tx=0x7feec802a480 comp rx=0 tx=0).stop 2024-09-11T00:24:34.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.573+0000 7feedf200640 1 -- 172.21.15.40:0/1667609832 shutdown_connections 2024-09-11T00:24:34.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.573+0000 7feedf200640 1 --2- 172.21.15.40:0/1667609832 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feee00b2d20 0x7feee006cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:34.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.573+0000 7feedf200640 1 --2- 172.21.15.40:0/1667609832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feee00d09e0 0x7feee00d4740 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:34.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.573+0000 7feedf200640 1 -- 172.21.15.40:0/1667609832 >> 172.21.15.40:0/1667609832 conn(0x7feee00d3c20 msgr2=0x7feee00d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:34.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.573+0000 7feedf200640 1 -- 172.21.15.40:0/1667609832 shutdown_connections 2024-09-11T00:24:34.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.573+0000 7feedf200640 1 -- 172.21.15.40:0/1667609832 wait complete. 2024-09-11T00:24:34.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.575+0000 7feedf200640 1 Processor -- start 2024-09-11T00:24:34.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.575+0000 7feedf200640 1 -- start start 2024-09-11T00:24:34.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.576+0000 7feedf200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feee00b2d20 0x7feee015b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:34.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.576+0000 7feedf200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feee00d09e0 0x7feee01f79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:34.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.576+0000 7feedf200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feee015dd10 0x7feee0157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:34.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.576+0000 7feedf200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7feee006d890 con 0x7feee015dd10 2024-09-11T00:24:34.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.576+0000 7feedf200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feee006d710 con 0x7feee00d09e0 2024-09-11T00:24:34.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.576+0000 7feedf200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7feee006da10 con 0x7feee00b2d20 2024-09-11T00:24:34.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.576+0000 7feede800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feee015dd10 0x7feee0157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:34.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.576+0000 7feede800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feee015dd10 0x7feee0157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47982/0 (socket says 172.21.15.40:47982) 2024-09-11T00:24:34.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.576+0000 7feede800640 1 -- 172.21.15.40:0/3968360837 learned_addr learned my addr 172.21.15.40:0/3968360837 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:34.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.576+0000 7feedde00640 1 --2- 172.21.15.40:0/3968360837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feee00b2d20 0x7feee015b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:34.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.576+0000 7feed5400640 1 --2- 172.21.15.40:0/3968360837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feee00d09e0 0x7feee01f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:34.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.577+0000 7feede800640 1 -- 172.21.15.40:0/3968360837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feee00b2d20 msgr2=0x7feee015b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:34.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.577+0000 7feede800640 1 --2- 172.21.15.40:0/3968360837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feee00b2d20 0x7feee015b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:34.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.577+0000 7feede800640 1 -- 172.21.15.40:0/3968360837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feee00d09e0 msgr2=0x7feee01f79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:34.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.577+0000 7feede800640 1 --2- 172.21.15.40:0/3968360837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feee00d09e0 0x7feee01f79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:34.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.577+0000 7feede800640 1 -- 172.21.15.40:0/3968360837 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee01f43e0 con 0x7feee015dd10 2024-09-11T00:24:34.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.577+0000 7feede800640 1 --2- 172.21.15.40:0/3968360837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feee015dd10 0x7feee0157280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7feed800efd0 tx=0x7feed800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:34.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.577+0000 7feed6a00640 1 -- 172.21.15.40:0/3968360837 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed8003b70 con 0x7feee015dd10 2024-09-11T00:24:34.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.577+0000 7feed6a00640 1 -- 172.21.15.40:0/3968360837 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feed8003e00 con 0x7feee015dd10 2024-09-11T00:24:34.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.577+0000 7feed6a00640 1 -- 172.21.15.40:0/3968360837 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed8004280 con 0x7feee015dd10 2024-09-11T00:24:34.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.577+0000 7feedf200640 1 -- 172.21.15.40:0/3968360837 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee01f8100 con 0x7feee015dd10 2024-09-11T00:24:34.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.577+0000 7feedf200640 1 -- 172.21.15.40:0/3968360837 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee01f86c0 con 0x7feee015dd10 2024-09-11T00:24:34.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.579+0000 7feedf200640 1 -- 172.21.15.40:0/3968360837 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee006cfc0 con 0x7feee015dd10 2024-09-11T00:24:34.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.580+0000 7feed6a00640 1 -- 172.21.15.40:0/3968360837 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7feed8004420 con 0x7feee015dd10 2024-09-11T00:24:34.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.581+0000 7feed6a00640 1 --2- 172.21.15.40:0/3968360837 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7feebc077f70 0x7feebc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:34.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.581+0000 7feed6a00640 1 -- 172.21.15.40:0/3968360837 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4943+0+0 (secure 0 0 0) 0x7feed809a950 con 0x7feee015dd10 2024-09-11T00:24:34.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.581+0000 7feedde00640 1 --2- 172.21.15.40:0/3968360837 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7feebc077f70 0x7feebc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:34.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.582+0000 7feedde00640 1 --2- 172.21.15.40:0/3968360837 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7feebc077f70 0x7feebc07a430 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feed0007fd0 tx=0x7feed0000fe0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:34.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.585+0000 7feed6a00640 1 -- 172.21.15.40:0/3968360837 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7feee01f43e0 con 0x7feee015dd10 2024-09-11T00:24:34.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:34.793+0000 7feedf200640 1 -- 172.21.15.40:0/3968360837 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7feee00b98f0 con 0x7feee015dd10 2024-09-11T00:24:35.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.333+0000 7feed6a00640 1 -- 172.21.15.40:0/3968360837 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) ==== 97+0+0 (secure 0 0 0) 0x7feed8063060 con 0x7feee015dd10 2024-09-11T00:24:35.336 INFO:teuthology.orchestra.run.smithi040.stderr: removed all blocklist entries 2024-09-11T00:24:35.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.336+0000 7feedf200640 1 -- 172.21.15.40:0/3968360837 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7feebc077f70 msgr2=0x7feebc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:35.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.336+0000 7feedf200640 1 --2- 172.21.15.40:0/3968360837 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7feebc077f70 0x7feebc07a430 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feed0007fd0 tx=0x7feed0000fe0 comp rx=0 tx=0).stop 2024-09-11T00:24:35.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.336+0000 7feedf200640 1 -- 172.21.15.40:0/3968360837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feee015dd10 msgr2=0x7feee0157280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:35.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.336+0000 7feedf200640 1 --2- 172.21.15.40:0/3968360837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feee015dd10 0x7feee0157280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7feed800efd0 tx=0x7feed800c6a0 comp rx=0 tx=0).stop 2024-09-11T00:24:35.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.336+0000 7feedf200640 1 -- 172.21.15.40:0/3968360837 shutdown_connections 2024-09-11T00:24:35.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.336+0000 7feedf200640 1 --2- 172.21.15.40:0/3968360837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feee015dd10 0x7feee0157280 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:35.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.336+0000 7feedf200640 1 --2- 172.21.15.40:0/3968360837 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7feebc077f70 0x7feebc07a430 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:35.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.336+0000 7feedf200640 1 --2- 172.21.15.40:0/3968360837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feee00d09e0 0x7feee01f79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:35.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.336+0000 7feedf200640 1 --2- 172.21.15.40:0/3968360837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feee00b2d20 0x7feee015b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:35.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.336+0000 7feedf200640 1 -- 172.21.15.40:0/3968360837 >> 172.21.15.40:0/3968360837 conn(0x7feee00d3c20 msgr2=0x7feee00b7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:35.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.336+0000 7feedf200640 1 -- 172.21.15.40:0/3968360837 shutdown_connections 2024-09-11T00:24:35.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.336+0000 7feedf200640 1 -- 172.21.15.40:0/3968360837 wait complete. 2024-09-11T00:24:35.359 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T00:24:35.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.519+0000 7ff728e00640 1 -- 172.21.15.40:0/2573829588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff72415ec70 msgr2=0x7ff72415e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:35.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.519+0000 7ff728e00640 1 --2- 172.21.15.40:0/2573829588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff72415ec70 0x7ff72415e3b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff7240cc5e0 tx=0x7ff71402a560 comp rx=0 tx=0).stop 2024-09-11T00:24:35.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.519+0000 7ff728e00640 1 -- 172.21.15.40:0/2573829588 shutdown_connections 2024-09-11T00:24:35.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.519+0000 7ff728e00640 1 --2- 172.21.15.40:0/2573829588 >> v2:172.21.15.175:3300/0 conn(0x7ff7240cd780 0x7ff7240cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:35.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.519+0000 7ff728e00640 1 --2- 172.21.15.40:0/2573829588 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff72415f050 0x7ff7240ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:35.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.519+0000 7ff728e00640 1 --2- 172.21.15.40:0/2573829588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff72415ec70 0x7ff72415e3b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:35.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.519+0000 7ff728e00640 1 -- 172.21.15.40:0/2573829588 >> 172.21.15.40:0/2573829588 conn(0x7ff7240cfbb0 msgr2=0x7ff7240cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:35.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.519+0000 7ff728e00640 1 -- 172.21.15.40:0/2573829588 shutdown_connections 2024-09-11T00:24:35.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.519+0000 7ff728e00640 1 -- 172.21.15.40:0/2573829588 wait complete. 2024-09-11T00:24:35.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.521+0000 7ff728e00640 1 Processor -- start 2024-09-11T00:24:35.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.521+0000 7ff728e00640 1 -- start start 2024-09-11T00:24:35.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.522+0000 7ff728e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7240cd780 0x7ff724153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:35.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.522+0000 7ff728e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff72415ec70 0x7ff7241573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:35.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.522+0000 7ff728e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff72415f050 0x7ff7240b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:35.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.522+0000 7ff728e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff724161b20 con 0x7ff72415ec70 2024-09-11T00:24:35.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.522+0000 7ff728e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff7241619a0 con 0x7ff72415f050 2024-09-11T00:24:35.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.522+0000 7ff728e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff724161ca0 con 0x7ff7240cd780 2024-09-11T00:24:35.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.522+0000 7ff721400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff72415ec70 0x7ff7241573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:35.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.522+0000 7ff721400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff72415ec70 0x7ff7241573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47994/0 (socket says 172.21.15.40:47994) 2024-09-11T00:24:35.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.522+0000 7ff721400640 1 -- 172.21.15.40:0/3301487931 learned_addr learned my addr 172.21.15.40:0/3301487931 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:35.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.522+0000 7ff721e00640 1 --2- 172.21.15.40:0/3301487931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7240cd780 0x7ff724153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:35.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.522+0000 7ff722800640 1 --2- 172.21.15.40:0/3301487931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff72415f050 0x7ff7240b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:35.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.522+0000 7ff721400640 1 -- 172.21.15.40:0/3301487931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7240cd780 msgr2=0x7ff724153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:35.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.522+0000 7ff721400640 1 --2- 172.21.15.40:0/3301487931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7240cd780 0x7ff724153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:35.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.522+0000 7ff721400640 1 -- 172.21.15.40:0/3301487931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff72415f050 msgr2=0x7ff7240b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:35.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.522+0000 7ff721400640 1 --2- 172.21.15.40:0/3301487931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff72415f050 0x7ff7240b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:35.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.523+0000 7ff721400640 1 -- 172.21.15.40:0/3301487931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7241f8a40 con 0x7ff72415ec70 2024-09-11T00:24:35.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.523+0000 7ff721e00640 1 --2- 172.21.15.40:0/3301487931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7240cd780 0x7ff724153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:35.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.523+0000 7ff722800640 1 --2- 172.21.15.40:0/3301487931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff72415f050 0x7ff7240b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:35.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.523+0000 7ff721400640 1 --2- 172.21.15.40:0/3301487931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff72415ec70 0x7ff7241573f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff71000e7c0 tx=0x7ff71000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:35.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.523+0000 7ff71a000640 1 -- 172.21.15.40:0/3301487931 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71000ccc0 con 0x7ff72415ec70 2024-09-11T00:24:35.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.523+0000 7ff71a000640 1 -- 172.21.15.40:0/3301487931 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff71000ce80 con 0x7ff72415ec70 2024-09-11T00:24:35.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.523+0000 7ff71a000640 1 -- 172.21.15.40:0/3301487931 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff710005280 con 0x7ff72415ec70 2024-09-11T00:24:35.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.523+0000 7ff728e00640 1 -- 172.21.15.40:0/3301487931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7241f8d20 con 0x7ff72415ec70 2024-09-11T00:24:35.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.523+0000 7ff728e00640 1 -- 172.21.15.40:0/3301487931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff724156bf0 con 0x7ff72415ec70 2024-09-11T00:24:35.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.524+0000 7ff728e00640 1 -- 172.21.15.40:0/3301487931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7240cdbd0 con 0x7ff72415ec70 2024-09-11T00:24:35.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.526+0000 7ff71a000640 1 -- 172.21.15.40:0/3301487931 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff710005420 con 0x7ff72415ec70 2024-09-11T00:24:35.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.527+0000 7ff71a000640 1 --2- 172.21.15.40:0/3301487931 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff704077f70 0x7ff70407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:35.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.527+0000 7ff71a000640 1 -- 172.21.15.40:0/3301487931 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7ff71009a3b0 con 0x7ff72415ec70 2024-09-11T00:24:35.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.528+0000 7ff721e00640 1 --2- 172.21.15.40:0/3301487931 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff704077f70 0x7ff70407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:35.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.528+0000 7ff721e00640 1 --2- 172.21.15.40:0/3301487931 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff704077f70 0x7ff70407a430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff714033000 tx=0x7ff714004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:35.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.532+0000 7ff71a000640 1 -- 172.21.15.40:0/3301487931 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff7100631f0 con 0x7ff72415ec70 2024-09-11T00:24:35.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.798+0000 7ff728e00640 1 -- 172.21.15.40:0/3301487931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff7240b5b30 con 0x7ff72415ec70 2024-09-11T00:24:35.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.798+0000 7ff71a000640 1 -- 172.21.15.40:0/3301487931 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7ff710063e20 con 0x7ff72415ec70 2024-09-11T00:24:35.801 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:35.801 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T00:24:35.801 INFO:teuthology.orchestra.run.smithi040.stdout: "auth_dump": [ 2024-09-11T00:24:35.802 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.802 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.a", 2024-09-11T00:24:35.802 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDV4uBmLFOvKhAAb1cFmpm1U1fm8MLXxXUPcQ==", 2024-09-11T00:24:35.802 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.802 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-09-11T00:24:35.802 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2024-09-11T00:24:35.802 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2024-09-11T00:24:35.802 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-11T00:24:35.802 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.802 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.802 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.803 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.b", 2024-09-11T00:24:35.803 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDW4uBmcfq7AhAAG2MquPDLPdnjl0gQuW2lSQ==", 2024-09-11T00:24:35.803 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.803 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-09-11T00:24:35.803 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2024-09-11T00:24:35.803 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2024-09-11T00:24:35.803 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-11T00:24:35.803 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.803 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.804 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.804 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.c", 2024-09-11T00:24:35.804 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDV4uBmUQ2ENBAA0hmk6g0a2Xom4gt2LTr8dA==", 2024-09-11T00:24:35.804 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.804 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-09-11T00:24:35.804 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2024-09-11T00:24:35.804 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2024-09-11T00:24:35.804 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-11T00:24:35.804 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.804 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.804 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.804 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.d", 2024-09-11T00:24:35.805 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDW4uBmUcKUDBAAv0bR7JPrKbIlni/IqRmfjg==", 2024-09-11T00:24:35.805 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.805 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-09-11T00:24:35.805 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2024-09-11T00:24:35.805 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2024-09-11T00:24:35.805 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-11T00:24:35.805 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.805 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.805 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.805 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.0", 2024-09-11T00:24:35.806 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDZ4uBmZZ9jHxAA+f3rLsxL2dvFgq7tN4tf0A==", 2024-09-11T00:24:35.806 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.806 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-09-11T00:24:35.806 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-09-11T00:24:35.806 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-11T00:24:35.806 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.806 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.806 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.806 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.1", 2024-09-11T00:24:35.806 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDc4uBm8V0uKxAAw4WYTHgOlO4SmPbwv4FtZg==", 2024-09-11T00:24:35.806 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.807 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-09-11T00:24:35.807 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-09-11T00:24:35.807 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-11T00:24:35.807 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.807 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.807 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.807 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.2", 2024-09-11T00:24:35.807 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDf4uBmTBweNhAAfa3ZEjKtk/gux+P/AQcgtw==", 2024-09-11T00:24:35.807 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.807 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-09-11T00:24:35.807 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-09-11T00:24:35.808 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-11T00:24:35.808 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.808 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.808 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.808 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.3", 2024-09-11T00:24:35.808 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDj4uBm5DoRBRAAIBfqSduZ0i/yWK4VmfBJlg==", 2024-09-11T00:24:35.808 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.808 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-09-11T00:24:35.808 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-09-11T00:24:35.808 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-11T00:24:35.808 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.809 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.809 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.809 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.4", 2024-09-11T00:24:35.809 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDp4uBmFlkRBhAAJThnT6u+bsgrgcxNajL+ag==", 2024-09-11T00:24:35.809 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.809 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-09-11T00:24:35.809 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-09-11T00:24:35.809 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-11T00:24:35.809 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.809 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.809 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.810 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.5", 2024-09-11T00:24:35.810 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDs4uBmSWpsHhAA9Nxa99BKw86VppOt5lcyvA==", 2024-09-11T00:24:35.810 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.810 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-09-11T00:24:35.810 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-09-11T00:24:35.810 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-11T00:24:35.810 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.810 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.810 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.810 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.6", 2024-09-11T00:24:35.810 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDv4uBmu6ePKBAA3Dsf28//S4DRnEfsqijC3A==", 2024-09-11T00:24:35.810 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.810 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-09-11T00:24:35.810 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-09-11T00:24:35.811 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-11T00:24:35.811 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.811 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.811 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.811 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.7", 2024-09-11T00:24:35.811 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDz4uBmJpOvBRAA860ItKmw0vHPT9j6sclQIw==", 2024-09-11T00:24:35.811 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.811 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-09-11T00:24:35.811 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-09-11T00:24:35.811 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-11T00:24:35.811 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.811 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.811 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.811 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.0", 2024-09-11T00:24:35.812 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDW4uBmjUo6FRAAR+2yK++OAaoLfSv+n2079Q==", 2024-09-11T00:24:35.812 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.812 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-09-11T00:24:35.812 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2024-09-11T00:24:35.812 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2024-09-11T00:24:35.812 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2024-09-11T00:24:35.812 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.812 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.812 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.812 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.1", 2024-09-11T00:24:35.813 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDW4uBm8dpDIhAAiF6QGXV6aVwkj7YjPW1ZtA==", 2024-09-11T00:24:35.813 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.813 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-09-11T00:24:35.813 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2024-09-11T00:24:35.813 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2024-09-11T00:24:35.813 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2024-09-11T00:24:35.813 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.813 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.813 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.813 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.2", 2024-09-11T00:24:35.813 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDW4uBmnE+5GxAAVuwA93riifhk4+FvqU5N1Q==", 2024-09-11T00:24:35.813 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.813 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-09-11T00:24:35.814 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2024-09-11T00:24:35.814 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2024-09-11T00:24:35.814 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2024-09-11T00:24:35.814 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.814 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.814 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.814 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.3", 2024-09-11T00:24:35.814 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDW4uBm+uWnKBAAuSy+KvI5JhtSuMHhM6imsw==", 2024-09-11T00:24:35.814 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.815 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-09-11T00:24:35.815 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2024-09-11T00:24:35.815 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2024-09-11T00:24:35.815 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2024-09-11T00:24:35.815 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.815 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.815 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.815 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.admin", 2024-09-11T00:24:35.815 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDU4uBmfu7SNhAAv0WuGj2MGv89ma/A4LvtaQ==", 2024-09-11T00:24:35.816 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.816 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2024-09-11T00:24:35.816 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2024-09-11T00:24:35.816 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2024-09-11T00:24:35.816 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-11T00:24:35.816 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.816 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.816 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.816 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-mds", 2024-09-11T00:24:35.816 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD64uBmrByQHhAAMZKRpW4zudSRTER+0OF6MQ==", 2024-09-11T00:24:35.817 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.817 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-mds" 2024-09-11T00:24:35.817 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.817 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.817 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.817 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-mgr", 2024-09-11T00:24:35.817 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD64uBmnCyQHhAAzAmJNAsKidRS3BAew9jgCQ==", 2024-09-11T00:24:35.817 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.817 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-11T00:24:35.817 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.817 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.817 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.817 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-osd", 2024-09-11T00:24:35.818 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD64uBmHkCQHhAAKkqHwz8h73S3QaR2p2MHyA==", 2024-09-11T00:24:35.818 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.818 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-osd" 2024-09-11T00:24:35.818 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.818 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.818 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.818 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rbd", 2024-09-11T00:24:35.818 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD64uBmKU+QHhAAl3wYHw1hm3oILz8POQiFVg==", 2024-09-11T00:24:35.818 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.818 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-11T00:24:35.818 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.818 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.818 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.818 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-11T00:24:35.819 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD64uBmi12QHhAAJoLHyKVnjGVKKzlCDY8x6w==", 2024-09-11T00:24:35.819 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.819 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-11T00:24:35.819 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.819 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.819 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.819 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rgw", 2024-09-11T00:24:35.819 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD64uBmT2yQHhAAZoWSc7eIze2OJo+a/aaUdA==", 2024-09-11T00:24:35.819 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.819 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-11T00:24:35.819 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.819 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.819 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.820 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.x", 2024-09-11T00:24:35.820 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDV4uBmVJUPJBAAeehcDZVCcpiiYtFBIo0ePA==", 2024-09-11T00:24:35.820 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.820 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2024-09-11T00:24:35.820 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2024-09-11T00:24:35.820 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-11T00:24:35.820 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.820 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:35.820 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:35.820 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.y", 2024-09-11T00:24:35.820 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDV4uBmZHwAHRAAaV9xFq8CBsynQaq38qysrg==", 2024-09-11T00:24:35.820 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-11T00:24:35.820 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2024-09-11T00:24:35.821 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2024-09-11T00:24:35.821 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-11T00:24:35.821 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.821 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:35.821 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-09-11T00:24:35.821 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T00:24:35.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.800+0000 7ff728e00640 1 -- 172.21.15.40:0/3301487931 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff704077f70 msgr2=0x7ff70407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:35.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.800+0000 7ff728e00640 1 --2- 172.21.15.40:0/3301487931 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff704077f70 0x7ff70407a430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff714033000 tx=0x7ff714004730 comp rx=0 tx=0).stop 2024-09-11T00:24:35.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.800+0000 7ff728e00640 1 -- 172.21.15.40:0/3301487931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff72415ec70 msgr2=0x7ff7241573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:35.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.800+0000 7ff728e00640 1 --2- 172.21.15.40:0/3301487931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff72415ec70 0x7ff7241573f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff71000e7c0 tx=0x7ff71000ec80 comp rx=0 tx=0).stop 2024-09-11T00:24:35.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.801+0000 7ff728e00640 1 -- 172.21.15.40:0/3301487931 shutdown_connections 2024-09-11T00:24:35.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.801+0000 7ff728e00640 1 --2- 172.21.15.40:0/3301487931 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff704077f70 0x7ff70407a430 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:35.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.801+0000 7ff728e00640 1 --2- 172.21.15.40:0/3301487931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff72415f050 0x7ff7240b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:35.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.801+0000 7ff728e00640 1 --2- 172.21.15.40:0/3301487931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff72415ec70 0x7ff7241573f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:35.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.801+0000 7ff728e00640 1 --2- 172.21.15.40:0/3301487931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7240cd780 0x7ff724153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:35.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.801+0000 7ff728e00640 1 -- 172.21.15.40:0/3301487931 >> 172.21.15.40:0/3301487931 conn(0x7ff7240cfbb0 msgr2=0x7ff724154040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:35.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.801+0000 7ff728e00640 1 -- 172.21.15.40:0/3301487931 shutdown_connections 2024-09-11T00:24:35.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.801+0000 7ff728e00640 1 -- 172.21.15.40:0/3301487931 wait complete. 2024-09-11T00:24:35.824 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-11T00:24:35.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.984+0000 7f0644000640 1 -- 172.21.15.40:0/652529564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0624004800 msgr2=0x7f0624004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:36.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.984+0000 7f0644000640 1 --2- 172.21.15.40:0/652529564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0624004800 0x7f0624004c80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0628009b50 tx=0x7f0624005830 comp rx=0 tx=0).stop 2024-09-11T00:24:36.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.984+0000 7f0644000640 1 -- 172.21.15.40:0/652529564 shutdown_connections 2024-09-11T00:24:36.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.984+0000 7f0644000640 1 --2- 172.21.15.40:0/652529564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0624004800 0x7f0624004c80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:36.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.984+0000 7f0644000640 1 -- 172.21.15.40:0/652529564 >> 172.21.15.40:0/652529564 conn(0x7f063c0cfbb0 msgr2=0x7f063c0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:36.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.984+0000 7f0644000640 1 -- 172.21.15.40:0/652529564 shutdown_connections 2024-09-11T00:24:36.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.984+0000 7f0644000640 1 -- 172.21.15.40:0/652529564 wait complete. 2024-09-11T00:24:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.986+0000 7f0644000640 1 Processor -- start 2024-09-11T00:24:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.986+0000 7f0644000640 1 -- start start 2024-09-11T00:24:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.987+0000 7f0644000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0624004800 0x7f063c155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.987+0000 7f0644000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f063c155b30 0x7f063c1f8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.987+0000 7f0644000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f063c151d40 0x7f063c072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.987+0000 7f0644000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f063c0cdd30 con 0x7f063c151d40 2024-09-11T00:24:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.987+0000 7f0644000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f063c0cdbb0 con 0x7f0624004800 2024-09-11T00:24:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.987+0000 7f0644000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f063c0cdeb0 con 0x7f063c155b30 2024-09-11T00:24:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.987+0000 7f0642000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f063c151d40 0x7f063c072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.987+0000 7f0642000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f063c151d40 0x7f063c072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48008/0 (socket says 172.21.15.40:48008) 2024-09-11T00:24:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.987+0000 7f0642000640 1 -- 172.21.15.40:0/2011749610 learned_addr learned my addr 172.21.15.40:0/2011749610 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:36.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.988+0000 7f0641600640 1 --2- 172.21.15.40:0/2011749610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0624004800 0x7f063c155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:36.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.988+0000 7f0642000640 1 -- 172.21.15.40:0/2011749610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f063c155b30 msgr2=0x7f063c1f8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:36.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.988+0000 7f0642000640 1 --2- 172.21.15.40:0/2011749610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f063c155b30 0x7f063c1f8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:36.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.988+0000 7f0642000640 1 -- 172.21.15.40:0/2011749610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0624004800 msgr2=0x7f063c155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:36.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.988+0000 7f0642000640 1 --2- 172.21.15.40:0/2011749610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0624004800 0x7f063c155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:36.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.988+0000 7f0642000640 1 -- 172.21.15.40:0/2011749610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063c0c9800 con 0x7f063c151d40 2024-09-11T00:24:36.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.988+0000 7f0641600640 1 --2- 172.21.15.40:0/2011749610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0624004800 0x7f063c155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:36.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.988+0000 7f0642000640 1 --2- 172.21.15.40:0/2011749610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f063c151d40 0x7f063c072de0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f063c0d0cb0 tx=0x7f06340019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:36.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.988+0000 7f0639600640 1 -- 172.21.15.40:0/2011749610 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634015020 con 0x7f063c151d40 2024-09-11T00:24:36.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.988+0000 7f0639600640 1 -- 172.21.15.40:0/2011749610 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0634011960 con 0x7f063c151d40 2024-09-11T00:24:36.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.988+0000 7f0639600640 1 -- 172.21.15.40:0/2011749610 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634011d90 con 0x7f063c151d40 2024-09-11T00:24:36.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.988+0000 7f0644000640 1 -- 172.21.15.40:0/2011749610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f063c0c9ae0 con 0x7f063c151d40 2024-09-11T00:24:36.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.988+0000 7f0644000640 1 -- 172.21.15.40:0/2011749610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f063c15d460 con 0x7f063c151d40 2024-09-11T00:24:36.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.989+0000 7f0644000640 1 -- 172.21.15.40:0/2011749610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f063c0ad910 con 0x7f063c151d40 2024-09-11T00:24:36.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.990+0000 7f0639600640 1 -- 172.21.15.40:0/2011749610 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f063401a400 con 0x7f063c151d40 2024-09-11T00:24:36.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.992+0000 7f0639600640 1 --2- 172.21.15.40:0/2011749610 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f061c077f70 0x7f061c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:36.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.992+0000 7f0639600640 1 -- 172.21.15.40:0/2011749610 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f063409a780 con 0x7f063c151d40 2024-09-11T00:24:36.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.992+0000 7f0641600640 1 --2- 172.21.15.40:0/2011749610 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f061c077f70 0x7f061c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:36.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.993+0000 7f0641600640 1 --2- 172.21.15.40:0/2011749610 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f061c077f70 0x7f061c07a430 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0630001860 tx=0x7f0630000ed0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:36.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:35.996+0000 7f0639600640 1 -- 172.21.15.40:0/2011749610 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f063401f020 con 0x7f063c151d40 2024-09-11T00:24:36.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.263+0000 7f0644000640 1 -- 172.21.15.40:0/2011749610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f063c154c90 con 0x7f063c151d40 2024-09-11T00:24:36.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.265+0000 7f0639600640 1 -- 172.21.15.40:0/2011749610 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7f0634063680 con 0x7f063c151d40 2024-09-11T00:24:36.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.268+0000 7f0644000640 1 -- 172.21.15.40:0/2011749610 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f061c077f70 msgr2=0x7f061c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:36.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.269+0000 7f0644000640 1 --2- 172.21.15.40:0/2011749610 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f061c077f70 0x7f061c07a430 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0630001860 tx=0x7f0630000ed0 comp rx=0 tx=0).stop 2024-09-11T00:24:36.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.269+0000 7f0644000640 1 -- 172.21.15.40:0/2011749610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f063c151d40 msgr2=0x7f063c072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:36.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.269+0000 7f0644000640 1 --2- 172.21.15.40:0/2011749610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f063c151d40 0x7f063c072de0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f063c0d0cb0 tx=0x7f06340019b0 comp rx=0 tx=0).stop 2024-09-11T00:24:36.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.269+0000 7f0644000640 1 -- 172.21.15.40:0/2011749610 shutdown_connections 2024-09-11T00:24:36.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.269+0000 7f0644000640 1 --2- 172.21.15.40:0/2011749610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f063c151d40 0x7f063c072de0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:36.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.269+0000 7f0644000640 1 --2- 172.21.15.40:0/2011749610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f063c155b30 0x7f063c1f8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:36.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.269+0000 7f0644000640 1 --2- 172.21.15.40:0/2011749610 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f061c077f70 0x7f061c07a430 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:36.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.269+0000 7f0644000640 1 --2- 172.21.15.40:0/2011749610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0624004800 0x7f063c155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:36.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.269+0000 7f0644000640 1 -- 172.21.15.40:0/2011749610 >> 172.21.15.40:0/2011749610 conn(0x7f063c0cfbb0 msgr2=0x7f063c153f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:36.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.269+0000 7f0644000640 1 -- 172.21.15.40:0/2011749610 shutdown_connections 2024-09-11T00:24:36.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.269+0000 7f0644000640 1 -- 172.21.15.40:0/2011749610 wait complete. 2024-09-11T00:24:36.745 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-11T00:24:36.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.906+0000 7fe391600640 1 -- 172.21.15.40:0/3275722356 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe38c15a410 msgr2=0x7fe38c0724f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:36.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.906+0000 7fe391600640 1 --2- 172.21.15.40:0/3275722356 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe38c15a410 0x7fe38c0724f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe378005fd0 tx=0x7fe37802b8f0 comp rx=0 tx=0).stop 2024-09-11T00:24:36.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.906+0000 7fe391600640 1 -- 172.21.15.40:0/3275722356 shutdown_connections 2024-09-11T00:24:36.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.906+0000 7fe391600640 1 --2- 172.21.15.40:0/3275722356 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe38c15a410 0x7fe38c0724f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:36.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.906+0000 7fe391600640 1 --2- 172.21.15.40:0/3275722356 >> v2:172.21.15.175:3300/0 conn(0x7fe38c0ca350 0x7fe38c0ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:36.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.906+0000 7fe391600640 1 -- 172.21.15.40:0/3275722356 >> 172.21.15.40:0/3275722356 conn(0x7fe38c0cfbb0 msgr2=0x7fe38c0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:36.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.906+0000 7fe391600640 1 -- 172.21.15.40:0/3275722356 shutdown_connections 2024-09-11T00:24:36.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.906+0000 7fe391600640 1 -- 172.21.15.40:0/3275722356 wait complete. 2024-09-11T00:24:36.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.907+0000 7fe391600640 1 Processor -- start 2024-09-11T00:24:36.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.908+0000 7fe391600640 1 -- start start 2024-09-11T00:24:36.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.908+0000 7fe391600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe38c0ca350 0x7fe38c15e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:36.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.908+0000 7fe391600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe38c0d06d0 0x7fe38c1e65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:36.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.908+0000 7fe391600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe38c15a410 0x7fe38c1fc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:36.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.908+0000 7fe391600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe38c15def0 con 0x7fe38c0ca350 2024-09-11T00:24:36.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.908+0000 7fe391600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe38c15dd70 con 0x7fe38c0d06d0 2024-09-11T00:24:36.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.908+0000 7fe391600640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe38c15e070 con 0x7fe38c15a410 2024-09-11T00:24:36.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.909+0000 7fe38aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe38c0ca350 0x7fe38c15e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:36.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.909+0000 7fe38aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe38c0ca350 0x7fe38c15e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48022/0 (socket says 172.21.15.40:48022) 2024-09-11T00:24:36.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.909+0000 7fe38aa00640 1 -- 172.21.15.40:0/1734586814 learned_addr learned my addr 172.21.15.40:0/1734586814 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:36.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.909+0000 7fe38a000640 1 --2- 172.21.15.40:0/1734586814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe38c0d06d0 0x7fe38c1e65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:36.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.909+0000 7fe38b400640 1 --2- 172.21.15.40:0/1734586814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe38c15a410 0x7fe38c1fc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:36.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.909+0000 7fe38aa00640 1 -- 172.21.15.40:0/1734586814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe38c15a410 msgr2=0x7fe38c1fc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:36.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.909+0000 7fe38aa00640 1 --2- 172.21.15.40:0/1734586814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe38c15a410 0x7fe38c1fc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:36.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.909+0000 7fe38aa00640 1 -- 172.21.15.40:0/1734586814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe38c0d06d0 msgr2=0x7fe38c1e65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:36.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.909+0000 7fe38aa00640 1 --2- 172.21.15.40:0/1734586814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe38c0d06d0 0x7fe38c1e65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:36.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.909+0000 7fe38aa00640 1 -- 172.21.15.40:0/1734586814 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38c0b5680 con 0x7fe38c0ca350 2024-09-11T00:24:36.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.910+0000 7fe38aa00640 1 --2- 172.21.15.40:0/1734586814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe38c0ca350 0x7fe38c15e490 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00e790 tx=0x7fe37c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:36.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.910+0000 7fe382a00640 1 -- 172.21.15.40:0/1734586814 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37c00eea0 con 0x7fe38c0ca350 2024-09-11T00:24:36.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.910+0000 7fe382a00640 1 -- 172.21.15.40:0/1734586814 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe37c00cdb0 con 0x7fe38c0ca350 2024-09-11T00:24:36.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.910+0000 7fe382a00640 1 -- 172.21.15.40:0/1734586814 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37c010690 con 0x7fe38c0ca350 2024-09-11T00:24:36.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.910+0000 7fe391600640 1 -- 172.21.15.40:0/1734586814 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe38c0b2c30 con 0x7fe38c0ca350 2024-09-11T00:24:36.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.910+0000 7fe391600640 1 -- 172.21.15.40:0/1734586814 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe38c0b31f0 con 0x7fe38c0ca350 2024-09-11T00:24:36.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.911+0000 7fe391600640 1 -- 172.21.15.40:0/1734586814 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe38c0cf500 con 0x7fe38c0ca350 2024-09-11T00:24:36.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.912+0000 7fe382a00640 1 -- 172.21.15.40:0/1734586814 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe37c010830 con 0x7fe38c0ca350 2024-09-11T00:24:36.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.913+0000 7fe382a00640 1 --2- 172.21.15.40:0/1734586814 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe36c077f70 0x7fe36c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:36.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.913+0000 7fe382a00640 1 -- 172.21.15.40:0/1734586814 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7fe37c09a3a0 con 0x7fe38c0ca350 2024-09-11T00:24:36.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.914+0000 7fe38a000640 1 --2- 172.21.15.40:0/1734586814 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe36c077f70 0x7fe36c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:36.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.915+0000 7fe38a000640 1 --2- 172.21.15.40:0/1734586814 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe36c077f70 0x7fe36c07a430 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe378035000 tx=0x7fe378004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:36.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:36.917+0000 7fe382a00640 1 -- 172.21.15.40:0/1734586814 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe37c062b90 con 0x7fe38c0ca350 2024-09-11T00:24:37.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.187+0000 7fe391600640 1 -- 172.21.15.40:0/1734586814 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fe38c0b5b30 con 0x7fe38c0ca350 2024-09-11T00:24:37.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.189+0000 7fe382a00640 1 -- 172.21.15.40:0/1734586814 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7fe37c0675c0 con 0x7fe38c0ca350 2024-09-11T00:24:37.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.192+0000 7fe391600640 1 -- 172.21.15.40:0/1734586814 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe36c077f70 msgr2=0x7fe36c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:37.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.192+0000 7fe391600640 1 --2- 172.21.15.40:0/1734586814 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe36c077f70 0x7fe36c07a430 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe378035000 tx=0x7fe378004730 comp rx=0 tx=0).stop 2024-09-11T00:24:37.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.192+0000 7fe391600640 1 -- 172.21.15.40:0/1734586814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe38c0ca350 msgr2=0x7fe38c15e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:37.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.192+0000 7fe391600640 1 --2- 172.21.15.40:0/1734586814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe38c0ca350 0x7fe38c15e490 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00e790 tx=0x7fe37c00ec50 comp rx=0 tx=0).stop 2024-09-11T00:24:37.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.192+0000 7fe391600640 1 -- 172.21.15.40:0/1734586814 shutdown_connections 2024-09-11T00:24:37.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.192+0000 7fe391600640 1 --2- 172.21.15.40:0/1734586814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe38c15a410 0x7fe38c1fc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:37.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.192+0000 7fe391600640 1 --2- 172.21.15.40:0/1734586814 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe36c077f70 0x7fe36c07a430 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:37.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.193+0000 7fe391600640 1 --2- 172.21.15.40:0/1734586814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe38c0d06d0 0x7fe38c1e65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:37.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.193+0000 7fe391600640 1 --2- 172.21.15.40:0/1734586814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe38c0ca350 0x7fe38c15e490 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:37.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.193+0000 7fe391600640 1 -- 172.21.15.40:0/1734586814 >> 172.21.15.40:0/1734586814 conn(0x7fe38c0cfbb0 msgr2=0x7fe38c156eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:37.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.193+0000 7fe391600640 1 -- 172.21.15.40:0/1734586814 shutdown_connections 2024-09-11T00:24:37.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.193+0000 7fe391600640 1 -- 172.21.15.40:0/1734586814 wait complete. 2024-09-11T00:24:37.211 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-11T00:24:37.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.370+0000 7fa12d000640 1 -- 172.21.15.40:0/1835342428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa12815e100 msgr2=0x7fa12815ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:37.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.370+0000 7fa12d000640 1 --2- 172.21.15.40:0/1835342428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa12815e100 0x7fa12815ba60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa1280cc5d0 tx=0x7fa11802a560 comp rx=0 tx=0).stop 2024-09-11T00:24:37.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.370+0000 7fa12d000640 1 -- 172.21.15.40:0/1835342428 shutdown_connections 2024-09-11T00:24:37.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.370+0000 7fa12d000640 1 --2- 172.21.15.40:0/1835342428 >> v2:172.21.15.175:3300/0 conn(0x7fa12815c3b0 0x7fa1280ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:37.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.370+0000 7fa12d000640 1 --2- 172.21.15.40:0/1835342428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa12815e100 0x7fa12815ba60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:37.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.370+0000 7fa12d000640 1 -- 172.21.15.40:0/1835342428 >> 172.21.15.40:0/1835342428 conn(0x7fa1280cfbb0 msgr2=0x7fa1280cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:37.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.370+0000 7fa12d000640 1 -- 172.21.15.40:0/1835342428 shutdown_connections 2024-09-11T00:24:37.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.370+0000 7fa12d000640 1 -- 172.21.15.40:0/1835342428 wait complete. 2024-09-11T00:24:37.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.372+0000 7fa12d000640 1 Processor -- start 2024-09-11T00:24:37.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.372+0000 7fa12d000640 1 -- start start 2024-09-11T00:24:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.373+0000 7fa12d000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1280cae90 0x7fa1280c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.373+0000 7fa12d000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa12815c3b0 0x7fa128154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.373+0000 7fa12d000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa12815e100 0x7fa1281f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.373+0000 7fa12d000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa12815ece0 con 0x7fa12815e100 2024-09-11T00:24:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.373+0000 7fa12d000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa1280ca410 con 0x7fa1280cae90 2024-09-11T00:24:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.373+0000 7fa12d000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa12815ee60 con 0x7fa12815c3b0 2024-09-11T00:24:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.373+0000 7fa126800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa12815e100 0x7fa1281f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.373+0000 7fa126800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa12815e100 0x7fa1281f5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48052/0 (socket says 172.21.15.40:48052) 2024-09-11T00:24:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.373+0000 7fa126800640 1 -- 172.21.15.40:0/2391271673 learned_addr learned my addr 172.21.15.40:0/2391271673 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.373+0000 7fa125e00640 1 --2- 172.21.15.40:0/2391271673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1280cae90 0x7fa1280c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.373+0000 7fa11d400640 1 --2- 172.21.15.40:0/2391271673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa12815c3b0 0x7fa128154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.373+0000 7fa126800640 1 -- 172.21.15.40:0/2391271673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa12815c3b0 msgr2=0x7fa128154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.373+0000 7fa126800640 1 --2- 172.21.15.40:0/2391271673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa12815c3b0 0x7fa128154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.373+0000 7fa126800640 1 -- 172.21.15.40:0/2391271673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1280cae90 msgr2=0x7fa1280c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.373+0000 7fa126800640 1 --2- 172.21.15.40:0/2391271673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1280cae90 0x7fa1280c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.373+0000 7fa126800640 1 -- 172.21.15.40:0/2391271673 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1280c6940 con 0x7fa12815e100 2024-09-11T00:24:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.374+0000 7fa126800640 1 --2- 172.21.15.40:0/2391271673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa12815e100 0x7fa1281f5360 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa12000b970 tx=0x7fa12000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:37.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.374+0000 7fa11ea00640 1 -- 172.21.15.40:0/2391271673 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa120019070 con 0x7fa12815e100 2024-09-11T00:24:37.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.374+0000 7fa11ea00640 1 -- 172.21.15.40:0/2391271673 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa12000cc30 con 0x7fa12815e100 2024-09-11T00:24:37.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.374+0000 7fa12d000640 1 -- 172.21.15.40:0/2391271673 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1280b34f0 con 0x7fa12815e100 2024-09-11T00:24:37.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.374+0000 7fa11ea00640 1 -- 172.21.15.40:0/2391271673 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1200146a0 con 0x7fa12815e100 2024-09-11T00:24:37.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.374+0000 7fa12d000640 1 -- 172.21.15.40:0/2391271673 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1281f4e40 con 0x7fa12815e100 2024-09-11T00:24:37.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.375+0000 7fa12d000640 1 -- 172.21.15.40:0/2391271673 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa12815f3c0 con 0x7fa12815e100 2024-09-11T00:24:37.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.376+0000 7fa11ea00640 1 -- 172.21.15.40:0/2391271673 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa12001e440 con 0x7fa12815e100 2024-09-11T00:24:37.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.377+0000 7fa11ea00640 1 --2- 172.21.15.40:0/2391271673 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa104077fa0 0x7fa10407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:37.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.377+0000 7fa11ea00640 1 -- 172.21.15.40:0/2391271673 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7fa120099930 con 0x7fa12815e100 2024-09-11T00:24:37.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.378+0000 7fa125e00640 1 --2- 172.21.15.40:0/2391271673 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa104077fa0 0x7fa10407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:37.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.379+0000 7fa125e00640 1 --2- 172.21.15.40:0/2391271673 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa104077fa0 0x7fa10407a460 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa118033000 tx=0x7fa118004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.381+0000 7fa11ea00640 1 -- 172.21.15.40:0/2391271673 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa1280c6940 con 0x7fa12815e100 2024-09-11T00:24:37.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.648+0000 7fa12d000640 1 -- 172.21.15.40:0/2391271673 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fa1280b5b30 con 0x7fa12815e100 2024-09-11T00:24:37.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.651+0000 7fa11ea00640 1 -- 172.21.15.40:0/2391271673 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fa120062780 con 0x7fa12815e100 2024-09-11T00:24:37.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.654+0000 7fa12d000640 1 -- 172.21.15.40:0/2391271673 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa104077fa0 msgr2=0x7fa10407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:37.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.654+0000 7fa12d000640 1 --2- 172.21.15.40:0/2391271673 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa104077fa0 0x7fa10407a460 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa118033000 tx=0x7fa118004730 comp rx=0 tx=0).stop 2024-09-11T00:24:37.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.654+0000 7fa12d000640 1 -- 172.21.15.40:0/2391271673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa12815e100 msgr2=0x7fa1281f5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:37.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.654+0000 7fa12d000640 1 --2- 172.21.15.40:0/2391271673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa12815e100 0x7fa1281f5360 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa12000b970 tx=0x7fa12000be30 comp rx=0 tx=0).stop 2024-09-11T00:24:37.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.654+0000 7fa12d000640 1 -- 172.21.15.40:0/2391271673 shutdown_connections 2024-09-11T00:24:37.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.654+0000 7fa12d000640 1 --2- 172.21.15.40:0/2391271673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa12815e100 0x7fa1281f5360 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:37.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.654+0000 7fa12d000640 1 --2- 172.21.15.40:0/2391271673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa12815c3b0 0x7fa128154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:37.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.654+0000 7fa12d000640 1 --2- 172.21.15.40:0/2391271673 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa104077fa0 0x7fa10407a460 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:37.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.654+0000 7fa12d000640 1 --2- 172.21.15.40:0/2391271673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1280cae90 0x7fa1280c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:37.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.654+0000 7fa12d000640 1 -- 172.21.15.40:0/2391271673 >> 172.21.15.40:0/2391271673 conn(0x7fa1280cfbb0 msgr2=0x7fa1280af760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:37.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.654+0000 7fa12d000640 1 -- 172.21.15.40:0/2391271673 shutdown_connections 2024-09-11T00:24:37.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.654+0000 7fa12d000640 1 -- 172.21.15.40:0/2391271673 wait complete. 2024-09-11T00:24:37.671 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-11T00:24:37.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.829+0000 7efe59000640 1 -- 172.21.15.40:0/2006566924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe5415e100 msgr2=0x7efe5415ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:37.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.829+0000 7efe59000640 1 --2- 172.21.15.40:0/2006566924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe5415e100 0x7efe5415ba60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efe540cc5d0 tx=0x7efe4402a560 comp rx=0 tx=0).stop 2024-09-11T00:24:37.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.829+0000 7efe59000640 1 -- 172.21.15.40:0/2006566924 shutdown_connections 2024-09-11T00:24:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.829+0000 7efe59000640 1 --2- 172.21.15.40:0/2006566924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe540cae90 0x7efe5415e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.829+0000 7efe59000640 1 --2- 172.21.15.40:0/2006566924 >> v2:172.21.15.175:3300/0 conn(0x7efe5415c3b0 0x7efe540ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.829+0000 7efe59000640 1 --2- 172.21.15.40:0/2006566924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe5415e100 0x7efe5415ba60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.829+0000 7efe59000640 1 -- 172.21.15.40:0/2006566924 >> 172.21.15.40:0/2006566924 conn(0x7efe540cfbb0 msgr2=0x7efe540cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.830+0000 7efe59000640 1 -- 172.21.15.40:0/2006566924 shutdown_connections 2024-09-11T00:24:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.830+0000 7efe59000640 1 -- 172.21.15.40:0/2006566924 wait complete. 2024-09-11T00:24:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.831+0000 7efe59000640 1 Processor -- start 2024-09-11T00:24:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.831+0000 7efe59000640 1 -- start start 2024-09-11T00:24:37.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.832+0000 7efe59000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe540cae90 0x7efe54155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.832+0000 7efe59000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe5415c3b0 0x7efe540b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.832+0000 7efe59000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe5415e100 0x7efe54157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.832+0000 7efe59000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efe5415eb10 con 0x7efe540cae90 2024-09-11T00:24:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.832+0000 7efe59000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efe540ca410 con 0x7efe5415c3b0 2024-09-11T00:24:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.832+0000 7efe59000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efe5415ec90 con 0x7efe5415e100 2024-09-11T00:24:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.832+0000 7efe51e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe540cae90 0x7efe54155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.832+0000 7efe51e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe540cae90 0x7efe54155ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42096/0 (socket says 172.21.15.40:42096) 2024-09-11T00:24:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.832+0000 7efe51e00640 1 -- 172.21.15.40:0/1296449005 learned_addr learned my addr 172.21.15.40:0/1296449005 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.833+0000 7efe4be00640 1 --2- 172.21.15.40:0/1296449005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe5415c3b0 0x7efe540b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.833+0000 7efe52800640 1 --2- 172.21.15.40:0/1296449005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe5415e100 0x7efe54157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.833+0000 7efe51e00640 1 -- 172.21.15.40:0/1296449005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe5415e100 msgr2=0x7efe54157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.833+0000 7efe51e00640 1 --2- 172.21.15.40:0/1296449005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe5415e100 0x7efe54157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.833+0000 7efe51e00640 1 -- 172.21.15.40:0/1296449005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe5415c3b0 msgr2=0x7efe540b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:37.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.833+0000 7efe51e00640 1 --2- 172.21.15.40:0/1296449005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe5415c3b0 0x7efe540b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:37.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.833+0000 7efe51e00640 1 -- 172.21.15.40:0/1296449005 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe54156320 con 0x7efe540cae90 2024-09-11T00:24:37.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.833+0000 7efe51e00640 1 --2- 172.21.15.40:0/1296449005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe540cae90 0x7efe54155ab0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efe44009850 tx=0x7efe44003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:37.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.834+0000 7efe4a000640 1 -- 172.21.15.40:0/1296449005 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4403f070 con 0x7efe540cae90 2024-09-11T00:24:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.834+0000 7efe4a000640 1 -- 172.21.15.40:0/1296449005 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe440047a0 con 0x7efe540cae90 2024-09-11T00:24:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.834+0000 7efe4a000640 1 -- 172.21.15.40:0/1296449005 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe44035030 con 0x7efe540cae90 2024-09-11T00:24:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.834+0000 7efe59000640 1 -- 172.21.15.40:0/1296449005 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe54073fe0 con 0x7efe540cae90 2024-09-11T00:24:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.834+0000 7efe59000640 1 -- 172.21.15.40:0/1296449005 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe540b4fa0 con 0x7efe540cae90 2024-09-11T00:24:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.835+0000 7efe59000640 1 -- 172.21.15.40:0/1296449005 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe5415f220 con 0x7efe540cae90 2024-09-11T00:24:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.836+0000 7efe4a000640 1 -- 172.21.15.40:0/1296449005 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7efe44004bb0 con 0x7efe540cae90 2024-09-11T00:24:37.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.837+0000 7efe4a000640 1 --2- 172.21.15.40:0/1296449005 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7efe30077f70 0x7efe3007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:37.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.837+0000 7efe4a000640 1 -- 172.21.15.40:0/1296449005 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7efe440bab00 con 0x7efe540cae90 2024-09-11T00:24:37.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.837+0000 7efe4be00640 1 --2- 172.21.15.40:0/1296449005 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7efe30077f70 0x7efe3007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:37.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.838+0000 7efe4be00640 1 --2- 172.21.15.40:0/1296449005 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7efe30077f70 0x7efe3007a430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efe540c9e60 tx=0x7efe3c00b390 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:37.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:37.841+0000 7efe4a000640 1 -- 172.21.15.40:0/1296449005 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7efe440832f0 con 0x7efe540cae90 2024-09-11T00:24:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.106+0000 7efe59000640 1 -- 172.21.15.40:0/1296449005 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7efe540747b0 con 0x7efe540cae90 2024-09-11T00:24:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.109+0000 7efe4a000640 1 -- 172.21.15.40:0/1296449005 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7efe44087d20 con 0x7efe540cae90 2024-09-11T00:24:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.112+0000 7efe59000640 1 -- 172.21.15.40:0/1296449005 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7efe30077f70 msgr2=0x7efe3007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.112+0000 7efe59000640 1 --2- 172.21.15.40:0/1296449005 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7efe30077f70 0x7efe3007a430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efe540c9e60 tx=0x7efe3c00b390 comp rx=0 tx=0).stop 2024-09-11T00:24:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.112+0000 7efe59000640 1 -- 172.21.15.40:0/1296449005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe540cae90 msgr2=0x7efe54155ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.112+0000 7efe59000640 1 --2- 172.21.15.40:0/1296449005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe540cae90 0x7efe54155ab0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efe44009850 tx=0x7efe44003910 comp rx=0 tx=0).stop 2024-09-11T00:24:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.112+0000 7efe59000640 1 -- 172.21.15.40:0/1296449005 shutdown_connections 2024-09-11T00:24:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.112+0000 7efe59000640 1 --2- 172.21.15.40:0/1296449005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe5415e100 0x7efe54157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.112+0000 7efe59000640 1 --2- 172.21.15.40:0/1296449005 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7efe30077f70 0x7efe3007a430 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.112+0000 7efe59000640 1 --2- 172.21.15.40:0/1296449005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe5415c3b0 0x7efe540b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.112+0000 7efe59000640 1 --2- 172.21.15.40:0/1296449005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe540cae90 0x7efe54155ab0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.112+0000 7efe59000640 1 -- 172.21.15.40:0/1296449005 >> 172.21.15.40:0/1296449005 conn(0x7efe540cfbb0 msgr2=0x7efe540b08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.112+0000 7efe59000640 1 -- 172.21.15.40:0/1296449005 shutdown_connections 2024-09-11T00:24:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.112+0000 7efe59000640 1 -- 172.21.15.40:0/1296449005 wait complete. 2024-09-11T00:24:38.130 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-11T00:24:38.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.290+0000 7f75b4800640 1 -- 172.21.15.40:0/696169320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75ac070b20 msgr2=0x7f75ac070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:38.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.290+0000 7f75b4800640 1 --2- 172.21.15.40:0/696169320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75ac070b20 0x7f75ac070f00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f75a0005fd0 tx=0x7f75a002a540 comp rx=0 tx=0).stop 2024-09-11T00:24:38.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.290+0000 7f75b4800640 1 -- 172.21.15.40:0/696169320 shutdown_connections 2024-09-11T00:24:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.290+0000 7f75b4800640 1 --2- 172.21.15.40:0/696169320 >> v2:172.21.15.175:3300/0 conn(0x7f75ac0cb310 0x7f75ac15fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.290+0000 7f75b4800640 1 --2- 172.21.15.40:0/696169320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75ac070b20 0x7f75ac070f00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.290+0000 7f75b4800640 1 -- 172.21.15.40:0/696169320 >> 172.21.15.40:0/696169320 conn(0x7f75ac0d0cc0 msgr2=0x7f75ac0d10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.290+0000 7f75b4800640 1 -- 172.21.15.40:0/696169320 shutdown_connections 2024-09-11T00:24:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.290+0000 7f75b4800640 1 -- 172.21.15.40:0/696169320 wait complete. 2024-09-11T00:24:38.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.291+0000 7f75b4800640 1 Processor -- start 2024-09-11T00:24:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.292+0000 7f75b4800640 1 -- start start 2024-09-11T00:24:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.292+0000 7f75b4800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75ac070b20 0x7f75ac1580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.292+0000 7f75b4800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75ac0cb310 0x7f75ac0c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.292+0000 7f75b4800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75ac0d18e0 0x7f75ac15b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.292+0000 7f75b4800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac06cc30 con 0x7f75ac0d18e0 2024-09-11T00:24:38.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.292+0000 7f75b4800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac06cab0 con 0x7f75ac070b20 2024-09-11T00:24:38.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.292+0000 7f75b4800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f75ac1601b0 con 0x7f75ac0cb310 2024-09-11T00:24:38.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.293+0000 7f75b2800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75ac0d18e0 0x7f75ac15b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:38.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.293+0000 7f75b1e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75ac070b20 0x7f75ac1580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:38.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.293+0000 7f75b2800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75ac0d18e0 0x7f75ac15b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42098/0 (socket says 172.21.15.40:42098) 2024-09-11T00:24:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.293+0000 7f75b2800640 1 -- 172.21.15.40:0/1781738289 learned_addr learned my addr 172.21.15.40:0/1781738289 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.293+0000 7f75b1400640 1 --2- 172.21.15.40:0/1781738289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75ac0cb310 0x7f75ac0c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.293+0000 7f75b2800640 1 -- 172.21.15.40:0/1781738289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75ac0cb310 msgr2=0x7f75ac0c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.293+0000 7f75b2800640 1 --2- 172.21.15.40:0/1781738289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75ac0cb310 0x7f75ac0c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.293+0000 7f75b2800640 1 -- 172.21.15.40:0/1781738289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75ac070b20 msgr2=0x7f75ac1580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.293+0000 7f75b2800640 1 --2- 172.21.15.40:0/1781738289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75ac070b20 0x7f75ac1580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.293+0000 7f75b2800640 1 -- 172.21.15.40:0/1781738289 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ac158840 con 0x7f75ac0d18e0 2024-09-11T00:24:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.294+0000 7f75b2800640 1 --2- 172.21.15.40:0/1781738289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75ac0d18e0 0x7f75ac15b040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f75a800eb10 tx=0x7f75a800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.294+0000 7f75a6000640 1 -- 172.21.15.40:0/1781738289 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a8004b20 con 0x7f75ac0d18e0 2024-09-11T00:24:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.294+0000 7f75a6000640 1 -- 172.21.15.40:0/1781738289 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75a8004ce0 con 0x7f75ac0d18e0 2024-09-11T00:24:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.294+0000 7f75a6000640 1 -- 172.21.15.40:0/1781738289 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a8005280 con 0x7f75ac0d18e0 2024-09-11T00:24:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.294+0000 7f75b4800640 1 -- 172.21.15.40:0/1781738289 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ac158b20 con 0x7f75ac0d18e0 2024-09-11T00:24:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.294+0000 7f75b4800640 1 -- 172.21.15.40:0/1781738289 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ac0c8280 con 0x7f75ac0d18e0 2024-09-11T00:24:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.295+0000 7f75b4800640 1 -- 172.21.15.40:0/1781738289 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75ac0b6730 con 0x7f75ac0d18e0 2024-09-11T00:24:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.296+0000 7f75a6000640 1 -- 172.21.15.40:0/1781738289 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f75a8005420 con 0x7f75ac0d18e0 2024-09-11T00:24:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.298+0000 7f75a6000640 1 --2- 172.21.15.40:0/1781738289 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7590077f70 0x7f759007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.298+0000 7f75a6000640 1 -- 172.21.15.40:0/1781738289 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f75a809a5b0 con 0x7f75ac0d18e0 2024-09-11T00:24:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.298+0000 7f75b1e00640 1 --2- 172.21.15.40:0/1781738289 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7590077f70 0x7f759007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.299+0000 7f75b1e00640 1 --2- 172.21.15.40:0/1781738289 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7590077f70 0x7f759007a430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f75a0033000 tx=0x7f75a0004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.302+0000 7f75a6000640 1 -- 172.21.15.40:0/1781738289 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f75ac0b6730 con 0x7f75ac0d18e0 2024-09-11T00:24:38.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.570+0000 7f75b4800640 1 -- 172.21.15.40:0/1781738289 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f75ac0c7d90 con 0x7f75ac0d18e0 2024-09-11T00:24:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.572+0000 7f75a6000640 1 -- 172.21.15.40:0/1781738289 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7f75a8062e40 con 0x7f75ac0d18e0 2024-09-11T00:24:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.575+0000 7f75b4800640 1 -- 172.21.15.40:0/1781738289 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7590077f70 msgr2=0x7f759007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.575+0000 7f75b4800640 1 --2- 172.21.15.40:0/1781738289 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7590077f70 0x7f759007a430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f75a0033000 tx=0x7f75a0004730 comp rx=0 tx=0).stop 2024-09-11T00:24:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.575+0000 7f75b4800640 1 -- 172.21.15.40:0/1781738289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75ac0d18e0 msgr2=0x7f75ac15b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.575+0000 7f75b4800640 1 --2- 172.21.15.40:0/1781738289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75ac0d18e0 0x7f75ac15b040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f75a800eb10 tx=0x7f75a800c2d0 comp rx=0 tx=0).stop 2024-09-11T00:24:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.575+0000 7f75b4800640 1 -- 172.21.15.40:0/1781738289 shutdown_connections 2024-09-11T00:24:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.575+0000 7f75b4800640 1 --2- 172.21.15.40:0/1781738289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75ac0d18e0 0x7f75ac15b040 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.575+0000 7f75b4800640 1 --2- 172.21.15.40:0/1781738289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75ac0cb310 0x7f75ac0c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.575+0000 7f75b4800640 1 --2- 172.21.15.40:0/1781738289 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7590077f70 0x7f759007a430 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.575+0000 7f75b4800640 1 --2- 172.21.15.40:0/1781738289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75ac070b20 0x7f75ac1580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.575+0000 7f75b4800640 1 -- 172.21.15.40:0/1781738289 >> 172.21.15.40:0/1781738289 conn(0x7f75ac0d0cc0 msgr2=0x7f75ac0b3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.575+0000 7f75b4800640 1 -- 172.21.15.40:0/1781738289 shutdown_connections 2024-09-11T00:24:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.575+0000 7f75b4800640 1 -- 172.21.15.40:0/1781738289 wait complete. 2024-09-11T00:24:38.593 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-11T00:24:38.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.752+0000 7f1bcee00640 1 -- 172.21.15.40:0/3967499837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc815bcc0 msgr2=0x7f1bc80cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:38.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.752+0000 7f1bcee00640 1 --2- 172.21.15.40:0/3967499837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc815bcc0 0x7f1bc80cb420 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8005fd0 tx=0x7f1bb802a630 comp rx=0 tx=0).stop 2024-09-11T00:24:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.753+0000 7f1bcee00640 1 -- 172.21.15.40:0/3967499837 shutdown_connections 2024-09-11T00:24:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.753+0000 7f1bcee00640 1 --2- 172.21.15.40:0/3967499837 >> v2:172.21.15.175:3300/0 conn(0x7f1bc80cba70 0x7f1bc80cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.753+0000 7f1bcee00640 1 --2- 172.21.15.40:0/3967499837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc815bcc0 0x7f1bc80cb420 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.753+0000 7f1bcee00640 1 -- 172.21.15.40:0/3967499837 >> 172.21.15.40:0/3967499837 conn(0x7f1bc80cfbb0 msgr2=0x7f1bc80cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.753+0000 7f1bcee00640 1 -- 172.21.15.40:0/3967499837 shutdown_connections 2024-09-11T00:24:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.753+0000 7f1bcee00640 1 -- 172.21.15.40:0/3967499837 wait complete. 2024-09-11T00:24:38.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.754+0000 7f1bcee00640 1 Processor -- start 2024-09-11T00:24:38.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.754+0000 7f1bcee00640 1 -- start start 2024-09-11T00:24:38.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.755+0000 7f1bcee00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc80ca200 0x7f1bc81f5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:38.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.755+0000 7f1bcee00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc80cba70 0x7f1bc80c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:38.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.755+0000 7f1bcee00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bc815bcc0 0x7f1bc80af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:38.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.755+0000 7f1bcee00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc815f940 con 0x7f1bc80cba70 2024-09-11T00:24:38.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.755+0000 7f1bcee00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc815f7c0 con 0x7f1bc80ca200 2024-09-11T00:24:38.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.755+0000 7f1bcee00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc80cad60 con 0x7f1bc815bcc0 2024-09-11T00:24:38.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.756+0000 7f1bc7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc80cba70 0x7f1bc80c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:38.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.756+0000 7f1bc7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc80cba70 0x7f1bc80c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42128/0 (socket says 172.21.15.40:42128) 2024-09-11T00:24:38.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.756+0000 7f1bc7400640 1 -- 172.21.15.40:0/1192801879 learned_addr learned my addr 172.21.15.40:0/1192801879 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:38.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.756+0000 7f1bc7e00640 1 --2- 172.21.15.40:0/1192801879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc80ca200 0x7f1bc81f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:38.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.756+0000 7f1bcce00640 1 --2- 172.21.15.40:0/1192801879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bc815bcc0 0x7f1bc80af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:38.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.756+0000 7f1bc7400640 1 -- 172.21.15.40:0/1192801879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bc815bcc0 msgr2=0x7f1bc80af8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:38.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.756+0000 7f1bc7400640 1 --2- 172.21.15.40:0/1192801879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bc815bcc0 0x7f1bc80af8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:38.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.756+0000 7f1bc7400640 1 -- 172.21.15.40:0/1192801879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc80ca200 msgr2=0x7f1bc81f5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:38.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.756+0000 7f1bc7400640 1 --2- 172.21.15.40:0/1192801879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc80ca200 0x7f1bc81f5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:38.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.756+0000 7f1bc7400640 1 -- 172.21.15.40:0/1192801879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc80c91e0 con 0x7f1bc80cba70 2024-09-11T00:24:38.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.756+0000 7f1bcce00640 1 --2- 172.21.15.40:0/1192801879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bc815bcc0 0x7f1bc80af8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:38.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.756+0000 7f1bc7400640 1 --2- 172.21.15.40:0/1192801879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc80cba70 0x7f1bc80c8ab0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400d950 tx=0x7f1bb400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:38.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.757+0000 7f1bbfe00640 1 -- 172.21.15.40:0/1192801879 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4017070 con 0x7f1bc80cba70 2024-09-11T00:24:38.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.757+0000 7f1bbfe00640 1 -- 172.21.15.40:0/1192801879 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bb4009d20 con 0x7f1bc80cba70 2024-09-11T00:24:38.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.757+0000 7f1bcee00640 1 -- 172.21.15.40:0/1192801879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc80c94c0 con 0x7f1bc80cba70 2024-09-11T00:24:38.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.757+0000 7f1bbfe00640 1 -- 172.21.15.40:0/1192801879 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40106c0 con 0x7f1bc80cba70 2024-09-11T00:24:38.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.757+0000 7f1bcee00640 1 -- 172.21.15.40:0/1192801879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc80afde0 con 0x7f1bc80cba70 2024-09-11T00:24:38.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.758+0000 7f1bcee00640 1 -- 172.21.15.40:0/1192801879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc80cbec0 con 0x7f1bc80cba70 2024-09-11T00:24:38.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.759+0000 7f1bbfe00640 1 -- 172.21.15.40:0/1192801879 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1bb4010860 con 0x7f1bc80cba70 2024-09-11T00:24:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.760+0000 7f1bbfe00640 1 --2- 172.21.15.40:0/1192801879 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1ba8077f70 0x7f1ba807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.761+0000 7f1bbfe00640 1 -- 172.21.15.40:0/1192801879 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f1bb4099db0 con 0x7f1bc80cba70 2024-09-11T00:24:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.761+0000 7f1bc7e00640 1 --2- 172.21.15.40:0/1192801879 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1ba8077f70 0x7f1ba807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:38.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.762+0000 7f1bc7e00640 1 --2- 172.21.15.40:0/1192801879 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1ba8077f70 0x7f1ba807a430 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8033000 tx=0x7f1bb8004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:38.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:38.765+0000 7f1bbfe00640 1 -- 172.21.15.40:0/1192801879 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1bb409e070 con 0x7f1bc80cba70 2024-09-11T00:24:39.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.034+0000 7f1bcee00640 1 -- 172.21.15.40:0/1192801879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f1bc815b4e0 con 0x7f1bc80cba70 2024-09-11T00:24:39.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.036+0000 7f1bbfe00640 1 -- 172.21.15.40:0/1192801879 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f1bb40625a0 con 0x7f1bc80cba70 2024-09-11T00:24:39.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.039+0000 7f1bcee00640 1 -- 172.21.15.40:0/1192801879 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1ba8077f70 msgr2=0x7f1ba807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:39.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.039+0000 7f1bcee00640 1 --2- 172.21.15.40:0/1192801879 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1ba8077f70 0x7f1ba807a430 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8033000 tx=0x7f1bb8004730 comp rx=0 tx=0).stop 2024-09-11T00:24:39.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.039+0000 7f1bcee00640 1 -- 172.21.15.40:0/1192801879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc80cba70 msgr2=0x7f1bc80c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:39.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.039+0000 7f1bcee00640 1 --2- 172.21.15.40:0/1192801879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc80cba70 0x7f1bc80c8ab0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400d950 tx=0x7f1bb400de10 comp rx=0 tx=0).stop 2024-09-11T00:24:39.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.039+0000 7f1bcee00640 1 -- 172.21.15.40:0/1192801879 shutdown_connections 2024-09-11T00:24:39.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.039+0000 7f1bcee00640 1 --2- 172.21.15.40:0/1192801879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bc815bcc0 0x7f1bc80af8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:39.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.039+0000 7f1bcee00640 1 --2- 172.21.15.40:0/1192801879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc80cba70 0x7f1bc80c8ab0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:39.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.039+0000 7f1bcee00640 1 --2- 172.21.15.40:0/1192801879 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1ba8077f70 0x7f1ba807a430 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:39.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.039+0000 7f1bcee00640 1 --2- 172.21.15.40:0/1192801879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc80ca200 0x7f1bc81f5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:39.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.039+0000 7f1bcee00640 1 -- 172.21.15.40:0/1192801879 >> 172.21.15.40:0/1192801879 conn(0x7f1bc80cfbb0 msgr2=0x7f1bc80b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:39.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.039+0000 7f1bcee00640 1 -- 172.21.15.40:0/1192801879 shutdown_connections 2024-09-11T00:24:39.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.039+0000 7f1bcee00640 1 -- 172.21.15.40:0/1192801879 wait complete. 2024-09-11T00:24:39.057 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T00:24:39.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.215+0000 7f78e3a00640 1 -- 172.21.15.40:0/2264969339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc15bcc0 msgr2=0x7f78dc0cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:39.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.215+0000 7f78e3a00640 1 --2- 172.21.15.40:0/2264969339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc15bcc0 0x7f78dc0cb420 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f78cc009860 tx=0x7f78cc02a540 comp rx=0 tx=0).stop 2024-09-11T00:24:39.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.215+0000 7f78e3a00640 1 -- 172.21.15.40:0/2264969339 shutdown_connections 2024-09-11T00:24:39.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.215+0000 7f78e3a00640 1 --2- 172.21.15.40:0/2264969339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78dc06f920 0x7f78dc0cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:39.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.215+0000 7f78e3a00640 1 --2- 172.21.15.40:0/2264969339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc15bcc0 0x7f78dc0cb420 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:39.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.215+0000 7f78e3a00640 1 -- 172.21.15.40:0/2264969339 >> 172.21.15.40:0/2264969339 conn(0x7f78dc0cfbb0 msgr2=0x7f78dc0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:39.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.215+0000 7f78e3a00640 1 -- 172.21.15.40:0/2264969339 shutdown_connections 2024-09-11T00:24:39.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.215+0000 7f78e3a00640 1 -- 172.21.15.40:0/2264969339 wait complete. 2024-09-11T00:24:39.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.217+0000 7f78e3a00640 1 Processor -- start 2024-09-11T00:24:39.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.217+0000 7f78e3a00640 1 -- start start 2024-09-11T00:24:39.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.218+0000 7f78e3a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc06f920 0x7f78dc0c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:39.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.218+0000 7f78e3a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc0cba70 0x7f78dc147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:39.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.218+0000 7f78e3a00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78dc15bcc0 0x7f78dc148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:39.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.218+0000 7f78e3a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc15f940 con 0x7f78dc06f920 2024-09-11T00:24:39.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.218+0000 7f78e3a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc15f7c0 con 0x7f78dc0cba70 2024-09-11T00:24:39.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.218+0000 7f78e3a00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f78dc0ca910 con 0x7f78dc15bcc0 2024-09-11T00:24:39.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.218+0000 7f78e1000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc06f920 0x7f78dc0c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:39.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.218+0000 7f78e1000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc06f920 0x7f78dc0c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42152/0 (socket says 172.21.15.40:42152) 2024-09-11T00:24:39.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.218+0000 7f78e1000640 1 -- 172.21.15.40:0/4010917884 learned_addr learned my addr 172.21.15.40:0/4010917884 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:39.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.218+0000 7f78d3e00640 1 --2- 172.21.15.40:0/4010917884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc0cba70 0x7f78dc147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:39.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.218+0000 7f78e1a00640 1 --2- 172.21.15.40:0/4010917884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78dc15bcc0 0x7f78dc148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:39.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.219+0000 7f78e1000640 1 -- 172.21.15.40:0/4010917884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78dc15bcc0 msgr2=0x7f78dc148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:39.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.219+0000 7f78e1000640 1 --2- 172.21.15.40:0/4010917884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78dc15bcc0 0x7f78dc148290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:39.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.219+0000 7f78e1000640 1 -- 172.21.15.40:0/4010917884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc0cba70 msgr2=0x7f78dc147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:39.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.219+0000 7f78e1000640 1 --2- 172.21.15.40:0/4010917884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc0cba70 0x7f78dc147d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:39.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.219+0000 7f78e1000640 1 -- 172.21.15.40:0/4010917884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78dc0c7e70 con 0x7f78dc06f920 2024-09-11T00:24:39.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.219+0000 7f78e1000640 1 --2- 172.21.15.40:0/4010917884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc06f920 0x7f78dc0c8f10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f78cc000c00 tx=0x7f78cc033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:39.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.219+0000 7f78d9600640 1 -- 172.21.15.40:0/4010917884 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc031d60 con 0x7f78dc06f920 2024-09-11T00:24:39.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.219+0000 7f78d9600640 1 -- 172.21.15.40:0/4010917884 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78cc0330d0 con 0x7f78dc06f920 2024-09-11T00:24:39.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.219+0000 7f78d9600640 1 -- 172.21.15.40:0/4010917884 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc033520 con 0x7f78dc06f920 2024-09-11T00:24:39.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.219+0000 7f78e3a00640 1 -- 172.21.15.40:0/4010917884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78dc0c8150 con 0x7f78dc06f920 2024-09-11T00:24:39.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.219+0000 7f78e3a00640 1 -- 172.21.15.40:0/4010917884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78dc0c8710 con 0x7f78dc06f920 2024-09-11T00:24:39.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.220+0000 7f78e3a00640 1 -- 172.21.15.40:0/4010917884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78dc0cae60 con 0x7f78dc06f920 2024-09-11T00:24:39.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.221+0000 7f78d9600640 1 -- 172.21.15.40:0/4010917884 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f78cc0035f0 con 0x7f78dc06f920 2024-09-11T00:24:39.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.222+0000 7f78d9600640 1 --2- 172.21.15.40:0/4010917884 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f78b8077f70 0x7f78b807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:39.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.223+0000 7f78d9600640 1 -- 172.21.15.40:0/4010917884 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f78cc0badd0 con 0x7f78dc06f920 2024-09-11T00:24:39.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.223+0000 7f78d3e00640 1 --2- 172.21.15.40:0/4010917884 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f78b8077f70 0x7f78b807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:39.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.224+0000 7f78d3e00640 1 --2- 172.21.15.40:0/4010917884 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f78b8077f70 0x7f78b807a430 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0c63f0 tx=0x7f78c4007e90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:39.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.227+0000 7f78d9600640 1 -- 172.21.15.40:0/4010917884 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f78cc03f030 con 0x7f78dc06f920 2024-09-11T00:24:39.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.423+0000 7f78e3a00640 1 -- 172.21.15.40:0/4010917884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f78dc147910 con 0x7f78dc06f920 2024-09-11T00:24:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.423+0000 7f78d9600640 1 -- 172.21.15.40:0/4010917884 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) ==== 84+0+65 (secure 0 0 0) 0x7f78cc083c10 con 0x7f78dc06f920 2024-09-11T00:24:39.426 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:39.426 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2024-09-11T00:24:39.426 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T00:24:39.426 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2024-09-11T00:24:39.426 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2024-09-11T00:24:39.426 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:39.426 INFO:teuthology.orchestra.run.smithi040.stdout:] 2024-09-11T00:24:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.426+0000 7f78e3a00640 1 -- 172.21.15.40:0/4010917884 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f78b8077f70 msgr2=0x7f78b807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.426+0000 7f78e3a00640 1 --2- 172.21.15.40:0/4010917884 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f78b8077f70 0x7f78b807a430 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0c63f0 tx=0x7f78c4007e90 comp rx=0 tx=0).stop 2024-09-11T00:24:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.426+0000 7f78e3a00640 1 -- 172.21.15.40:0/4010917884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc06f920 msgr2=0x7f78dc0c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.426+0000 7f78e3a00640 1 --2- 172.21.15.40:0/4010917884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc06f920 0x7f78dc0c8f10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f78cc000c00 tx=0x7f78cc033d60 comp rx=0 tx=0).stop 2024-09-11T00:24:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.426+0000 7f78e3a00640 1 -- 172.21.15.40:0/4010917884 shutdown_connections 2024-09-11T00:24:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.426+0000 7f78e3a00640 1 --2- 172.21.15.40:0/4010917884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78dc15bcc0 0x7f78dc148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.426+0000 7f78e3a00640 1 --2- 172.21.15.40:0/4010917884 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f78b8077f70 0x7f78b807a430 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.426+0000 7f78e3a00640 1 --2- 172.21.15.40:0/4010917884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc0cba70 0x7f78dc147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.426+0000 7f78e3a00640 1 --2- 172.21.15.40:0/4010917884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc06f920 0x7f78dc0c8f10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.426+0000 7f78e3a00640 1 -- 172.21.15.40:0/4010917884 >> 172.21.15.40:0/4010917884 conn(0x7f78dc0cfbb0 msgr2=0x7f78dc0cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.426+0000 7f78e3a00640 1 -- 172.21.15.40:0/4010917884 shutdown_connections 2024-09-11T00:24:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.426+0000 7f78e3a00640 1 -- 172.21.15.40:0/4010917884 wait complete. 2024-09-11T00:24:39.444 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T00:24:39.444 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T00:24:39.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.607+0000 7f6dce200640 1 -- 172.21.15.40:0/3268341055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dc815beb0 msgr2=0x7f6dc80d0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:39.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.607+0000 7f6dce200640 1 --2- 172.21.15.40:0/3268341055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dc815beb0 0x7f6dc80d0470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80730f0 tx=0x7f6db802a6d0 comp rx=0 tx=0).stop 2024-09-11T00:24:39.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.608+0000 7f6dce200640 1 -- 172.21.15.40:0/3268341055 shutdown_connections 2024-09-11T00:24:39.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.608+0000 7f6dce200640 1 --2- 172.21.15.40:0/3268341055 >> v2:172.21.15.175:3300/0 conn(0x7f6dc80cb350 0x7f6dc806f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:39.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.608+0000 7f6dce200640 1 --2- 172.21.15.40:0/3268341055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dc815beb0 0x7f6dc80d0470 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:39.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.608+0000 7f6dce200640 1 -- 172.21.15.40:0/3268341055 >> 172.21.15.40:0/3268341055 conn(0x7f6dc80cf950 msgr2=0x7f6dc80cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:39.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.608+0000 7f6dce200640 1 -- 172.21.15.40:0/3268341055 shutdown_connections 2024-09-11T00:24:39.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.608+0000 7f6dce200640 1 -- 172.21.15.40:0/3268341055 wait complete. 2024-09-11T00:24:39.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.609+0000 7f6dce200640 1 Processor -- start 2024-09-11T00:24:39.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.609+0000 7f6dce200640 1 -- start start 2024-09-11T00:24:39.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.610+0000 7f6dce200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dc80cb350 0x7f6dc8152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:39.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.610+0000 7f6dce200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dc815beb0 0x7f6dc8153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:39.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.610+0000 7f6dce200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dc8155600 0x7f6dc8155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:39.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.610+0000 7f6dce200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc8073c20 con 0x7f6dc8155600 2024-09-11T00:24:39.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.610+0000 7f6dce200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc80b3120 con 0x7f6dc80cb350 2024-09-11T00:24:39.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.610+0000 7f6dce200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc8073da0 con 0x7f6dc815beb0 2024-09-11T00:24:39.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.611+0000 7f6dc7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dc8155600 0x7f6dc8155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.611+0000 7f6dc7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dc80cb350 0x7f6dc8152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.611+0000 7f6dc7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dc8155600 0x7f6dc8155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42164/0 (socket says 172.21.15.40:42164) 2024-09-11T00:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.611+0000 7f6dc7e00640 1 -- 172.21.15.40:0/3376810625 learned_addr learned my addr 172.21.15.40:0/3376810625 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.611+0000 7f6dbea00640 1 --2- 172.21.15.40:0/3376810625 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dc815beb0 0x7f6dc8153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.611+0000 7f6dc7e00640 1 -- 172.21.15.40:0/3376810625 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dc815beb0 msgr2=0x7f6dc8153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.611+0000 7f6dc7e00640 1 --2- 172.21.15.40:0/3376810625 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dc815beb0 0x7f6dc8153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.611+0000 7f6dc7e00640 1 -- 172.21.15.40:0/3376810625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dc80cb350 msgr2=0x7f6dc8152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.611+0000 7f6dc7e00640 1 --2- 172.21.15.40:0/3376810625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dc80cb350 0x7f6dc8152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.611+0000 7f6dc7e00640 1 -- 172.21.15.40:0/3376810625 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc80cea10 con 0x7f6dc8155600 2024-09-11T00:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.611+0000 7f6dc7e00640 1 --2- 172.21.15.40:0/3376810625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dc8155600 0x7f6dc8155a80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000c710 tx=0x7f6dc000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.612+0000 7f6dbfe00640 1 -- 172.21.15.40:0/3376810625 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0003b70 con 0x7f6dc8155600 2024-09-11T00:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.612+0000 7f6dbfe00640 1 -- 172.21.15.40:0/3376810625 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dc0003d10 con 0x7f6dc8155600 2024-09-11T00:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.612+0000 7f6dce200640 1 -- 172.21.15.40:0/3376810625 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc80cd970 con 0x7f6dc8155600 2024-09-11T00:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.612+0000 7f6dbfe00640 1 -- 172.21.15.40:0/3376810625 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc000aab0 con 0x7f6dc8155600 2024-09-11T00:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.612+0000 7f6dce200640 1 -- 172.21.15.40:0/3376810625 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc80cdf30 con 0x7f6dc8155600 2024-09-11T00:24:39.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.613+0000 7f6dce200640 1 -- 172.21.15.40:0/3376810625 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc806f500 con 0x7f6dc8155600 2024-09-11T00:24:39.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.614+0000 7f6dbfe00640 1 -- 172.21.15.40:0/3376810625 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6dc000ac50 con 0x7f6dc8155600 2024-09-11T00:24:39.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.615+0000 7f6dbfe00640 1 --2- 172.21.15.40:0/3376810625 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6da4077f70 0x7f6da407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:39.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.615+0000 7f6dbfe00640 1 -- 172.21.15.40:0/3376810625 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f6dc0099660 con 0x7f6dc8155600 2024-09-11T00:24:39.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.616+0000 7f6dc7400640 1 --2- 172.21.15.40:0/3376810625 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6da4077f70 0x7f6da407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:39.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.616+0000 7f6dc7400640 1 --2- 172.21.15.40:0/3376810625 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6da4077f70 0x7f6da407a430 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6db8033000 tx=0x7f6db8004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:39.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.619+0000 7f6dbfe00640 1 -- 172.21.15.40:0/3376810625 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6dc000ce20 con 0x7f6dc8155600 2024-09-11T00:24:39.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:39.817+0000 7f6dce200640 1 -- 172.21.15.40:0/3376810625 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6dc8076110 con 0x7f6dc8155600 2024-09-11T00:24:40.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.346+0000 7f6dbfe00640 1 -- 172.21.15.40:0/3376810625 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) ==== 138+0+0 (secure 0 0 0) 0x7f6dc0061e60 con 0x7f6dc8155600 2024-09-11T00:24:40.349 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2024-09-11T00:24:40.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.350+0000 7f6dce200640 1 -- 172.21.15.40:0/3376810625 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6da4077f70 msgr2=0x7f6da407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:40.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.350+0000 7f6dce200640 1 --2- 172.21.15.40:0/3376810625 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6da4077f70 0x7f6da407a430 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6db8033000 tx=0x7f6db8004730 comp rx=0 tx=0).stop 2024-09-11T00:24:40.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.350+0000 7f6dce200640 1 -- 172.21.15.40:0/3376810625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dc8155600 msgr2=0x7f6dc8155a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:40.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.350+0000 7f6dce200640 1 --2- 172.21.15.40:0/3376810625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dc8155600 0x7f6dc8155a80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000c710 tx=0x7f6dc000cbd0 comp rx=0 tx=0).stop 2024-09-11T00:24:40.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.350+0000 7f6dce200640 1 -- 172.21.15.40:0/3376810625 shutdown_connections 2024-09-11T00:24:40.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.350+0000 7f6dce200640 1 --2- 172.21.15.40:0/3376810625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dc8155600 0x7f6dc8155a80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:40.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.350+0000 7f6dce200640 1 --2- 172.21.15.40:0/3376810625 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6dc815beb0 0x7f6dc8153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:40.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.350+0000 7f6dce200640 1 --2- 172.21.15.40:0/3376810625 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6da4077f70 0x7f6da407a430 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:40.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.350+0000 7f6dce200640 1 --2- 172.21.15.40:0/3376810625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6dc80cb350 0x7f6dc8152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:40.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.350+0000 7f6dce200640 1 -- 172.21.15.40:0/3376810625 >> 172.21.15.40:0/3376810625 conn(0x7f6dc80cf950 msgr2=0x7f6dc80b32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:40.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.351+0000 7f6dce200640 1 -- 172.21.15.40:0/3376810625 shutdown_connections 2024-09-11T00:24:40.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.351+0000 7f6dce200640 1 -- 172.21.15.40:0/3376810625 wait complete. 2024-09-11T00:24:40.374 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T00:24:40.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.542+0000 7f0927000640 1 -- 172.21.15.40:0/1793050933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09200cc490 msgr2=0x7f09200cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:40.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.542+0000 7f0927000640 1 --2- 172.21.15.40:0/1793050933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09200cc490 0x7f09200cc920 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0920073ca0 tx=0x7f091802aa30 comp rx=0 tx=0).stop 2024-09-11T00:24:40.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.542+0000 7f0927000640 1 -- 172.21.15.40:0/1793050933 shutdown_connections 2024-09-11T00:24:40.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.542+0000 7f0927000640 1 --2- 172.21.15.40:0/1793050933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09200cc490 0x7f09200cc920 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:40.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.542+0000 7f0927000640 1 --2- 172.21.15.40:0/1793050933 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09200cff60 0x7f09200d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:40.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.542+0000 7f0927000640 1 --2- 172.21.15.40:0/1793050933 >> v2:172.21.15.175:3300/0 conn(0x7f092015bb00 0x7f09200cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:40.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.542+0000 7f0927000640 1 -- 172.21.15.40:0/1793050933 >> 172.21.15.40:0/1793050933 conn(0x7f092009a9f0 msgr2=0x7f09200d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:40.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.542+0000 7f0927000640 1 -- 172.21.15.40:0/1793050933 shutdown_connections 2024-09-11T00:24:40.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.542+0000 7f0927000640 1 -- 172.21.15.40:0/1793050933 wait complete. 2024-09-11T00:24:40.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.544+0000 7f0927000640 1 Processor -- start 2024-09-11T00:24:40.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.544+0000 7f0927000640 1 -- start start 2024-09-11T00:24:40.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.545+0000 7f0927000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09200cc490 0x7f09201f1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:40.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.545+0000 7f0927000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09200cff60 0x7f092015e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:40.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.545+0000 7f0927000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f092015bb00 0x7f09200cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:40.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.545+0000 7f0927000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f09200cce60 con 0x7f092015bb00 2024-09-11T00:24:40.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.545+0000 7f0927000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f09200cfca0 con 0x7f09200cff60 2024-09-11T00:24:40.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.545+0000 7f0927000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f09200ccfe0 con 0x7f09200cc490 2024-09-11T00:24:40.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.545+0000 7f0926600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f092015bb00 0x7f09200cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:40.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.545+0000 7f0926600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f092015bb00 0x7f09200cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42184/0 (socket says 172.21.15.40:42184) 2024-09-11T00:24:40.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.545+0000 7f0926600640 1 -- 172.21.15.40:0/3596506778 learned_addr learned my addr 172.21.15.40:0/3596506778 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:40.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.545+0000 7f0925c00640 1 --2- 172.21.15.40:0/3596506778 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09200cc490 0x7f09201f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:40.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.545+0000 7f0925200640 1 --2- 172.21.15.40:0/3596506778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09200cff60 0x7f092015e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:40.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.546+0000 7f0926600640 1 -- 172.21.15.40:0/3596506778 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09200cc490 msgr2=0x7f09201f1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:40.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.546+0000 7f0926600640 1 --2- 172.21.15.40:0/3596506778 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09200cc490 0x7f09201f1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:40.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.546+0000 7f0926600640 1 -- 172.21.15.40:0/3596506778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09200cff60 msgr2=0x7f092015e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:40.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.546+0000 7f0926600640 1 --2- 172.21.15.40:0/3596506778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09200cff60 0x7f092015e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:40.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.546+0000 7f0926600640 1 -- 172.21.15.40:0/3596506778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09200c6540 con 0x7f092015bb00 2024-09-11T00:24:40.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.546+0000 7f0925c00640 1 --2- 172.21.15.40:0/3596506778 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09200cc490 0x7f09201f1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:40.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.546+0000 7f0926600640 1 --2- 172.21.15.40:0/3596506778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f092015bb00 0x7f09200cafa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0918009d60 tx=0x7f0918003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:40.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.546+0000 7f091d600640 1 -- 172.21.15.40:0/3596506778 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0918047070 con 0x7f092015bb00 2024-09-11T00:24:40.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.546+0000 7f091d600640 1 -- 172.21.15.40:0/3596506778 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0918004250 con 0x7f092015bb00 2024-09-11T00:24:40.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.546+0000 7f091d600640 1 -- 172.21.15.40:0/3596506778 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0918033050 con 0x7f092015bb00 2024-09-11T00:24:40.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.546+0000 7f0927000640 1 -- 172.21.15.40:0/3596506778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09200c67c0 con 0x7f092015bb00 2024-09-11T00:24:40.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.546+0000 7f0927000640 1 -- 172.21.15.40:0/3596506778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f092015ed80 con 0x7f092015bb00 2024-09-11T00:24:40.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.547+0000 7f0927000640 1 -- 172.21.15.40:0/3596506778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09200d0360 con 0x7f092015bb00 2024-09-11T00:24:40.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.549+0000 7f091d600640 1 -- 172.21.15.40:0/3596506778 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0918004680 con 0x7f092015bb00 2024-09-11T00:24:40.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.550+0000 7f091d600640 1 --2- 172.21.15.40:0/3596506778 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0900077f70 0x7f090007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:40.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.550+0000 7f091d600640 1 -- 172.21.15.40:0/3596506778 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5227+0+0 (secure 0 0 0) 0x7f09180bb3b0 con 0x7f092015bb00 2024-09-11T00:24:40.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.550+0000 7f0925c00640 1 --2- 172.21.15.40:0/3596506778 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0900077f70 0x7f090007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:40.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.551+0000 7f0925c00640 1 --2- 172.21.15.40:0/3596506778 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0900077f70 0x7f090007a430 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0914005fd0 tx=0x7f0914005c70 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:40.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.554+0000 7f091d600640 1 -- 172.21.15.40:0/3596506778 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0918051080 con 0x7f092015bb00 2024-09-11T00:24:40.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:40.754+0000 7f0927000640 1 -- 172.21.15.40:0/3596506778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f09200cca10 con 0x7f092015bb00 2024-09-11T00:24:41.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.349+0000 7f091d600640 1 -- 172.21.15.40:0/3596506778 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) ==== 170+0+0 (secure 0 0 0) 0x7f09200c6540 con 0x7f092015bb00 2024-09-11T00:24:41.352 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2024-09-11T00:24:41.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.353+0000 7f0927000640 1 -- 172.21.15.40:0/3596506778 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0900077f70 msgr2=0x7f090007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:41.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.353+0000 7f0927000640 1 --2- 172.21.15.40:0/3596506778 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0900077f70 0x7f090007a430 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0914005fd0 tx=0x7f0914005c70 comp rx=0 tx=0).stop 2024-09-11T00:24:41.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.353+0000 7f0927000640 1 -- 172.21.15.40:0/3596506778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f092015bb00 msgr2=0x7f09200cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:41.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.353+0000 7f0927000640 1 --2- 172.21.15.40:0/3596506778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f092015bb00 0x7f09200cafa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0918009d60 tx=0x7f0918003f10 comp rx=0 tx=0).stop 2024-09-11T00:24:41.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.353+0000 7f0927000640 1 -- 172.21.15.40:0/3596506778 shutdown_connections 2024-09-11T00:24:41.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.353+0000 7f0927000640 1 --2- 172.21.15.40:0/3596506778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f092015bb00 0x7f09200cafa0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:41.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.353+0000 7f0927000640 1 --2- 172.21.15.40:0/3596506778 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0900077f70 0x7f090007a430 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:41.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.353+0000 7f0927000640 1 --2- 172.21.15.40:0/3596506778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09200cff60 0x7f092015e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:41.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.353+0000 7f0927000640 1 --2- 172.21.15.40:0/3596506778 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09200cc490 0x7f09201f1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:41.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.353+0000 7f0927000640 1 -- 172.21.15.40:0/3596506778 >> 172.21.15.40:0/3596506778 conn(0x7f092009a9f0 msgr2=0x7f09200ae590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:41.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.353+0000 7f0927000640 1 -- 172.21.15.40:0/3596506778 shutdown_connections 2024-09-11T00:24:41.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.353+0000 7f0927000640 1 -- 172.21.15.40:0/3596506778 wait complete. 2024-09-11T00:24:41.392 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T00:24:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.555+0000 7fb016200640 1 -- 172.21.15.40:0/3942900753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0100d21d0 msgr2=0x7fb010160890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.555+0000 7fb016200640 1 --2- 172.21.15.40:0/3942900753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0100d21d0 0x7fb010160890 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb01006cec0 tx=0x7fb00802aa30 comp rx=0 tx=0).stop 2024-09-11T00:24:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.555+0000 7fb016200640 1 -- 172.21.15.40:0/3942900753 shutdown_connections 2024-09-11T00:24:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.555+0000 7fb016200640 1 --2- 172.21.15.40:0/3942900753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0100d21d0 0x7fb010160890 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.555+0000 7fb016200640 1 --2- 172.21.15.40:0/3942900753 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0100d0fe0 0x7fb0100d1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.555+0000 7fb016200640 1 --2- 172.21.15.40:0/3942900753 >> v2:172.21.15.175:3300/0 conn(0x7fb0100b5090 0x7fb0100d47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.555+0000 7fb016200640 1 -- 172.21.15.40:0/3942900753 >> 172.21.15.40:0/3942900753 conn(0x7fb0100d3c10 msgr2=0x7fb0100d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.555+0000 7fb016200640 1 -- 172.21.15.40:0/3942900753 shutdown_connections 2024-09-11T00:24:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.555+0000 7fb016200640 1 -- 172.21.15.40:0/3942900753 wait complete. 2024-09-11T00:24:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.557+0000 7fb016200640 1 Processor -- start 2024-09-11T00:24:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.557+0000 7fb016200640 1 -- start start 2024-09-11T00:24:41.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.558+0000 7fb016200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0100b5090 0x7fb0101f7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:41.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.558+0000 7fb016200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0100d0fe0 0x7fb01014ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:41.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.558+0000 7fb016200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0100d21d0 0x7fb01006e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:41.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.558+0000 7fb016200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb010160f50 con 0x7fb0100d21d0 2024-09-11T00:24:41.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.558+0000 7fb016200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb010160dd0 con 0x7fb0100d0fe0 2024-09-11T00:24:41.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.558+0000 7fb016200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb0101610d0 con 0x7fb0100b5090 2024-09-11T00:24:41.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.558+0000 7fb015800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0100d21d0 0x7fb01006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:41.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.558+0000 7fb015800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0100d21d0 0x7fb01006e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42192/0 (socket says 172.21.15.40:42192) 2024-09-11T00:24:41.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.558+0000 7fb015800640 1 -- 172.21.15.40:0/788944794 learned_addr learned my addr 172.21.15.40:0/788944794 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.558+0000 7fb014e00640 1 --2- 172.21.15.40:0/788944794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0100b5090 0x7fb0101f7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.558+0000 7fb00fe00640 1 --2- 172.21.15.40:0/788944794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0100d0fe0 0x7fb01014ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.558+0000 7fb015800640 1 -- 172.21.15.40:0/788944794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0100b5090 msgr2=0x7fb0101f7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.558+0000 7fb015800640 1 --2- 172.21.15.40:0/788944794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0100b5090 0x7fb0101f7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.558+0000 7fb015800640 1 -- 172.21.15.40:0/788944794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0100d0fe0 msgr2=0x7fb01014ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.558+0000 7fb015800640 1 --2- 172.21.15.40:0/788944794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0100d0fe0 0x7fb01014ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.558+0000 7fb015800640 1 -- 172.21.15.40:0/788944794 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0101f8450 con 0x7fb0100d21d0 2024-09-11T00:24:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.559+0000 7fb015800640 1 --2- 172.21.15.40:0/788944794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0100d21d0 0x7fb01006e230 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb00802b020 tx=0x7fb008003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.559+0000 7fb00cc00640 1 -- 172.21.15.40:0/788944794 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb008033050 con 0x7fb0100d21d0 2024-09-11T00:24:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.559+0000 7fb00cc00640 1 -- 172.21.15.40:0/788944794 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb008004540 con 0x7fb0100d21d0 2024-09-11T00:24:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.559+0000 7fb00cc00640 1 -- 172.21.15.40:0/788944794 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb008038450 con 0x7fb0100d21d0 2024-09-11T00:24:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.559+0000 7fb016200640 1 -- 172.21.15.40:0/788944794 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0101f8730 con 0x7fb0100d21d0 2024-09-11T00:24:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.559+0000 7fb016200640 1 -- 172.21.15.40:0/788944794 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb010157c50 con 0x7fb0100d21d0 2024-09-11T00:24:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.560+0000 7fb016200640 1 -- 172.21.15.40:0/788944794 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0100b08b0 con 0x7fb0100d21d0 2024-09-11T00:24:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.562+0000 7fb00cc00640 1 -- 172.21.15.40:0/788944794 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb00804a030 con 0x7fb0100d21d0 2024-09-11T00:24:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.563+0000 7fb00cc00640 1 --2- 172.21.15.40:0/788944794 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7faff0077f70 0x7faff007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.563+0000 7fb00cc00640 1 -- 172.21.15.40:0/788944794 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5609+0+0 (secure 0 0 0) 0x7fb0080baea0 con 0x7fb0100d21d0 2024-09-11T00:24:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.563+0000 7fb014e00640 1 --2- 172.21.15.40:0/788944794 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7faff0077f70 0x7faff007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.564+0000 7fb014e00640 1 --2- 172.21.15.40:0/788944794 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7faff0077f70 0x7faff007a430 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb004005fd0 tx=0x7fb00400b2e0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:41.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.566+0000 7fb00cc00640 1 -- 172.21.15.40:0/788944794 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb0100b08b0 con 0x7fb0100d21d0 2024-09-11T00:24:41.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:41.797+0000 7fb016200640 1 -- 172.21.15.40:0/788944794 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb010157e20 con 0x7fb0100d21d0 2024-09-11T00:24:42.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.371+0000 7fb00cc00640 1 -- 172.21.15.40:0/788944794 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7fb008083520 con 0x7fb0100d21d0 2024-09-11T00:24:42.378 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 4 and data pool 5 2024-09-11T00:24:42.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.378+0000 7fb016200640 1 -- 172.21.15.40:0/788944794 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7faff0077f70 msgr2=0x7faff007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:42.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.378+0000 7fb016200640 1 --2- 172.21.15.40:0/788944794 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7faff0077f70 0x7faff007a430 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb004005fd0 tx=0x7fb00400b2e0 comp rx=0 tx=0).stop 2024-09-11T00:24:42.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.378+0000 7fb016200640 1 -- 172.21.15.40:0/788944794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0100d21d0 msgr2=0x7fb01006e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:42.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.378+0000 7fb016200640 1 --2- 172.21.15.40:0/788944794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0100d21d0 0x7fb01006e230 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb00802b020 tx=0x7fb008003f10 comp rx=0 tx=0).stop 2024-09-11T00:24:42.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.378+0000 7fb016200640 1 -- 172.21.15.40:0/788944794 shutdown_connections 2024-09-11T00:24:42.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.378+0000 7fb016200640 1 --2- 172.21.15.40:0/788944794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0100d21d0 0x7fb01006e230 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:42.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.378+0000 7fb016200640 1 --2- 172.21.15.40:0/788944794 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7faff0077f70 0x7faff007a430 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:42.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.378+0000 7fb016200640 1 --2- 172.21.15.40:0/788944794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0100d0fe0 0x7fb01014ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:42.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.378+0000 7fb016200640 1 --2- 172.21.15.40:0/788944794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0100b5090 0x7fb0101f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:42.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.378+0000 7fb016200640 1 -- 172.21.15.40:0/788944794 >> 172.21.15.40:0/788944794 conn(0x7fb0100d3c10 msgr2=0x7fb01015ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:42.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.381+0000 7fb016200640 1 -- 172.21.15.40:0/788944794 shutdown_connections 2024-09-11T00:24:42.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.381+0000 7fb016200640 1 -- 172.21.15.40:0/788944794 wait complete. 2024-09-11T00:24:42.419 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:24:42.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.580+0000 7f8589200640 1 -- 172.21.15.40:0/3435059635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85840ae640 msgr2=0x7f858406edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:42.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.580+0000 7f8589200640 1 --2- 172.21.15.40:0/3435059635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85840ae640 0x7f858406edd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f858406e2a0 tx=0x7f857002a5f0 comp rx=0 tx=0).stop 2024-09-11T00:24:42.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.580+0000 7f8589200640 1 -- 172.21.15.40:0/3435059635 shutdown_connections 2024-09-11T00:24:42.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.580+0000 7f8589200640 1 --2- 172.21.15.40:0/3435059635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85840ae640 0x7f858406edd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:42.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.580+0000 7f8589200640 1 --2- 172.21.15.40:0/3435059635 >> v2:172.21.15.175:3300/0 conn(0x7f858415baa0 0x7f858406e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:42.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.580+0000 7f8589200640 1 -- 172.21.15.40:0/3435059635 >> 172.21.15.40:0/3435059635 conn(0x7f85840cf770 msgr2=0x7f85840cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:42.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.580+0000 7f8589200640 1 -- 172.21.15.40:0/3435059635 shutdown_connections 2024-09-11T00:24:42.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.580+0000 7f8589200640 1 -- 172.21.15.40:0/3435059635 wait complete. 2024-09-11T00:24:42.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.582+0000 7f8589200640 1 Processor -- start 2024-09-11T00:24:42.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.582+0000 7f8589200640 1 -- start start 2024-09-11T00:24:42.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.583+0000 7f8589200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8584073830 0x7f858414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:42.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.583+0000 7f8589200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85840ae640 0x7f85841f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:42.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.583+0000 7f8589200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f858415baa0 0x7f85841f6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:42.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.583+0000 7f8589200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f858415be80 con 0x7f8584073830 2024-09-11T00:24:42.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.583+0000 7f8589200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f85840b5760 con 0x7f85840ae640 2024-09-11T00:24:42.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.583+0000 7f8589200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f858415c000 con 0x7f858415baa0 2024-09-11T00:24:42.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.583+0000 7f8583400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8584073830 0x7f858414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:42.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.583+0000 7f8583400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8584073830 0x7f858414b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42206/0 (socket says 172.21.15.40:42206) 2024-09-11T00:24:42.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.583+0000 7f8583400640 1 -- 172.21.15.40:0/4287477461 learned_addr learned my addr 172.21.15.40:0/4287477461 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:42.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.583+0000 7f8582a00640 1 --2- 172.21.15.40:0/4287477461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85840ae640 0x7f85841f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:42.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.583+0000 7f8583e00640 1 --2- 172.21.15.40:0/4287477461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f858415baa0 0x7f85841f6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:42.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.584+0000 7f8583400640 1 -- 172.21.15.40:0/4287477461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f858415baa0 msgr2=0x7f85841f6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:42.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.584+0000 7f8583400640 1 --2- 172.21.15.40:0/4287477461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f858415baa0 0x7f85841f6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:42.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.584+0000 7f8583400640 1 -- 172.21.15.40:0/4287477461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85840ae640 msgr2=0x7f85841f5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:42.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.584+0000 7f8583400640 1 --2- 172.21.15.40:0/4287477461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85840ae640 0x7f85841f5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:42.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.584+0000 7f8583400640 1 -- 172.21.15.40:0/4287477461 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85840c8680 con 0x7f8584073830 2024-09-11T00:24:42.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.584+0000 7f8583e00640 1 --2- 172.21.15.40:0/4287477461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f858415baa0 0x7f85841f6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:42.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.584+0000 7f8583400640 1 --2- 172.21.15.40:0/4287477461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8584073830 0x7f858414b2e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f857400d6d0 tx=0x7f857400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:42.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.584+0000 7f857b400640 1 -- 172.21.15.40:0/4287477461 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8574017070 con 0x7f8584073830 2024-09-11T00:24:42.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.584+0000 7f857b400640 1 -- 172.21.15.40:0/4287477461 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8574005330 con 0x7f8584073830 2024-09-11T00:24:42.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.584+0000 7f8589200640 1 -- 172.21.15.40:0/4287477461 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85840c8960 con 0x7f8584073830 2024-09-11T00:24:42.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.584+0000 7f857b400640 1 -- 172.21.15.40:0/4287477461 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8574009820 con 0x7f8584073830 2024-09-11T00:24:42.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.584+0000 7f8589200640 1 -- 172.21.15.40:0/4287477461 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85840c9200 con 0x7f8584073830 2024-09-11T00:24:42.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.585+0000 7f8589200640 1 -- 172.21.15.40:0/4287477461 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85840c8d50 con 0x7f8584073830 2024-09-11T00:24:42.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.586+0000 7f857b400640 1 -- 172.21.15.40:0/4287477461 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8574009bd0 con 0x7f8584073830 2024-09-11T00:24:42.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.587+0000 7f857b400640 1 --2- 172.21.15.40:0/4287477461 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8564077fa0 0x7f856407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:42.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.588+0000 7f857b400640 1 -- 172.21.15.40:0/4287477461 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8574099fb0 con 0x7f8584073830 2024-09-11T00:24:42.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.588+0000 7f8582a00640 1 --2- 172.21.15.40:0/4287477461 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8564077fa0 0x7f856407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:42.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.588+0000 7f8582a00640 1 --2- 172.21.15.40:0/4287477461 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8564077fa0 0x7f856407a460 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8570033000 tx=0x7f8570004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:42.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.592+0000 7f857b400640 1 -- 172.21.15.40:0/4287477461 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8574062450 con 0x7f8584073830 2024-09-11T00:24:42.707 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:24:42.712 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:24:42.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.787+0000 7f8589200640 1 -- 172.21.15.40:0/4287477461 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f858415c520 con 0x7f8584073830 2024-09-11T00:24:42.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.788+0000 7f857b400640 1 -- 172.21.15.40:0/4287477461 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16718 (secure 0 0 0) 0x7f857406b1c0 con 0x7f8584073830 2024-09-11T00:24:42.791 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:42.791 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":34,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","created":"2024-09-11T00:23:22.512139+0000","modified":"2024-09-11T00:24:41.799407+0000","last_up_change":"2024-09-11T00:23:36.842446+0000","last_in_change":"2024-09-11T00:23:26.734953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:23:37.800502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:24:39.827986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T00:24:40.764894+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee10e123-8817-4d94-a340-73d00121af37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6801","nonce":973366008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6803","nonce":973366008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6807","nonce":973366008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6805","nonce":973366008}]},"public_addr":"172.21.15.40:6801/973366008","cluster_addr":"172.21.15.40:6803/973366008","heartbeat_back_addr":"172.21.15.40:6807/973366008","heartbeat_front_addr":"172.21.15.40:6805/973366008","state":["exists","up"]},{"osd":1,"uuid":"f90895e9-8660-42b9-8aba-3f9d4d130b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6823","nonce":2542266029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6827","nonce":2542266029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6831","nonce":2542266029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6829","nonce":2542266029}]},"public_addr":"172.21.15.40:6823/2542266029","cluster_addr":"172.21.15.40:6827/2542266029","heartbeat_back_addr":"172.21.15.40:6831/2542266029","heartbeat_front_addr":"172.21.15.40:6829/2542266029","state":["exists","up"]},{"osd":2,"uuid":"a190497a-2aba-4748-8f1d-7e372259d65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6815","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6817","nonce":559505356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6819","nonce":559505356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6826","nonce":559505356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6822","nonce":559505356}]},"public_addr":"172.21.15.40:6817/559505356","cluster_addr":"172.21.15.40:6819/559505356","heartbeat_back_addr":"172.21.15.40:6826/559505356","heartbeat_front_addr":"172.21.15.40:6822/559505356","state":["exists","up"]},{"osd":3,"uuid":"8be32ced-898a-46f2-b850-1517667766b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6809","nonce":503633839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6811","nonce":503633839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6816","nonce":503633839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6813","nonce":503633839}]},"public_addr":"172.21.15.40:6809/503633839","cluster_addr":"172.21.15.40:6811/503633839","heartbeat_back_addr":"172.21.15.40:6816/503633839","heartbeat_front_addr":"172.21.15.40:6813/503633839","state":["exists","up"]},{"osd":4,"uuid":"9867fdfc-6f93-466e-b768-b5a1da7157de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6811","nonce":2418348042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6813","nonce":2418348042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6817","nonce":2418348042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6815","nonce":2418348042}]},"public_addr":"172.21.15.175:6811/2418348042","cluster_addr":"172.21.15.175:6813/2418348042","heartbeat_back_addr":"172.21.15.175:6817/2418348042","heartbeat_front_addr":"172.21.15.175:6815/2418348042","state":["exists","up"]},{"osd":5,"uuid":"e2f6f616-b5db-466e-942f-e2762171a8ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6827","nonce":520822300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6829","nonce":520822300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6833","nonce":520822300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6831","nonce":520822300}]},"public_addr":"172.21.15.175:6827/520822300","cluster_addr":"172.21.15.175:6829/520822300","heartbeat_back_addr":"172.21.15.175:6833/520822300","heartbeat_front_addr":"172.21.15.175:6831/520822300","state":["exists","up"]},{"osd":6,"uuid":"807ac045-bf63-4ff6-9a06-7f7022f9ef32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6819","nonce":1431736593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6821","nonce":1431736593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6825","nonce":1431736593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6823","nonce":1431736593}]},"public_addr":"172.21.15.175:6819/1431736593","cluster_addr":"172.21.15.175:6821/1431736593","heartbeat_back_addr":"172.21.15.175:6825/1431736593","heartbeat_front_addr":"172.21.15.175:6823/1431736593","state":["exists","up"]},{"osd":7,"uuid":"8e0b3293-390f-4b43-b29d-babdc5e88f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6803","nonce":3300317000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6805","nonce":3300317000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6809","nonce":3300317000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6807","nonce":3300317000}]},"public_addr":"172.21.15.175:6803/3300317000","cluster_addr":"172.21.15.175:6805/3300317000","heartbeat_back_addr":"172.21.15.175:6809/3300317000","heartbeat_front_addr":"172.21.15.175:6807/3300317000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:32.967062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.266558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.063509+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.616332+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.431077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.866822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.645225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.016210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:24:42.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.791+0000 7f8589200640 1 -- 172.21.15.40:0/4287477461 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8564077fa0 msgr2=0x7f856407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:42.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.791+0000 7f8589200640 1 --2- 172.21.15.40:0/4287477461 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8564077fa0 0x7f856407a460 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8570033000 tx=0x7f8570004730 comp rx=0 tx=0).stop 2024-09-11T00:24:42.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.791+0000 7f8589200640 1 -- 172.21.15.40:0/4287477461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8584073830 msgr2=0x7f858414b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:42.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.791+0000 7f8589200640 1 --2- 172.21.15.40:0/4287477461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8584073830 0x7f858414b2e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f857400d6d0 tx=0x7f857400db90 comp rx=0 tx=0).stop 2024-09-11T00:24:42.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.791+0000 7f8589200640 1 -- 172.21.15.40:0/4287477461 shutdown_connections 2024-09-11T00:24:42.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.791+0000 7f8589200640 1 --2- 172.21.15.40:0/4287477461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f858415baa0 0x7f85841f6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:42.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.791+0000 7f8589200640 1 --2- 172.21.15.40:0/4287477461 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f8564077fa0 0x7f856407a460 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:42.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.791+0000 7f8589200640 1 --2- 172.21.15.40:0/4287477461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85840ae640 0x7f85841f5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:42.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.791+0000 7f8589200640 1 --2- 172.21.15.40:0/4287477461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8584073830 0x7f858414b2e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:42.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.791+0000 7f8589200640 1 -- 172.21.15.40:0/4287477461 >> 172.21.15.40:0/4287477461 conn(0x7f85840cf770 msgr2=0x7f85840cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:42.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.791+0000 7f8589200640 1 -- 172.21.15.40:0/4287477461 shutdown_connections 2024-09-11T00:24:42.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:42.791+0000 7f8589200640 1 -- 172.21.15.40:0/4287477461 wait complete. 2024-09-11T00:24:42.810 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:24:43.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.008+0000 7f5b0a200640 1 -- 172.21.15.40:0/3128367348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae8003a00 msgr2=0x7f5ae8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:43.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.008+0000 7f5b0a200640 1 --2- 172.21.15.40:0/3128367348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae8003a00 0x7f5ae8003e20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5af400c2e0 tx=0x7f5ae8005830 comp rx=0 tx=0).stop 2024-09-11T00:24:43.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.008+0000 7f5b03e00640 1 -- 172.21.15.40:0/3128367348 reap_dead start 2024-09-11T00:24:43.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.008+0000 7f5b0a200640 1 -- 172.21.15.40:0/3128367348 shutdown_connections 2024-09-11T00:24:43.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.008+0000 7f5b0a200640 1 -- 172.21.15.40:0/3128367348 >> 172.21.15.40:0/3128367348 conn(0x7f5b040cfbb0 msgr2=0x7f5b040cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:43.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.008+0000 7f5b0a200640 1 -- 172.21.15.40:0/3128367348 shutdown_connections 2024-09-11T00:24:43.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.008+0000 7f5b0a200640 1 -- 172.21.15.40:0/3128367348 wait complete. 2024-09-11T00:24:43.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.010+0000 7f5b0a200640 1 Processor -- start 2024-09-11T00:24:43.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.010+0000 7f5b0a200640 1 -- start start 2024-09-11T00:24:43.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.011+0000 7f5b0a200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae8003a00 0x7f5b0414ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:43.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.011+0000 7f5b0a200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b040c8b20 0x7f5b04152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:43.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.011+0000 7f5b0a200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b040c8fa0 0x7f5b04152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:43.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.011+0000 7f5b0a200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5b040735e0 con 0x7f5ae8003a00 2024-09-11T00:24:43.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.011+0000 7f5b0a200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b04073460 con 0x7f5b040c8fa0 2024-09-11T00:24:43.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.011+0000 7f5b0a200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5b04073760 con 0x7f5b040c8b20 2024-09-11T00:24:43.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.011+0000 7f5b03400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae8003a00 0x7f5b0414ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:43.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.011+0000 7f5b03400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae8003a00 0x7f5b0414ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42226/0 (socket says 172.21.15.40:42226) 2024-09-11T00:24:43.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.011+0000 7f5b03400640 1 -- 172.21.15.40:0/1424094482 learned_addr learned my addr 172.21.15.40:0/1424094482 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:43.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.011+0000 7f5afaa00640 1 --2- 172.21.15.40:0/1424094482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b040c8b20 0x7f5b04152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:43.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.011+0000 7f5b03e00640 1 --2- 172.21.15.40:0/1424094482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b040c8fa0 0x7f5b04152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:43.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.012+0000 7f5b03400640 1 -- 172.21.15.40:0/1424094482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b040c8b20 msgr2=0x7f5b04152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:43.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.012+0000 7f5b03400640 1 --2- 172.21.15.40:0/1424094482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b040c8b20 0x7f5b04152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:43.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.012+0000 7f5b03400640 1 -- 172.21.15.40:0/1424094482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b040c8fa0 msgr2=0x7f5b04152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:43.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.012+0000 7f5b03400640 1 --2- 172.21.15.40:0/1424094482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b040c8fa0 0x7f5b04152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:43.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.012+0000 7f5b03400640 1 -- 172.21.15.40:0/1424094482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b040c37b0 con 0x7f5ae8003a00 2024-09-11T00:24:43.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.012+0000 7f5b03400640 1 --2- 172.21.15.40:0/1424094482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae8003a00 0x7f5b0414ec60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5af400c3d0 tx=0x7f5af4006cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:43.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.012+0000 7f5afbe00640 1 -- 172.21.15.40:0/1424094482 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af4031030 con 0x7f5ae8003a00 2024-09-11T00:24:43.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.012+0000 7f5afbe00640 1 -- 172.21.15.40:0/1424094482 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5af40065e0 con 0x7f5ae8003a00 2024-09-11T00:24:43.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.012+0000 7f5afbe00640 1 -- 172.21.15.40:0/1424094482 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af4003a40 con 0x7f5ae8003a00 2024-09-11T00:24:43.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.012+0000 7f5b0a200640 1 -- 172.21.15.40:0/1424094482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b040c3a90 con 0x7f5ae8003a00 2024-09-11T00:24:43.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.012+0000 7f5b0a200640 1 -- 172.21.15.40:0/1424094482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b040c4050 con 0x7f5ae8003a00 2024-09-11T00:24:43.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.013+0000 7f5b0a200640 1 -- 172.21.15.40:0/1424094482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b04157c50 con 0x7f5ae8003a00 2024-09-11T00:24:43.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.015+0000 7f5afbe00640 1 -- 172.21.15.40:0/1424094482 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5af4003be0 con 0x7f5ae8003a00 2024-09-11T00:24:43.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.016+0000 7f5afbe00640 1 --2- 172.21.15.40:0/1424094482 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5ae0077f70 0x7f5ae007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:43.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.016+0000 7f5afbe00640 1 -- 172.21.15.40:0/1424094482 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f5af40b9f90 con 0x7f5ae8003a00 2024-09-11T00:24:43.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.016+0000 7f5afaa00640 1 --2- 172.21.15.40:0/1424094482 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5ae0077f70 0x7f5ae007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:43.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.017+0000 7f5afaa00640 1 --2- 172.21.15.40:0/1424094482 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5ae0077f70 0x7f5ae007a430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5b040b5ab0 tx=0x7f5aec005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:43.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.020+0000 7f5afbe00640 1 -- 172.21.15.40:0/1424094482 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5b04157c50 con 0x7f5ae8003a00 2024-09-11T00:24:43.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.213+0000 7f5b0a200640 1 -- 172.21.15.40:0/1424094482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b040747b0 con 0x7f5ae8003a00 2024-09-11T00:24:43.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.214+0000 7f5afbe00640 1 -- 172.21.15.40:0/1424094482 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16718 (secure 0 0 0) 0x7f5af408b220 con 0x7f5ae8003a00 2024-09-11T00:24:43.217 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:43.217 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":34,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","created":"2024-09-11T00:23:22.512139+0000","modified":"2024-09-11T00:24:41.799407+0000","last_up_change":"2024-09-11T00:23:36.842446+0000","last_in_change":"2024-09-11T00:23:26.734953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:23:37.800502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:24:39.827986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T00:24:40.764894+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee10e123-8817-4d94-a340-73d00121af37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6801","nonce":973366008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6803","nonce":973366008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6807","nonce":973366008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6805","nonce":973366008}]},"public_addr":"172.21.15.40:6801/973366008","cluster_addr":"172.21.15.40:6803/973366008","heartbeat_back_addr":"172.21.15.40:6807/973366008","heartbeat_front_addr":"172.21.15.40:6805/973366008","state":["exists","up"]},{"osd":1,"uuid":"f90895e9-8660-42b9-8aba-3f9d4d130b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6823","nonce":2542266029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6827","nonce":2542266029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6831","nonce":2542266029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6829","nonce":2542266029}]},"public_addr":"172.21.15.40:6823/2542266029","cluster_addr":"172.21.15.40:6827/2542266029","heartbeat_back_addr":"172.21.15.40:6831/2542266029","heartbeat_front_addr":"172.21.15.40:6829/2542266029","state":["exists","up"]},{"osd":2,"uuid":"a190497a-2aba-4748-8f1d-7e372259d65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6815","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6817","nonce":559505356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6819","nonce":559505356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6826","nonce":559505356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6822","nonce":559505356}]},"public_addr":"172.21.15.40:6817/559505356","cluster_addr":"172.21.15.40:6819/559505356","heartbeat_back_addr":"172.21.15.40:6826/559505356","heartbeat_front_addr":"172.21.15.40:6822/559505356","state":["exists","up"]},{"osd":3,"uuid":"8be32ced-898a-46f2-b850-1517667766b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6809","nonce":503633839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6811","nonce":503633839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6816","nonce":503633839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6813","nonce":503633839}]},"public_addr":"172.21.15.40:6809/503633839","cluster_addr":"172.21.15.40:6811/503633839","heartbeat_back_addr":"172.21.15.40:6816/503633839","heartbeat_front_addr":"172.21.15.40:6813/503633839","state":["exists","up"]},{"osd":4,"uuid":"9867fdfc-6f93-466e-b768-b5a1da7157de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6811","nonce":2418348042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6813","nonce":2418348042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6817","nonce":2418348042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6815","nonce":2418348042}]},"public_addr":"172.21.15.175:6811/2418348042","cluster_addr":"172.21.15.175:6813/2418348042","heartbeat_back_addr":"172.21.15.175:6817/2418348042","heartbeat_front_addr":"172.21.15.175:6815/2418348042","state":["exists","up"]},{"osd":5,"uuid":"e2f6f616-b5db-466e-942f-e2762171a8ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6827","nonce":520822300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6829","nonce":520822300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6833","nonce":520822300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6831","nonce":520822300}]},"public_addr":"172.21.15.175:6827/520822300","cluster_addr":"172.21.15.175:6829/520822300","heartbeat_back_addr":"172.21.15.175:6833/520822300","heartbeat_front_addr":"172.21.15.175:6831/520822300","state":["exists","up"]},{"osd":6,"uuid":"807ac045-bf63-4ff6-9a06-7f7022f9ef32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6819","nonce":1431736593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6821","nonce":1431736593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6825","nonce":1431736593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6823","nonce":1431736593}]},"public_addr":"172.21.15.175:6819/1431736593","cluster_addr":"172.21.15.175:6821/1431736593","heartbeat_back_addr":"172.21.15.175:6825/1431736593","heartbeat_front_addr":"172.21.15.175:6823/1431736593","state":["exists","up"]},{"osd":7,"uuid":"8e0b3293-390f-4b43-b29d-babdc5e88f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6803","nonce":3300317000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6805","nonce":3300317000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6809","nonce":3300317000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6807","nonce":3300317000}]},"public_addr":"172.21.15.175:6803/3300317000","cluster_addr":"172.21.15.175:6805/3300317000","heartbeat_back_addr":"172.21.15.175:6809/3300317000","heartbeat_front_addr":"172.21.15.175:6807/3300317000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:32.967062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.266558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.063509+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.616332+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.431077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.866822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.645225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.016210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:24:43.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.217+0000 7f5b0a200640 1 -- 172.21.15.40:0/1424094482 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5ae0077f70 msgr2=0x7f5ae007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:43.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.217+0000 7f5b0a200640 1 --2- 172.21.15.40:0/1424094482 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5ae0077f70 0x7f5ae007a430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5b040b5ab0 tx=0x7f5aec005f90 comp rx=0 tx=0).stop 2024-09-11T00:24:43.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.217+0000 7f5b0a200640 1 -- 172.21.15.40:0/1424094482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae8003a00 msgr2=0x7f5b0414ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:43.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.217+0000 7f5b0a200640 1 --2- 172.21.15.40:0/1424094482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae8003a00 0x7f5b0414ec60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5af400c3d0 tx=0x7f5af4006cc0 comp rx=0 tx=0).stop 2024-09-11T00:24:43.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.217+0000 7f5b0a200640 1 -- 172.21.15.40:0/1424094482 shutdown_connections 2024-09-11T00:24:43.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.217+0000 7f5b0a200640 1 --2- 172.21.15.40:0/1424094482 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5ae0077f70 0x7f5ae007a430 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:43.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.217+0000 7f5b0a200640 1 --2- 172.21.15.40:0/1424094482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b040c8fa0 0x7f5b04152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:43.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.217+0000 7f5b0a200640 1 --2- 172.21.15.40:0/1424094482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b040c8b20 0x7f5b04152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:43.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.217+0000 7f5b0a200640 1 --2- 172.21.15.40:0/1424094482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae8003a00 0x7f5b0414ec60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:43.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.217+0000 7f5b0a200640 1 -- 172.21.15.40:0/1424094482 >> 172.21.15.40:0/1424094482 conn(0x7f5b040cfbb0 msgr2=0x7f5b040cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:43.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.217+0000 7f5b0a200640 1 -- 172.21.15.40:0/1424094482 shutdown_connections 2024-09-11T00:24:43.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.217+0000 7f5b0a200640 1 -- 172.21.15.40:0/1424094482 wait complete. 2024-09-11T00:24:43.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T00:24:43.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.399+0000 7fb13a000640 1 -- 172.21.15.40:0/3585373602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb13406e910 msgr2=0x7fb13406ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:43.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.399+0000 7fb13a000640 1 --2- 172.21.15.40:0/3585373602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb13406e910 0x7fb13406ed80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb12c005fd0 tx=0x7fb12c02a8b0 comp rx=0 tx=0).stop 2024-09-11T00:24:43.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.399+0000 7fb13a000640 1 -- 172.21.15.40:0/3585373602 shutdown_connections 2024-09-11T00:24:43.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.399+0000 7fb13a000640 1 --2- 172.21.15.40:0/3585373602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb13406e910 0x7fb13406ed80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:43.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.399+0000 7fb13a000640 1 --2- 172.21.15.40:0/3585373602 >> v2:172.21.15.175:3300/0 conn(0x7fb1340cc180 0x7fb1340cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:43.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.399+0000 7fb13a000640 1 -- 172.21.15.40:0/3585373602 >> 172.21.15.40:0/3585373602 conn(0x7fb1340cfbb0 msgr2=0x7fb1340cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:43.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.399+0000 7fb13a000640 1 -- 172.21.15.40:0/3585373602 shutdown_connections 2024-09-11T00:24:43.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.399+0000 7fb13a000640 1 -- 172.21.15.40:0/3585373602 wait complete. 2024-09-11T00:24:43.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.401+0000 7fb13a000640 1 Processor -- start 2024-09-11T00:24:43.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.401+0000 7fb13a000640 1 -- start start 2024-09-11T00:24:43.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.402+0000 7fb13a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb13406e910 0x7fb1340c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:43.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.402+0000 7fb13a000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1340cc180 0x7fb1341f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:43.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.402+0000 7fb13a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13415bcc0 0x7fb134159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:43.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.402+0000 7fb13a000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb13406f2c0 con 0x7fb13406e910 2024-09-11T00:24:43.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.402+0000 7fb13a000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb13415f9d0 con 0x7fb13415bcc0 2024-09-11T00:24:43.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.402+0000 7fb13a000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb13406f440 con 0x7fb1340cc180 2024-09-11T00:24:43.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.402+0000 7fb133400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb13406e910 0x7fb1340c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:43.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.403+0000 7fb133400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb13406e910 0x7fb1340c9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42228/0 (socket says 172.21.15.40:42228) 2024-09-11T00:24:43.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.403+0000 7fb133400640 1 -- 172.21.15.40:0/4073753657 learned_addr learned my addr 172.21.15.40:0/4073753657 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:43.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.403+0000 7fb12aa00640 1 --2- 172.21.15.40:0/4073753657 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1340cc180 0x7fb1341f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:43.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.403+0000 7fb133e00640 1 --2- 172.21.15.40:0/4073753657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13415bcc0 0x7fb134159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:43.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.403+0000 7fb133400640 1 -- 172.21.15.40:0/4073753657 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1340cc180 msgr2=0x7fb1341f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:43.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.403+0000 7fb133400640 1 --2- 172.21.15.40:0/4073753657 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1340cc180 0x7fb1341f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:43.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.403+0000 7fb133400640 1 -- 172.21.15.40:0/4073753657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13415bcc0 msgr2=0x7fb134159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:43.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.403+0000 7fb133400640 1 --2- 172.21.15.40:0/4073753657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13415bcc0 0x7fb134159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:43.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.403+0000 7fb133400640 1 -- 172.21.15.40:0/4073753657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1341f2fd0 con 0x7fb13406e910 2024-09-11T00:24:43.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.404+0000 7fb133400640 1 --2- 172.21.15.40:0/4073753657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb13406e910 0x7fb1340c9490 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb12400c430 tx=0x7fb12400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:43.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.404+0000 7fb12be00640 1 -- 172.21.15.40:0/4073753657 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb124011790 con 0x7fb13406e910 2024-09-11T00:24:43.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.404+0000 7fb12be00640 1 -- 172.21.15.40:0/4073753657 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb124017070 con 0x7fb13406e910 2024-09-11T00:24:43.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.404+0000 7fb12be00640 1 -- 172.21.15.40:0/4073753657 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb124011ce0 con 0x7fb13406e910 2024-09-11T00:24:43.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.404+0000 7fb13a000640 1 -- 172.21.15.40:0/4073753657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1341f32b0 con 0x7fb13406e910 2024-09-11T00:24:43.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.405+0000 7fb13a000640 1 -- 172.21.15.40:0/4073753657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1340c3bd0 con 0x7fb13406e910 2024-09-11T00:24:43.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.406+0000 7fb13a000640 1 -- 172.21.15.40:0/4073753657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb13406f9d0 con 0x7fb13406e910 2024-09-11T00:24:43.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.407+0000 7fb12be00640 1 -- 172.21.15.40:0/4073753657 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb12401c460 con 0x7fb13406e910 2024-09-11T00:24:43.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.408+0000 7fb12be00640 1 --2- 172.21.15.40:0/4073753657 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb110077f70 0x7fb11007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:43.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.408+0000 7fb12be00640 1 -- 172.21.15.40:0/4073753657 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fb124099980 con 0x7fb13406e910 2024-09-11T00:24:43.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.408+0000 7fb12aa00640 1 --2- 172.21.15.40:0/4073753657 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb110077f70 0x7fb11007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:43.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.409+0000 7fb12aa00640 1 --2- 172.21.15.40:0/4073753657 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb110077f70 0x7fb11007a430 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb11c0095f0 tx=0x7fb11c005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:43.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.412+0000 7fb12be00640 1 -- 172.21.15.40:0/4073753657 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb124061e20 con 0x7fb13406e910 2024-09-11T00:24:43.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:43.644+0000 7fb13a000640 1 -- 172.21.15.40:0/4073753657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb134074490 con 0x7fb13406e910 2024-09-11T00:24:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.382+0000 7fb12be00640 1 -- 172.21.15.40:0/4073753657 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7fb134074490 con 0x7fb13406e910 2024-09-11T00:24:44.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.385+0000 7fb13a000640 1 -- 172.21.15.40:0/4073753657 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb110077f70 msgr2=0x7fb11007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:44.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.385+0000 7fb13a000640 1 --2- 172.21.15.40:0/4073753657 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb110077f70 0x7fb11007a430 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb11c0095f0 tx=0x7fb11c005f90 comp rx=0 tx=0).stop 2024-09-11T00:24:44.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.385+0000 7fb13a000640 1 -- 172.21.15.40:0/4073753657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb13406e910 msgr2=0x7fb1340c9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:44.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.385+0000 7fb13a000640 1 --2- 172.21.15.40:0/4073753657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb13406e910 0x7fb1340c9490 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb12400c430 tx=0x7fb12400c8f0 comp rx=0 tx=0).stop 2024-09-11T00:24:44.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.386+0000 7fb13a000640 1 -- 172.21.15.40:0/4073753657 shutdown_connections 2024-09-11T00:24:44.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.386+0000 7fb13a000640 1 --2- 172.21.15.40:0/4073753657 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb110077f70 0x7fb11007a430 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:44.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.386+0000 7fb13a000640 1 --2- 172.21.15.40:0/4073753657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13415bcc0 0x7fb134159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:44.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.386+0000 7fb13a000640 1 --2- 172.21.15.40:0/4073753657 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1340cc180 0x7fb1341f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:44.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.386+0000 7fb13a000640 1 --2- 172.21.15.40:0/4073753657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb13406e910 0x7fb1340c9490 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:44.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.386+0000 7fb13a000640 1 -- 172.21.15.40:0/4073753657 >> 172.21.15.40:0/4073753657 conn(0x7fb1340cfbb0 msgr2=0x7fb1340cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:44.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.386+0000 7fb13a000640 1 -- 172.21.15.40:0/4073753657 shutdown_connections 2024-09-11T00:24:44.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.386+0000 7fb13a000640 1 -- 172.21.15.40:0/4073753657 wait complete. 2024-09-11T00:24:44.406 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T00:24:44.406 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T00:24:44.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.574+0000 7f652b600640 1 -- 172.21.15.40:0/1409704450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6508004800 msgr2=0x7f6508004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.574+0000 7f652b600640 1 --2- 172.21.15.40:0/1409704450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6508004800 0x7f6508004c80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f650c009b20 tx=0x7f6508005830 comp rx=0 tx=0).stop 2024-09-11T00:24:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.575+0000 7f652b600640 1 -- 172.21.15.40:0/1409704450 shutdown_connections 2024-09-11T00:24:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.575+0000 7f652b600640 1 --2- 172.21.15.40:0/1409704450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6508004800 0x7f6508004c80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.575+0000 7f652b600640 1 -- 172.21.15.40:0/1409704450 >> 172.21.15.40:0/1409704450 conn(0x7f65240cfbb0 msgr2=0x7f65240cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.575+0000 7f652b600640 1 -- 172.21.15.40:0/1409704450 shutdown_connections 2024-09-11T00:24:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.575+0000 7f652b600640 1 -- 172.21.15.40:0/1409704450 wait complete. 2024-09-11T00:24:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.576+0000 7f652b600640 1 Processor -- start 2024-09-11T00:24:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.576+0000 7f652b600640 1 -- start start 2024-09-11T00:24:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.577+0000 7f652b600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6508004800 0x7f65241f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.577+0000 7f652b600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65240b4a10 0x7f65241570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.577+0000 7f652b600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65241588c0 0x7f6524158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.577+0000 7f652b600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f65240cb420 con 0x7f6508004800 2024-09-11T00:24:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.577+0000 7f652b600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f652415f9d0 con 0x7f65240b4a10 2024-09-11T00:24:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.577+0000 7f652b600640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f65240cb5a0 con 0x7f65241588c0 2024-09-11T00:24:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.577+0000 7f6528c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6508004800 0x7f65241f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.578+0000 7f6528c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6508004800 0x7f65241f4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42250/0 (socket says 172.21.15.40:42250) 2024-09-11T00:24:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.578+0000 7f6528c00640 1 -- 172.21.15.40:0/1354657310 learned_addr learned my addr 172.21.15.40:0/1354657310 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.578+0000 7f6529600640 1 --2- 172.21.15.40:0/1354657310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65241588c0 0x7f6524158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.578+0000 7f651be00640 1 --2- 172.21.15.40:0/1354657310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65240b4a10 0x7f65241570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.578+0000 7f6528c00640 1 -- 172.21.15.40:0/1354657310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65241588c0 msgr2=0x7f6524158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.578+0000 7f6528c00640 1 --2- 172.21.15.40:0/1354657310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65241588c0 0x7f6524158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.578+0000 7f6528c00640 1 -- 172.21.15.40:0/1354657310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65240b4a10 msgr2=0x7f65241570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.578+0000 7f6528c00640 1 --2- 172.21.15.40:0/1354657310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65240b4a10 0x7f65241570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.578+0000 7f6528c00640 1 -- 172.21.15.40:0/1354657310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65241f5460 con 0x7f6508004800 2024-09-11T00:24:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.578+0000 7f651be00640 1 --2- 172.21.15.40:0/1354657310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65240b4a10 0x7f65241570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.578+0000 7f6528c00640 1 --2- 172.21.15.40:0/1354657310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6508004800 0x7f65241f4f20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f65140066e0 tx=0x7f65140039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.578+0000 7f6521600640 1 -- 172.21.15.40:0/1354657310 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6514011700 con 0x7f6508004800 2024-09-11T00:24:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.578+0000 7f6521600640 1 -- 172.21.15.40:0/1354657310 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6514016020 con 0x7f6508004800 2024-09-11T00:24:44.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.578+0000 7f6521600640 1 -- 172.21.15.40:0/1354657310 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6514011b60 con 0x7f6508004800 2024-09-11T00:24:44.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.579+0000 7f652b600640 1 -- 172.21.15.40:0/1354657310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65240b2a80 con 0x7f6508004800 2024-09-11T00:24:44.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.579+0000 7f652b600640 1 -- 172.21.15.40:0/1354657310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65240b3040 con 0x7f6508004800 2024-09-11T00:24:44.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.580+0000 7f652b600640 1 -- 172.21.15.40:0/1354657310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65240cbac0 con 0x7f6508004800 2024-09-11T00:24:44.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.581+0000 7f6521600640 1 -- 172.21.15.40:0/1354657310 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f651401b410 con 0x7f6508004800 2024-09-11T00:24:44.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.582+0000 7f6521600640 1 --2- 172.21.15.40:0/1354657310 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6500077fa0 0x7f650007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:44.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.582+0000 7f6521600640 1 -- 172.21.15.40:0/1354657310 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f651409a8a0 con 0x7f6508004800 2024-09-11T00:24:44.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.582+0000 7f651be00640 1 --2- 172.21.15.40:0/1354657310 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6500077fa0 0x7f650007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:44.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.583+0000 7f651be00640 1 --2- 172.21.15.40:0/1354657310 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6500077fa0 0x7f650007a460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f650c035000 tx=0x7f650c0046c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:44.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.586+0000 7f6521600640 1 -- 172.21.15.40:0/1354657310 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6514020020 con 0x7f6508004800 2024-09-11T00:24:44.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:44.817+0000 7f652b600640 1 -- 172.21.15.40:0/1354657310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6524074560 con 0x7f6508004800 2024-09-11T00:24:45.329 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-11T00:24:45.326+0000 7fc2ee400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T00:24:45.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.384+0000 7f6521600640 1 -- 172.21.15.40:0/1354657310 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f6514063310 con 0x7f6508004800 2024-09-11T00:24:45.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.387+0000 7f652b600640 1 -- 172.21.15.40:0/1354657310 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6500077fa0 msgr2=0x7f650007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:45.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.387+0000 7f652b600640 1 --2- 172.21.15.40:0/1354657310 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6500077fa0 0x7f650007a460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f650c035000 tx=0x7f650c0046c0 comp rx=0 tx=0).stop 2024-09-11T00:24:45.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.387+0000 7f652b600640 1 -- 172.21.15.40:0/1354657310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6508004800 msgr2=0x7f65241f4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:45.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.387+0000 7f652b600640 1 --2- 172.21.15.40:0/1354657310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6508004800 0x7f65241f4f20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f65140066e0 tx=0x7f65140039c0 comp rx=0 tx=0).stop 2024-09-11T00:24:45.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.387+0000 7f652b600640 1 -- 172.21.15.40:0/1354657310 shutdown_connections 2024-09-11T00:24:45.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.387+0000 7f652b600640 1 --2- 172.21.15.40:0/1354657310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65241588c0 0x7f6524158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:45.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.387+0000 7f652b600640 1 --2- 172.21.15.40:0/1354657310 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6500077fa0 0x7f650007a460 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:45.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.387+0000 7f652b600640 1 --2- 172.21.15.40:0/1354657310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65240b4a10 0x7f65241570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:45.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.387+0000 7f652b600640 1 --2- 172.21.15.40:0/1354657310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6508004800 0x7f65241f4f20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:45.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.387+0000 7f652b600640 1 -- 172.21.15.40:0/1354657310 >> 172.21.15.40:0/1354657310 conn(0x7f65240cfbb0 msgr2=0x7f652406f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:45.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.387+0000 7f652b600640 1 -- 172.21.15.40:0/1354657310 shutdown_connections 2024-09-11T00:24:45.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.387+0000 7f652b600640 1 -- 172.21.15.40:0/1354657310 wait complete. 2024-09-11T00:24:45.409 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T00:24:45.409 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:24:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.570+0000 7f619b200640 1 -- 172.21.15.40:0/338114918 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61940ce840 msgr2=0x7f619406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.570+0000 7f619b200640 1 --2- 172.21.15.40:0/338114918 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61940ce840 0x7f619406e550 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f61940c3330 tx=0x7f618c02aa30 comp rx=0 tx=0).stop 2024-09-11T00:24:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.570+0000 7f619b200640 1 -- 172.21.15.40:0/338114918 shutdown_connections 2024-09-11T00:24:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.570+0000 7f619b200640 1 --2- 172.21.15.40:0/338114918 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61940ce840 0x7f619406e550 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.570+0000 7f619b200640 1 --2- 172.21.15.40:0/338114918 >> v2:172.21.15.175:3300/0 conn(0x7f619415ad80 0x7f61940ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.570+0000 7f619b200640 1 -- 172.21.15.40:0/338114918 >> 172.21.15.40:0/338114918 conn(0x7f61940cfbb0 msgr2=0x7f61940cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.570+0000 7f619b200640 1 -- 172.21.15.40:0/338114918 shutdown_connections 2024-09-11T00:24:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.570+0000 7f619b200640 1 -- 172.21.15.40:0/338114918 wait complete. 2024-09-11T00:24:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.572+0000 7f619b200640 1 Processor -- start 2024-09-11T00:24:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.572+0000 7f619b200640 1 -- start start 2024-09-11T00:24:45.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.573+0000 7f619b200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61940ca200 0x7f61940b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.573+0000 7f619b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61940ce840 0x7f6194073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.573+0000 7f619b200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f619415ad80 0x7f6194073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.573+0000 7f619b200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6194154650 con 0x7f619415ad80 2024-09-11T00:24:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.573+0000 7f619b200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f619415b210 con 0x7f61940ce840 2024-09-11T00:24:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.573+0000 7f619b200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f61941547d0 con 0x7f61940ca200 2024-09-11T00:24:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.573+0000 7f6199200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f619415ad80 0x7f6194073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.573+0000 7f6199200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f619415ad80 0x7f6194073ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42264/0 (socket says 172.21.15.40:42264) 2024-09-11T00:24:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.573+0000 7f6199200640 1 -- 172.21.15.40:0/3718299327 learned_addr learned my addr 172.21.15.40:0/3718299327 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.573+0000 7f618b400640 1 --2- 172.21.15.40:0/3718299327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61940ce840 0x7f6194073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.573+0000 7f6193e00640 1 --2- 172.21.15.40:0/3718299327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61940ca200 0x7f61940b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:45.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.574+0000 7f6199200640 1 -- 172.21.15.40:0/3718299327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61940ca200 msgr2=0x7f61940b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:45.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.574+0000 7f6199200640 1 --2- 172.21.15.40:0/3718299327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61940ca200 0x7f61940b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:45.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.574+0000 7f6199200640 1 -- 172.21.15.40:0/3718299327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61940ce840 msgr2=0x7f6194073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:45.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.574+0000 7f6199200640 1 --2- 172.21.15.40:0/3718299327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61940ce840 0x7f6194073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.574+0000 7f6199200640 1 -- 172.21.15.40:0/3718299327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61941f8b60 con 0x7f619415ad80 2024-09-11T00:24:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.574+0000 7f6199200640 1 --2- 172.21.15.40:0/3718299327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f619415ad80 0x7f6194073ab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f618c009d60 tx=0x7f618c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.574+0000 7f6190c00640 1 -- 172.21.15.40:0/3718299327 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c047070 con 0x7f619415ad80 2024-09-11T00:24:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.574+0000 7f6190c00640 1 -- 172.21.15.40:0/3718299327 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f618c004250 con 0x7f619415ad80 2024-09-11T00:24:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.574+0000 7f6190c00640 1 -- 172.21.15.40:0/3718299327 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c033050 con 0x7f619415ad80 2024-09-11T00:24:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.574+0000 7f619b200640 1 -- 172.21.15.40:0/3718299327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61941f8e40 con 0x7f619415ad80 2024-09-11T00:24:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.575+0000 7f619b200640 1 -- 172.21.15.40:0/3718299327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61941f9400 con 0x7f619415ad80 2024-09-11T00:24:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.575+0000 7f619b200640 1 -- 172.21.15.40:0/3718299327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61940707f0 con 0x7f619415ad80 2024-09-11T00:24:45.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.577+0000 7f6190c00640 1 -- 172.21.15.40:0/3718299327 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f618c004680 con 0x7f619415ad80 2024-09-11T00:24:45.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.578+0000 7f6190c00640 1 --2- 172.21.15.40:0/3718299327 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6170077f70 0x7f617007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:45.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.578+0000 7f6190c00640 1 -- 172.21.15.40:0/3718299327 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f618c0bb2b0 con 0x7f619415ad80 2024-09-11T00:24:45.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.579+0000 7f6193e00640 1 --2- 172.21.15.40:0/3718299327 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6170077f70 0x7f617007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:45.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.579+0000 7f6193e00640 1 --2- 172.21.15.40:0/3718299327 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6170077f70 0x7f617007a430 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6184001720 tx=0x7f6184009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:45.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.582+0000 7f6190c00640 1 -- 172.21.15.40:0/3718299327 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f618c083750 con 0x7f619415ad80 2024-09-11T00:24:45.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.813+0000 7f619b200640 1 -- 172.21.15.40:0/3718299327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61940c31e0 con 0x7f619415ad80 2024-09-11T00:24:45.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.813+0000 7f6190c00640 1 -- 172.21.15.40:0/3718299327 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7f618c088180 con 0x7f619415ad80 2024-09-11T00:24:45.816 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:45.816 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"btime":"2024-09-11T00:24:45:383933+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2499570202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2499570202},{"type":"v1","addr":"172.21.15.40:6835","nonce":2499570202}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4885,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2232689934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2232689934},{"type":"v1","addr":"172.21.15.175:6836","nonce":2232689934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/4012257321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":4012257321},{"type":"v1","addr":"172.21.15.175:6837","nonce":4012257321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:24:41.799375+0000","modified":"2024-09-11T00:24:44.819725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/2666966234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2666966234},{"type":"v1","addr":"172.21.15.40:6834","nonce":2666966234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4944,"qdb_cluster":[4944]},"id":2}]} 2024-09-11T00:24:45.816 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 16 2024-09-11T00:24:45.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.816+0000 7f619b200640 1 -- 172.21.15.40:0/3718299327 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6170077f70 msgr2=0x7f617007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:45.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.816+0000 7f619b200640 1 --2- 172.21.15.40:0/3718299327 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6170077f70 0x7f617007a430 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6184001720 tx=0x7f6184009040 comp rx=0 tx=0).stop 2024-09-11T00:24:45.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.816+0000 7f619b200640 1 -- 172.21.15.40:0/3718299327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f619415ad80 msgr2=0x7f6194073ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:45.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.816+0000 7f619b200640 1 --2- 172.21.15.40:0/3718299327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f619415ad80 0x7f6194073ab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f618c009d60 tx=0x7f618c003f10 comp rx=0 tx=0).stop 2024-09-11T00:24:45.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.816+0000 7f619b200640 1 -- 172.21.15.40:0/3718299327 shutdown_connections 2024-09-11T00:24:45.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.816+0000 7f619b200640 1 --2- 172.21.15.40:0/3718299327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f619415ad80 0x7f6194073ab0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:45.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.816+0000 7f619b200640 1 --2- 172.21.15.40:0/3718299327 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f6170077f70 0x7f617007a430 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:45.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.816+0000 7f619b200640 1 --2- 172.21.15.40:0/3718299327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61940ce840 0x7f6194073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:45.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.816+0000 7f619b200640 1 --2- 172.21.15.40:0/3718299327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61940ca200 0x7f61940b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:45.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.816+0000 7f619b200640 1 -- 172.21.15.40:0/3718299327 >> 172.21.15.40:0/3718299327 conn(0x7f61940cfbb0 msgr2=0x7f61940af630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:45.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.816+0000 7f619b200640 1 -- 172.21.15.40:0/3718299327 shutdown_connections 2024-09-11T00:24:45.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.816+0000 7f619b200640 1 -- 172.21.15.40:0/3718299327 wait complete. 2024-09-11T00:24:45.833 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:24:45.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.991+0000 7f1d3e200640 1 -- 172.21.15.40:0/2584617845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d38072730 msgr2=0x7f1d3806ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:45.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.991+0000 7f1d3e200640 1 --2- 172.21.15.40:0/2584617845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d38072730 0x7f1d3806ee10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1d20005fd0 tx=0x7f1d2002a5d0 comp rx=0 tx=0).stop 2024-09-11T00:24:45.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.991+0000 7f1d3e200640 1 -- 172.21.15.40:0/2584617845 shutdown_connections 2024-09-11T00:24:45.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.991+0000 7f1d3e200640 1 --2- 172.21.15.40:0/2584617845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d38072730 0x7f1d3806ee10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:45.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.991+0000 7f1d3e200640 1 --2- 172.21.15.40:0/2584617845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d3815e080 0x7f1d380d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:45.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.991+0000 7f1d3e200640 1 -- 172.21.15.40:0/2584617845 >> 172.21.15.40:0/2584617845 conn(0x7f1d380cf770 msgr2=0x7f1d380cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:45.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.991+0000 7f1d3e200640 1 -- 172.21.15.40:0/2584617845 shutdown_connections 2024-09-11T00:24:45.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.991+0000 7f1d3e200640 1 -- 172.21.15.40:0/2584617845 wait complete. 2024-09-11T00:24:45.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.993+0000 7f1d3e200640 1 Processor -- start 2024-09-11T00:24:45.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.993+0000 7f1d3e200640 1 -- start start 2024-09-11T00:24:45.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.994+0000 7f1d3e200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d3806f350 0x7f1d381f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:45.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.994+0000 7f1d3e200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d38072730 0x7f1d38159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:45.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.994+0000 7f1d3e200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d3815e080 0x7f1d3814c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:45.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.994+0000 7f1d3e200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3806fb60 con 0x7f1d3815e080 2024-09-11T00:24:45.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.994+0000 7f1d3e200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3806f9e0 con 0x7f1d38072730 2024-09-11T00:24:45.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.994+0000 7f1d3e200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1d3815eda0 con 0x7f1d3806f350 2024-09-11T00:24:45.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.994+0000 7f1d3d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d3815e080 0x7f1d3814c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:45.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.994+0000 7f1d3d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d3815e080 0x7f1d3814c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42278/0 (socket says 172.21.15.40:42278) 2024-09-11T00:24:45.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.994+0000 7f1d3d800640 1 -- 172.21.15.40:0/977091288 learned_addr learned my addr 172.21.15.40:0/977091288 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:45.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.994+0000 7f1d2fe00640 1 --2- 172.21.15.40:0/977091288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d38072730 0x7f1d38159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:45.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.994+0000 7f1d3ce00640 1 --2- 172.21.15.40:0/977091288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d3806f350 0x7f1d381f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:45.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.994+0000 7f1d3d800640 1 -- 172.21.15.40:0/977091288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d3806f350 msgr2=0x7f1d381f69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:45.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.994+0000 7f1d3d800640 1 --2- 172.21.15.40:0/977091288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d3806f350 0x7f1d381f69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:45.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.994+0000 7f1d3d800640 1 -- 172.21.15.40:0/977091288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d38072730 msgr2=0x7f1d38159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:45.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.994+0000 7f1d3d800640 1 --2- 172.21.15.40:0/977091288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d38072730 0x7f1d38159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:45.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.994+0000 7f1d3d800640 1 -- 172.21.15.40:0/977091288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d380c3480 con 0x7f1d3815e080 2024-09-11T00:24:45.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.994+0000 7f1d2fe00640 1 --2- 172.21.15.40:0/977091288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d38072730 0x7f1d38159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:45.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.995+0000 7f1d3d800640 1 --2- 172.21.15.40:0/977091288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d3815e080 0x7f1d3814c740 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000c7a0 tx=0x7f1d3000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:45.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.995+0000 7f1d35600640 1 -- 172.21.15.40:0/977091288 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d30003b70 con 0x7f1d3815e080 2024-09-11T00:24:45.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.995+0000 7f1d35600640 1 -- 172.21.15.40:0/977091288 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d30003d30 con 0x7f1d3815e080 2024-09-11T00:24:45.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.995+0000 7f1d35600640 1 -- 172.21.15.40:0/977091288 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3000aab0 con 0x7f1d3815e080 2024-09-11T00:24:45.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.995+0000 7f1d3e200640 1 -- 172.21.15.40:0/977091288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d380c3760 con 0x7f1d3815e080 2024-09-11T00:24:45.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.995+0000 7f1d3e200640 1 -- 172.21.15.40:0/977091288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d380c3d20 con 0x7f1d3815e080 2024-09-11T00:24:46.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.996+0000 7f1d3e200640 1 -- 172.21.15.40:0/977091288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d3815f300 con 0x7f1d3815e080 2024-09-11T00:24:46.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.998+0000 7f1d35600640 1 -- 172.21.15.40:0/977091288 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1d3000ac50 con 0x7f1d3815e080 2024-09-11T00:24:46.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.998+0000 7f1d35600640 1 --2- 172.21.15.40:0/977091288 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1d14077f70 0x7f1d1407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:46.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.999+0000 7f1d35600640 1 -- 172.21.15.40:0/977091288 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f1d30099ce0 con 0x7f1d3815e080 2024-09-11T00:24:46.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:45.999+0000 7f1d3ce00640 1 --2- 172.21.15.40:0/977091288 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1d14077f70 0x7f1d1407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:46.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.000+0000 7f1d3ce00640 1 --2- 172.21.15.40:0/977091288 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1d14077f70 0x7f1d1407a430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009ac0 tx=0x7f1d28005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:46.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.002+0000 7f1d35600640 1 -- 172.21.15.40:0/977091288 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1d300626c0 con 0x7f1d3815e080 2024-09-11T00:24:46.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.199+0000 7f1d3e200640 1 -- 172.21.15.40:0/977091288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d380cb770 con 0x7f1d3815e080 2024-09-11T00:24:46.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.200+0000 7f1d35600640 1 -- 172.21.15.40:0/977091288 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16705 (secure 0 0 0) 0x7f1d30061fc0 con 0x7f1d3815e080 2024-09-11T00:24:46.203 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:46.203 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","created":"2024-09-11T00:23:22.512139+0000","modified":"2024-09-11T00:24:43.371051+0000","last_up_change":"2024-09-11T00:23:36.842446+0000","last_in_change":"2024-09-11T00:23:26.734953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:23:37.800502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:24:39.827986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T00:24:40.764894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee10e123-8817-4d94-a340-73d00121af37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6801","nonce":973366008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6803","nonce":973366008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6807","nonce":973366008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6805","nonce":973366008}]},"public_addr":"172.21.15.40:6801/973366008","cluster_addr":"172.21.15.40:6803/973366008","heartbeat_back_addr":"172.21.15.40:6807/973366008","heartbeat_front_addr":"172.21.15.40:6805/973366008","state":["exists","up"]},{"osd":1,"uuid":"f90895e9-8660-42b9-8aba-3f9d4d130b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6823","nonce":2542266029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6827","nonce":2542266029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6831","nonce":2542266029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6829","nonce":2542266029}]},"public_addr":"172.21.15.40:6823/2542266029","cluster_addr":"172.21.15.40:6827/2542266029","heartbeat_back_addr":"172.21.15.40:6831/2542266029","heartbeat_front_addr":"172.21.15.40:6829/2542266029","state":["exists","up"]},{"osd":2,"uuid":"a190497a-2aba-4748-8f1d-7e372259d65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6815","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6817","nonce":559505356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6819","nonce":559505356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6826","nonce":559505356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6822","nonce":559505356}]},"public_addr":"172.21.15.40:6817/559505356","cluster_addr":"172.21.15.40:6819/559505356","heartbeat_back_addr":"172.21.15.40:6826/559505356","heartbeat_front_addr":"172.21.15.40:6822/559505356","state":["exists","up"]},{"osd":3,"uuid":"8be32ced-898a-46f2-b850-1517667766b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6809","nonce":503633839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6811","nonce":503633839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6816","nonce":503633839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6813","nonce":503633839}]},"public_addr":"172.21.15.40:6809/503633839","cluster_addr":"172.21.15.40:6811/503633839","heartbeat_back_addr":"172.21.15.40:6816/503633839","heartbeat_front_addr":"172.21.15.40:6813/503633839","state":["exists","up"]},{"osd":4,"uuid":"9867fdfc-6f93-466e-b768-b5a1da7157de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6811","nonce":2418348042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6813","nonce":2418348042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6817","nonce":2418348042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6815","nonce":2418348042}]},"public_addr":"172.21.15.175:6811/2418348042","cluster_addr":"172.21.15.175:6813/2418348042","heartbeat_back_addr":"172.21.15.175:6817/2418348042","heartbeat_front_addr":"172.21.15.175:6815/2418348042","state":["exists","up"]},{"osd":5,"uuid":"e2f6f616-b5db-466e-942f-e2762171a8ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6827","nonce":520822300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6829","nonce":520822300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6833","nonce":520822300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6831","nonce":520822300}]},"public_addr":"172.21.15.175:6827/520822300","cluster_addr":"172.21.15.175:6829/520822300","heartbeat_back_addr":"172.21.15.175:6833/520822300","heartbeat_front_addr":"172.21.15.175:6831/520822300","state":["exists","up"]},{"osd":6,"uuid":"807ac045-bf63-4ff6-9a06-7f7022f9ef32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6819","nonce":1431736593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6821","nonce":1431736593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6825","nonce":1431736593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6823","nonce":1431736593}]},"public_addr":"172.21.15.175:6819/1431736593","cluster_addr":"172.21.15.175:6821/1431736593","heartbeat_back_addr":"172.21.15.175:6825/1431736593","heartbeat_front_addr":"172.21.15.175:6823/1431736593","state":["exists","up"]},{"osd":7,"uuid":"8e0b3293-390f-4b43-b29d-babdc5e88f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6803","nonce":3300317000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6805","nonce":3300317000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6809","nonce":3300317000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6807","nonce":3300317000}]},"public_addr":"172.21.15.175:6803/3300317000","cluster_addr":"172.21.15.175:6805/3300317000","heartbeat_back_addr":"172.21.15.175:6809/3300317000","heartbeat_front_addr":"172.21.15.175:6807/3300317000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:32.967062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.266558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.063509+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.616332+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.431077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.866822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.645225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.016210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:24:46.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.203+0000 7f1d3e200640 1 -- 172.21.15.40:0/977091288 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1d14077f70 msgr2=0x7f1d1407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:46.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.203+0000 7f1d3e200640 1 --2- 172.21.15.40:0/977091288 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1d14077f70 0x7f1d1407a430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009ac0 tx=0x7f1d28005f90 comp rx=0 tx=0).stop 2024-09-11T00:24:46.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.203+0000 7f1d3e200640 1 -- 172.21.15.40:0/977091288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d3815e080 msgr2=0x7f1d3814c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:46.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.203+0000 7f1d3e200640 1 --2- 172.21.15.40:0/977091288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d3815e080 0x7f1d3814c740 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000c7a0 tx=0x7f1d3000cc60 comp rx=0 tx=0).stop 2024-09-11T00:24:46.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.203+0000 7f1d3e200640 1 -- 172.21.15.40:0/977091288 shutdown_connections 2024-09-11T00:24:46.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.203+0000 7f1d3e200640 1 --2- 172.21.15.40:0/977091288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d3815e080 0x7f1d3814c740 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:46.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.203+0000 7f1d3e200640 1 --2- 172.21.15.40:0/977091288 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1d14077f70 0x7f1d1407a430 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:46.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.203+0000 7f1d3e200640 1 --2- 172.21.15.40:0/977091288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d38072730 0x7f1d38159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:46.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.203+0000 7f1d3e200640 1 --2- 172.21.15.40:0/977091288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d3806f350 0x7f1d381f69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:46.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.203+0000 7f1d3e200640 1 -- 172.21.15.40:0/977091288 >> 172.21.15.40:0/977091288 conn(0x7f1d380cf770 msgr2=0x7f1d3806e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:46.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.203+0000 7f1d3e200640 1 -- 172.21.15.40:0/977091288 shutdown_connections 2024-09-11T00:24:46.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.203+0000 7f1d3e200640 1 -- 172.21.15.40:0/977091288 wait complete. 2024-09-11T00:24:46.221 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T00:24:46.222 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:24:46.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.379+0000 7f8113e00640 1 -- 172.21.15.40:0/3391571586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8114161d90 msgr2=0x7f8114162170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:46.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.379+0000 7f8113e00640 1 --2- 172.21.15.40:0/3391571586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8114161d90 0x7f8114162170 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8104005fd0 tx=0x7f810402a5f0 comp rx=0 tx=0).stop 2024-09-11T00:24:46.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.379+0000 7f8113e00640 1 -- 172.21.15.40:0/3391571586 shutdown_connections 2024-09-11T00:24:46.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.379+0000 7f8113e00640 1 --2- 172.21.15.40:0/3391571586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8114161d90 0x7f8114162170 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:46.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.379+0000 7f8113e00640 1 -- 172.21.15.40:0/3391571586 >> 172.21.15.40:0/3391571586 conn(0x7f81140d3ba0 msgr2=0x7f81140d3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:46.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.379+0000 7f8113e00640 1 -- 172.21.15.40:0/3391571586 shutdown_connections 2024-09-11T00:24:46.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.379+0000 7f8113e00640 1 -- 172.21.15.40:0/3391571586 wait complete. 2024-09-11T00:24:46.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.381+0000 7f8113e00640 1 Processor -- start 2024-09-11T00:24:46.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.381+0000 7f8113e00640 1 -- start start 2024-09-11T00:24:46.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.382+0000 7f8113e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f811406e280 0x7f81141f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:46.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.382+0000 7f8113e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8114161690 0x7f811415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:46.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.382+0000 7f8113e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8114161d90 0x7f81141f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:46.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.382+0000 7f8113e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f81140ce960 con 0x7f811406e280 2024-09-11T00:24:46.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.382+0000 7f8113e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f81140ce7e0 con 0x7f8114161690 2024-09-11T00:24:46.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.382+0000 7f8113e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f81140ceae0 con 0x7f8114161d90 2024-09-11T00:24:46.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.383+0000 7f8112a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f811406e280 0x7f81141f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:46.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.383+0000 7f8112a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f811406e280 0x7f81141f5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42290/0 (socket says 172.21.15.40:42290) 2024-09-11T00:24:46.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.383+0000 7f8112a00640 1 -- 172.21.15.40:0/3694174136 learned_addr learned my addr 172.21.15.40:0/3694174136 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:46.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.383+0000 7f810a000640 1 --2- 172.21.15.40:0/3694174136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8114161690 0x7f811415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:46.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.383+0000 7f8113400640 1 --2- 172.21.15.40:0/3694174136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8114161d90 0x7f81141f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:46.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.383+0000 7f8112a00640 1 -- 172.21.15.40:0/3694174136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8114161d90 msgr2=0x7f81141f7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:46.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.383+0000 7f8112a00640 1 --2- 172.21.15.40:0/3694174136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8114161d90 0x7f81141f7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:46.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.383+0000 7f8112a00640 1 -- 172.21.15.40:0/3694174136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8114161690 msgr2=0x7f811415efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:46.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.383+0000 7f8112a00640 1 --2- 172.21.15.40:0/3694174136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8114161690 0x7f811415efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:46.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.383+0000 7f8112a00640 1 -- 172.21.15.40:0/3694174136 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81141f55b0 con 0x7f811406e280 2024-09-11T00:24:46.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.383+0000 7f8112a00640 1 --2- 172.21.15.40:0/3694174136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f811406e280 0x7f81141f5070 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8104034040 tx=0x7f81040039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:46.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.384+0000 7f810b400640 1 -- 172.21.15.40:0/3694174136 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810403e030 con 0x7f811406e280 2024-09-11T00:24:46.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.384+0000 7f810b400640 1 -- 172.21.15.40:0/3694174136 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81040047a0 con 0x7f811406e280 2024-09-11T00:24:46.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.384+0000 7f810b400640 1 -- 172.21.15.40:0/3694174136 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104035040 con 0x7f811406e280 2024-09-11T00:24:46.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.384+0000 7f8113e00640 1 -- 172.21.15.40:0/3694174136 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81141f85c0 con 0x7f811406e280 2024-09-11T00:24:46.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.384+0000 7f8113e00640 1 -- 172.21.15.40:0/3694174136 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81141f4870 con 0x7f811406e280 2024-09-11T00:24:46.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.385+0000 7f8113e00640 1 -- 172.21.15.40:0/3694174136 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81141f8ae0 con 0x7f811406e280 2024-09-11T00:24:46.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.386+0000 7f810b400640 1 -- 172.21.15.40:0/3694174136 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8104004b90 con 0x7f811406e280 2024-09-11T00:24:46.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.387+0000 7f810b400640 1 --2- 172.21.15.40:0/3694174136 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f80f0077f70 0x7f80f007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:46.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.387+0000 7f810b400640 1 -- 172.21.15.40:0/3694174136 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f81040ba8c0 con 0x7f811406e280 2024-09-11T00:24:46.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.387+0000 7f810a000640 1 --2- 172.21.15.40:0/3694174136 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f80f0077f70 0x7f80f007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:46.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.388+0000 7f810a000640 1 --2- 172.21.15.40:0/3694174136 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f80f0077f70 0x7f80f007a430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f81140c98a0 tx=0x7f80fc009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:46.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.391+0000 7f810b400640 1 -- 172.21.15.40:0/3694174136 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f81141f8ae0 con 0x7f811406e280 2024-09-11T00:24:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.583+0000 7f8113e00640 1 -- 172.21.15.40:0/3694174136 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f811406dd30 con 0x7f80f0077f70 2024-09-11T00:24:46.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.588+0000 7f810b400640 1 -- 172.21.15.40:0/3694174136 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245888 (secure 0 0 0) 0x7f811406dd30 con 0x7f80f0077f70 2024-09-11T00:24:46.595 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:46.597 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T00:24:46.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.593+0000 7f8113e00640 1 -- 172.21.15.40:0/3694174136 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f80f0077f70 msgr2=0x7f80f007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:46.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.593+0000 7f8113e00640 1 --2- 172.21.15.40:0/3694174136 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f80f0077f70 0x7f80f007a430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f81140c98a0 tx=0x7f80fc009040 comp rx=0 tx=0).stop 2024-09-11T00:24:46.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.593+0000 7f8113e00640 1 -- 172.21.15.40:0/3694174136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f811406e280 msgr2=0x7f81141f5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:46.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.593+0000 7f8113e00640 1 --2- 172.21.15.40:0/3694174136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f811406e280 0x7f81141f5070 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8104034040 tx=0x7f81040039e0 comp rx=0 tx=0).stop 2024-09-11T00:24:46.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.593+0000 7f8113e00640 1 -- 172.21.15.40:0/3694174136 shutdown_connections 2024-09-11T00:24:46.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.593+0000 7f8113e00640 1 --2- 172.21.15.40:0/3694174136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8114161d90 0x7f81141f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:46.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.593+0000 7f8113e00640 1 --2- 172.21.15.40:0/3694174136 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f80f0077f70 0x7f80f007a430 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:46.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.593+0000 7f8113e00640 1 --2- 172.21.15.40:0/3694174136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8114161690 0x7f811415efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:46.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.593+0000 7f8113e00640 1 --2- 172.21.15.40:0/3694174136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f811406e280 0x7f81141f5070 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:46.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.593+0000 7f8113e00640 1 -- 172.21.15.40:0/3694174136 >> 172.21.15.40:0/3694174136 conn(0x7f81140d3ba0 msgr2=0x7f81140b2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:46.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.593+0000 7f8113e00640 1 -- 172.21.15.40:0/3694174136 shutdown_connections 2024-09-11T00:24:46.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.593+0000 7f8113e00640 1 -- 172.21.15.40:0/3694174136 wait complete. 2024-09-11T00:24:46.612 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-09-11T00:24:45.790182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224356,"kb_used_data":3960,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750364,"statfs":{"total":773094113280,"available":772864372736,"internally_reserved":0,"allocated":4055040,"data_stored":2267246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.441787"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.363156+0000","last_change":"2024-09-11T00:24:41.363156+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.363156+0000","last_undegraded":"2024-09-11T00:24:41.363156+0000","last_fullsized":"2024-09-11T00:24:41.363156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359801+0000","last_change":"2024-09-11T00:24:41.359801+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359801+0000","last_undegraded":"2024-09-11T00:24:41.359801+0000","last_fullsized":"2024-09-11T00:24:41.359801+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358253+0000","last_change":"2024-09-11T00:24:41.358253+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358253+0000","last_undegraded":"2024-09-11T00:24:41.358253+0000","last_fullsized":"2024-09-11T00:24:41.358253+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.366219+0000","last_change":"2024-09-11T00:24:41.366219+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.366219+0000","last_undegraded":"2024-09-11T00:24:41.366219+0000","last_fullsized":"2024-09-11T00:24:41.366219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.367083+0000","last_change":"2024-09-11T00:24:41.367083+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.367083+0000","last_undegraded":"2024-09-11T00:24:41.367083+0000","last_fullsized":"2024-09-11T00:24:41.367083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359992+0000","last_change":"2024-09-11T00:24:41.359992+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359992+0000","last_undegraded":"2024-09-11T00:24:41.359992+0000","last_fullsized":"2024-09-11T00:24:41.359992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.363690+0000","last_change":"2024-09-11T00:24:41.363690+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.363690+0000","last_undegraded":"2024-09-11T00:24:41.363690+0000","last_fullsized":"2024-09-11T00:24:41.363690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.365050+0000","last_change":"2024-09-11T00:24:41.365050+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.365050+0000","last_undegraded":"2024-09-11T00:24:41.365050+0000","last_fullsized":"2024-09-11T00:24:41.365050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359277+0000","last_change":"2024-09-11T00:24:41.359277+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359277+0000","last_undegraded":"2024-09-11T00:24:41.359277+0000","last_fullsized":"2024-09-11T00:24:41.359277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.366933+0000","last_change":"2024-09-11T00:24:41.366933+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.366933+0000","last_undegraded":"2024-09-11T00:24:41.366933+0000","last_fullsized":"2024-09-11T00:24:41.366933+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.365535+0000","last_change":"2024-09-11T00:24:41.365535+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.365535+0000","last_undegraded":"2024-09-11T00:24:41.365535+0000","last_fullsized":"2024-09-11T00:24:41.365535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.356887+0000","last_change":"2024-09-11T00:24:41.356887+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.356887+0000","last_undegraded":"2024-09-11T00:24:41.356887+0000","last_fullsized":"2024-09-11T00:24:41.356887+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.366274+0000","last_change":"2024-09-11T00:24:41.366274+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.366274+0000","last_undegraded":"2024-09-11T00:24:41.366274+0000","last_fullsized":"2024-09-11T00:24:41.366274+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359440+0000","last_change":"2024-09-11T00:24:41.359440+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359440+0000","last_undegraded":"2024-09-11T00:24:41.359440+0000","last_fullsized":"2024-09-11T00:24:41.359440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.357471+0000","last_change":"2024-09-11T00:24:41.357471+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.357471+0000","last_undegraded":"2024-09-11T00:24:41.357471+0000","last_fullsized":"2024-09-11T00:24:41.357471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.362678+0000","last_change":"2024-09-11T00:24:41.362678+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.362678+0000","last_undegraded":"2024-09-11T00:24:41.362678+0000","last_fullsized":"2024-09-11T00:24:41.362678+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.365193+0000","last_change":"2024-09-11T00:24:41.365193+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.365193+0000","last_undegraded":"2024-09-11T00:24:41.365193+0000","last_fullsized":"2024-09-11T00:24:41.365193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359315+0000","last_change":"2024-09-11T00:24:41.359315+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359315+0000","last_undegraded":"2024-09-11T00:24:41.359315+0000","last_fullsized":"2024-09-11T00:24:41.359315+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358922+0000","last_change":"2024-09-11T00:24:41.358922+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358922+0000","last_undegraded":"2024-09-11T00:24:41.358922+0000","last_fullsized":"2024-09-11T00:24:41.358922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.367696+0000","last_change":"2024-09-11T00:24:41.367696+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.367696+0000","last_undegraded":"2024-09-11T00:24:41.367696+0000","last_fullsized":"2024-09-11T00:24:41.367696+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358377+0000","last_change":"2024-09-11T00:24:41.358377+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358377+0000","last_undegraded":"2024-09-11T00:24:41.358377+0000","last_fullsized":"2024-09-11T00:24:41.358377+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.356661+0000","last_change":"2024-09-11T00:24:41.356661+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.356661+0000","last_undegraded":"2024-09-11T00:24:41.356661+0000","last_fullsized":"2024-09-11T00:24:41.356661+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:24:41.347717+0000","last_change":"2024-09-11T00:24:41.347717+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.347717+0000","last_undegraded":"2024-09-11T00:24:41.347717+0000","last_fullsized":"2024-09-11T00:24:41.347717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358657+0000","last_change":"2024-09-11T00:24:41.358657+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358657+0000","last_undegraded":"2024-09-11T00:24:41.358657+0000","last_fullsized":"2024-09-11T00:24:41.358657+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.366120+0000","last_change":"2024-09-11T00:24:41.366120+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.366120+0000","last_undegraded":"2024-09-11T00:24:41.366120+0000","last_fullsized":"2024-09-11T00:24:41.366120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358232+0000","last_change":"2024-09-11T00:24:41.358232+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358232+0000","last_undegraded":"2024-09-11T00:24:41.358232+0000","last_fullsized":"2024-09-11T00:24:41.358232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364192+0000","last_change":"2024-09-11T00:24:41.364192+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364192+0000","last_undegraded":"2024-09-11T00:24:41.364192+0000","last_fullsized":"2024-09-11T00:24:41.364192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.356413+0000","last_change":"2024-09-11T00:24:41.356413+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.356413+0000","last_undegraded":"2024-09-11T00:24:41.356413+0000","last_fullsized":"2024-09-11T00:24:41.356413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.357262+0000","last_change":"2024-09-11T00:24:41.357262+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.357262+0000","last_undegraded":"2024-09-11T00:24:41.357262+0000","last_fullsized":"2024-09-11T00:24:41.357262+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.366640+0000","last_change":"2024-09-11T00:24:41.366640+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.366640+0000","last_undegraded":"2024-09-11T00:24:41.366640+0000","last_fullsized":"2024-09-11T00:24:41.366640+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.361893+0000","last_change":"2024-09-11T00:24:41.361893+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.361893+0000","last_undegraded":"2024-09-11T00:24:41.361893+0000","last_fullsized":"2024-09-11T00:24:41.361893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364630+0000","last_change":"2024-09-11T00:24:41.364630+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364630+0000","last_undegraded":"2024-09-11T00:24:41.364630+0000","last_fullsized":"2024-09-11T00:24:41.364630+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:24:41.347717+0000","last_change":"2024-09-11T00:24:41.347717+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.347717+0000","last_undegraded":"2024-09-11T00:24:41.347717+0000","last_fullsized":"2024-09-11T00:24:41.347717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.377572+0000","last_change":"2024-09-11T00:24:41.375539+0000","last_active":"2024-09-11T00:24:41.377572+0000","last_peered":"2024-09-11T00:24:41.377572+0000","last_clean":"2024-09-11T00:24:41.377572+0000","last_became_active":"2024-09-11T00:24:41.375222+0000","last_became_peered":"2024-09-11T00:24:41.375222+0000","last_unstale":"2024-09-11T00:24:41.377572+0000","last_undegraded":"2024-09-11T00:24:41.377572+0000","last_fullsized":"2024-09-11T00:24:41.377572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:09.436702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.361244+0000","last_change":"2024-09-11T00:24:41.361244+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.361244+0000","last_undegraded":"2024-09-11T00:24:41.361244+0000","last_fullsized":"2024-09-11T00:24:41.361244+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T00:24:40.558594+0000","last_change":"2024-09-11T00:24:40.558594+0000","last_active":"2024-09-11T00:24:40.342329+0000","last_peered":"2024-09-11T00:24:40.342329+0000","last_clean":"2024-09-11T00:24:40.342329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:40.558594+0000","last_undegraded":"2024-09-11T00:24:40.558594+0000","last_fullsized":"2024-09-11T00:24:40.558594+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358279+0000","last_change":"2024-09-11T00:24:41.358279+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358279+0000","last_undegraded":"2024-09-11T00:24:41.358279+0000","last_fullsized":"2024-09-11T00:24:41.358279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.385350+0000","last_change":"2024-09-11T00:24:41.378757+0000","last_active":"2024-09-11T00:24:41.385350+0000","last_peered":"2024-09-11T00:24:41.385350+0000","last_clean":"2024-09-11T00:24:41.385350+0000","last_became_active":"2024-09-11T00:24:41.376929+0000","last_became_peered":"2024-09-11T00:24:41.376929+0000","last_unstale":"2024-09-11T00:24:41.385350+0000","last_undegraded":"2024-09-11T00:24:41.385350+0000","last_fullsized":"2024-09-11T00:24:41.385350+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:29.892657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.363720+0000","last_change":"2024-09-11T00:24:41.363720+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.363720+0000","last_undegraded":"2024-09-11T00:24:41.363720+0000","last_fullsized":"2024-09-11T00:24:41.363720+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.387589+0000","last_change":"2024-09-11T00:24:41.383340+0000","last_active":"2024-09-11T00:24:41.387589+0000","last_peered":"2024-09-11T00:24:41.387589+0000","last_clean":"2024-09-11T00:24:41.387589+0000","last_became_active":"2024-09-11T00:24:41.383103+0000","last_became_peered":"2024-09-11T00:24:41.383103+0000","last_unstale":"2024-09-11T00:24:41.387589+0000","last_undegraded":"2024-09-11T00:24:41.387589+0000","last_fullsized":"2024-09-11T00:24:41.387589+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:42.587573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364020+0000","last_change":"2024-09-11T00:24:41.364020+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364020+0000","last_undegraded":"2024-09-11T00:24:41.364020+0000","last_fullsized":"2024-09-11T00:24:41.364020+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.369770+0000","last_change":"2024-09-11T00:24:41.364406+0000","last_active":"2024-09-11T00:24:41.369770+0000","last_peered":"2024-09-11T00:24:41.369770+0000","last_clean":"2024-09-11T00:24:41.369770+0000","last_became_active":"2024-09-11T00:24:41.362829+0000","last_became_peered":"2024-09-11T00:24:41.362829+0000","last_unstale":"2024-09-11T00:24:41.369770+0000","last_undegraded":"2024-09-11T00:24:41.369770+0000","last_fullsized":"2024-09-11T00:24:41.369770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:25.588635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.355754+0000","last_change":"2024-09-11T00:24:41.355754+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.355754+0000","last_undegraded":"2024-09-11T00:24:41.355754+0000","last_fullsized":"2024-09-11T00:24:41.355754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.374255+0000","last_change":"2024-09-11T00:24:41.367444+0000","last_active":"2024-09-11T00:24:41.374255+0000","last_peered":"2024-09-11T00:24:41.374255+0000","last_clean":"2024-09-11T00:24:41.374255+0000","last_became_active":"2024-09-11T00:24:41.367132+0000","last_became_peered":"2024-09-11T00:24:41.367132+0000","last_unstale":"2024-09-11T00:24:41.374255+0000","last_undegraded":"2024-09-11T00:24:41.374255+0000","last_fullsized":"2024-09-11T00:24:41.374255+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:01.435017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.356222+0000","last_change":"2024-09-11T00:24:41.356222+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.356222+0000","last_undegraded":"2024-09-11T00:24:41.356222+0000","last_fullsized":"2024-09-11T00:24:41.356222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.385330+0000","last_change":"2024-09-11T00:24:41.379745+0000","last_active":"2024-09-11T00:24:41.385330+0000","last_peered":"2024-09-11T00:24:41.385330+0000","last_clean":"2024-09-11T00:24:41.385330+0000","last_became_active":"2024-09-11T00:24:41.379450+0000","last_became_peered":"2024-09-11T00:24:41.379450+0000","last_unstale":"2024-09-11T00:24:41.385330+0000","last_undegraded":"2024-09-11T00:24:41.385330+0000","last_fullsized":"2024-09-11T00:24:41.385330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:52.909342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.363964+0000","last_change":"2024-09-11T00:24:41.363964+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.363964+0000","last_undegraded":"2024-09-11T00:24:41.363964+0000","last_fullsized":"2024-09-11T00:24:41.363964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.375868+0000","last_change":"2024-09-11T00:24:41.369910+0000","last_active":"2024-09-11T00:24:41.375868+0000","last_peered":"2024-09-11T00:24:41.375868+0000","last_clean":"2024-09-11T00:24:41.375868+0000","last_became_active":"2024-09-11T00:24:41.366429+0000","last_became_peered":"2024-09-11T00:24:41.366429+0000","last_unstale":"2024-09-11T00:24:41.375868+0000","last_undegraded":"2024-09-11T00:24:41.375868+0000","last_fullsized":"2024-09-11T00:24:41.375868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:35.033907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.355750+0000","last_change":"2024-09-11T00:24:41.355750+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.355750+0000","last_undegraded":"2024-09-11T00:24:41.355750+0000","last_fullsized":"2024-09-11T00:24:41.355750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.380006+0000","last_change":"2024-09-11T00:24:41.375561+0000","last_active":"2024-09-11T00:24:41.380006+0000","last_peered":"2024-09-11T00:24:41.380006+0000","last_clean":"2024-09-11T00:24:41.380006+0000","last_became_active":"2024-09-11T00:24:41.375291+0000","last_became_peered":"2024-09-11T00:24:41.375291+0000","last_unstale":"2024-09-11T00:24:41.380006+0000","last_undegraded":"2024-09-11T00:24:41.380006+0000","last_fullsized":"2024-09-11T00:24:41.380006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:01.861466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364001+0000","last_change":"2024-09-11T00:24:41.364001+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364001+0000","last_undegraded":"2024-09-11T00:24:41.364001+0000","last_fullsized":"2024-09-11T00:24:41.364001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T00:24:40.557402+0000","last_change":"2024-09-11T00:24:40.557402+0000","last_active":"2024-09-11T00:24:40.342329+0000","last_peered":"2024-09-11T00:24:40.342329+0000","last_clean":"2024-09-11T00:24:40.342329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:40.557402+0000","last_undegraded":"2024-09-11T00:24:40.557402+0000","last_fullsized":"2024-09-11T00:24:40.557402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358380+0000","last_change":"2024-09-11T00:24:41.358380+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358380+0000","last_undegraded":"2024-09-11T00:24:41.358380+0000","last_fullsized":"2024-09-11T00:24:41.358380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.379223+0000","last_change":"2024-09-11T00:24:41.374576+0000","last_active":"2024-09-11T00:24:41.379223+0000","last_peered":"2024-09-11T00:24:41.379223+0000","last_clean":"2024-09-11T00:24:41.379223+0000","last_became_active":"2024-09-11T00:24:41.373816+0000","last_became_peered":"2024-09-11T00:24:41.373816+0000","last_unstale":"2024-09-11T00:24:41.379223+0000","last_undegraded":"2024-09-11T00:24:41.379223+0000","last_fullsized":"2024-09-11T00:24:41.379223+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:29.892657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359741+0000","last_change":"2024-09-11T00:24:41.359741+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359741+0000","last_undegraded":"2024-09-11T00:24:41.359741+0000","last_fullsized":"2024-09-11T00:24:41.359741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.384673+0000","last_change":"2024-09-11T00:24:41.378401+0000","last_active":"2024-09-11T00:24:41.384673+0000","last_peered":"2024-09-11T00:24:41.384673+0000","last_clean":"2024-09-11T00:24:41.384673+0000","last_became_active":"2024-09-11T00:24:41.377514+0000","last_became_peered":"2024-09-11T00:24:41.377514+0000","last_unstale":"2024-09-11T00:24:41.384673+0000","last_undegraded":"2024-09-11T00:24:41.384673+0000","last_fullsized":"2024-09-11T00:24:41.384673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:21:49.397863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364749+0000","last_change":"2024-09-11T00:24:41.364749+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364749+0000","last_undegraded":"2024-09-11T00:24:41.364749+0000","last_fullsized":"2024-09-11T00:24:41.364749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.373962+0000","last_change":"2024-09-11T00:24:41.369376+0000","last_active":"2024-09-11T00:24:41.373962+0000","last_peered":"2024-09-11T00:24:41.373962+0000","last_clean":"2024-09-11T00:24:41.373962+0000","last_became_active":"2024-09-11T00:24:41.369126+0000","last_became_peered":"2024-09-11T00:24:41.369126+0000","last_unstale":"2024-09-11T00:24:41.373962+0000","last_undegraded":"2024-09-11T00:24:41.373962+0000","last_fullsized":"2024-09-11T00:24:41.373962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:20.420194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358214+0000","last_change":"2024-09-11T00:24:41.358214+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358214+0000","last_undegraded":"2024-09-11T00:24:41.358214+0000","last_fullsized":"2024-09-11T00:24:41.358214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.382785+0000","last_change":"2024-09-11T00:24:41.378892+0000","last_active":"2024-09-11T00:24:41.382785+0000","last_peered":"2024-09-11T00:24:41.382785+0000","last_clean":"2024-09-11T00:24:41.382785+0000","last_became_active":"2024-09-11T00:24:41.378470+0000","last_became_peered":"2024-09-11T00:24:41.378470+0000","last_unstale":"2024-09-11T00:24:41.382785+0000","last_undegraded":"2024-09-11T00:24:41.382785+0000","last_fullsized":"2024-09-11T00:24:41.382785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:19.462270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364191+0000","last_change":"2024-09-11T00:24:41.364191+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364191+0000","last_undegraded":"2024-09-11T00:24:41.364191+0000","last_fullsized":"2024-09-11T00:24:41.364191+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.378069+0000","last_change":"2024-09-11T00:24:41.372351+0000","last_active":"2024-09-11T00:24:41.378069+0000","last_peered":"2024-09-11T00:24:41.378069+0000","last_clean":"2024-09-11T00:24:41.378069+0000","last_became_active":"2024-09-11T00:24:41.372125+0000","last_became_peered":"2024-09-11T00:24:41.372125+0000","last_unstale":"2024-09-11T00:24:41.378069+0000","last_undegraded":"2024-09-11T00:24:41.378069+0000","last_fullsized":"2024-09-11T00:24:41.378069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:28.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.360605+0000","last_change":"2024-09-11T00:24:41.360605+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.360605+0000","last_undegraded":"2024-09-11T00:24:41.360605+0000","last_fullsized":"2024-09-11T00:24:41.360605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.376463+0000","last_change":"2024-09-11T00:24:41.364238+0000","last_active":"2024-09-11T00:24:41.376463+0000","last_peered":"2024-09-11T00:24:41.376463+0000","last_clean":"2024-09-11T00:24:41.376463+0000","last_became_active":"2024-09-11T00:24:41.362593+0000","last_became_peered":"2024-09-11T00:24:41.362593+0000","last_unstale":"2024-09-11T00:24:41.376463+0000","last_undegraded":"2024-09-11T00:24:41.376463+0000","last_fullsized":"2024-09-11T00:24:41.376463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:08:39.940691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.356154+0000","last_change":"2024-09-11T00:24:41.356154+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.356154+0000","last_undegraded":"2024-09-11T00:24:41.356154+0000","last_fullsized":"2024-09-11T00:24:41.356154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.387589+0000","last_change":"2024-09-11T00:24:41.381321+0000","last_active":"2024-09-11T00:24:41.387589+0000","last_peered":"2024-09-11T00:24:41.387589+0000","last_clean":"2024-09-11T00:24:41.387589+0000","last_became_active":"2024-09-11T00:24:41.381052+0000","last_became_peered":"2024-09-11T00:24:41.381052+0000","last_unstale":"2024-09-11T00:24:41.387589+0000","last_undegraded":"2024-09-11T00:24:41.387589+0000","last_fullsized":"2024-09-11T00:24:41.387589+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:28.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359000+0000","last_change":"2024-09-11T00:24:41.359000+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359000+0000","last_undegraded":"2024-09-11T00:24:41.359000+0000","last_fullsized":"2024-09-11T00:24:41.359000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.376175+0000","last_change":"2024-09-11T00:24:41.372282+0000","last_active":"2024-09-11T00:24:41.376175+0000","last_peered":"2024-09-11T00:24:41.376175+0000","last_clean":"2024-09-11T00:24:41.376175+0000","last_became_active":"2024-09-11T00:24:41.371783+0000","last_became_peered":"2024-09-11T00:24:41.371783+0000","last_unstale":"2024-09-11T00:24:41.376175+0000","last_undegraded":"2024-09-11T00:24:41.376175+0000","last_fullsized":"2024-09-11T00:24:41.376175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:32.728539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.365454+0000","last_change":"2024-09-11T00:24:41.365454+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.365454+0000","last_undegraded":"2024-09-11T00:24:41.365454+0000","last_fullsized":"2024-09-11T00:24:41.365454+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.382993+0000","last_change":"2024-09-11T00:24:41.382162+0000","last_active":"2024-09-11T00:24:41.382993+0000","last_peered":"2024-09-11T00:24:41.382993+0000","last_clean":"2024-09-11T00:24:41.382993+0000","last_became_active":"2024-09-11T00:24:41.381878+0000","last_became_peered":"2024-09-11T00:24:41.381878+0000","last_unstale":"2024-09-11T00:24:41.382993+0000","last_undegraded":"2024-09-11T00:24:41.382993+0000","last_fullsized":"2024-09-11T00:24:41.382993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:10.872755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.372574+0000","last_change":"2024-09-11T00:24:41.372574+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.372574+0000","last_undegraded":"2024-09-11T00:24:41.372574+0000","last_fullsized":"2024-09-11T00:24:41.372574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.378249+0000","last_change":"2024-09-11T00:24:41.376338+0000","last_active":"2024-09-11T00:24:41.378249+0000","last_peered":"2024-09-11T00:24:41.378249+0000","last_clean":"2024-09-11T00:24:41.378249+0000","last_became_active":"2024-09-11T00:24:41.376049+0000","last_became_peered":"2024-09-11T00:24:41.376049+0000","last_unstale":"2024-09-11T00:24:41.378249+0000","last_undegraded":"2024-09-11T00:24:41.378249+0000","last_fullsized":"2024-09-11T00:24:41.378249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:30.444734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364446+0000","last_change":"2024-09-11T00:24:41.364446+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364446+0000","last_undegraded":"2024-09-11T00:24:41.364446+0000","last_fullsized":"2024-09-11T00:24:41.364446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T00:24:40.558040+0000","last_change":"2024-09-11T00:24:40.558040+0000","last_active":"2024-09-11T00:24:40.342329+0000","last_peered":"2024-09-11T00:24:40.342329+0000","last_clean":"2024-09-11T00:24:40.342329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:40.558040+0000","last_undegraded":"2024-09-11T00:24:40.558040+0000","last_fullsized":"2024-09-11T00:24:40.558040+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.365738+0000","last_change":"2024-09-11T00:24:41.365738+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.365738+0000","last_undegraded":"2024-09-11T00:24:41.365738+0000","last_fullsized":"2024-09-11T00:24:41.365738+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.379779+0000","last_change":"2024-09-11T00:24:41.378707+0000","last_active":"2024-09-11T00:24:41.379779+0000","last_peered":"2024-09-11T00:24:41.379779+0000","last_clean":"2024-09-11T00:24:41.379779+0000","last_became_active":"2024-09-11T00:24:41.378352+0000","last_became_peered":"2024-09-11T00:24:41.378352+0000","last_unstale":"2024-09-11T00:24:41.379779+0000","last_undegraded":"2024-09-11T00:24:41.379779+0000","last_fullsized":"2024-09-11T00:24:41.379779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:19.462270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.367480+0000","last_change":"2024-09-11T00:24:41.367480+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.367480+0000","last_undegraded":"2024-09-11T00:24:41.367480+0000","last_fullsized":"2024-09-11T00:24:41.367480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.376514+0000","last_change":"2024-09-11T00:24:41.375301+0000","last_active":"2024-09-11T00:24:41.376514+0000","last_peered":"2024-09-11T00:24:41.376514+0000","last_clean":"2024-09-11T00:24:41.376514+0000","last_became_active":"2024-09-11T00:24:41.375027+0000","last_became_peered":"2024-09-11T00:24:41.375027+0000","last_unstale":"2024-09-11T00:24:41.376514+0000","last_undegraded":"2024-09-11T00:24:41.376514+0000","last_fullsized":"2024-09-11T00:24:41.376514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:57:18.064050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364200+0000","last_change":"2024-09-11T00:24:41.364200+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364200+0000","last_undegraded":"2024-09-11T00:24:41.364200+0000","last_fullsized":"2024-09-11T00:24:41.364200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.374401+0000","last_change":"2024-09-11T00:24:41.369826+0000","last_active":"2024-09-11T00:24:41.374401+0000","last_peered":"2024-09-11T00:24:41.374401+0000","last_clean":"2024-09-11T00:24:41.374401+0000","last_became_active":"2024-09-11T00:24:41.369533+0000","last_became_peered":"2024-09-11T00:24:41.369533+0000","last_unstale":"2024-09-11T00:24:41.374401+0000","last_undegraded":"2024-09-11T00:24:41.374401+0000","last_fullsized":"2024-09-11T00:24:41.374401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:52.909342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.369899+0000","last_change":"2024-09-11T00:24:41.369899+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.369899+0000","last_undegraded":"2024-09-11T00:24:41.369899+0000","last_fullsized":"2024-09-11T00:24:41.369899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.377264+0000","last_change":"2024-09-11T00:24:41.373957+0000","last_active":"2024-09-11T00:24:41.377264+0000","last_peered":"2024-09-11T00:24:41.377264+0000","last_clean":"2024-09-11T00:24:41.377264+0000","last_became_active":"2024-09-11T00:24:41.373644+0000","last_became_peered":"2024-09-11T00:24:41.373644+0000","last_unstale":"2024-09-11T00:24:41.377264+0000","last_undegraded":"2024-09-11T00:24:41.377264+0000","last_fullsized":"2024-09-11T00:24:41.377264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:56.614698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358544+0000","last_change":"2024-09-11T00:24:41.358544+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358544+0000","last_undegraded":"2024-09-11T00:24:41.358544+0000","last_fullsized":"2024-09-11T00:24:41.358544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T00:24:40.558006+0000","last_change":"2024-09-11T00:24:40.558006+0000","last_active":"2024-09-11T00:24:40.342329+0000","last_peered":"2024-09-11T00:24:40.342329+0000","last_clean":"2024-09-11T00:24:40.342329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:40.558006+0000","last_undegraded":"2024-09-11T00:24:40.558006+0000","last_fullsized":"2024-09-11T00:24:40.558006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:24:41.347717+0000","last_change":"2024-09-11T00:24:41.347717+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.347717+0000","last_undegraded":"2024-09-11T00:24:41.347717+0000","last_fullsized":"2024-09-11T00:24:41.347717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.384967+0000","last_change":"2024-09-11T00:24:41.381021+0000","last_active":"2024-09-11T00:24:41.384967+0000","last_peered":"2024-09-11T00:24:41.384967+0000","last_clean":"2024-09-11T00:24:41.384967+0000","last_became_active":"2024-09-11T00:24:41.380749+0000","last_became_peered":"2024-09-11T00:24:41.380749+0000","last_unstale":"2024-09-11T00:24:41.384967+0000","last_undegraded":"2024-09-11T00:24:41.384967+0000","last_fullsized":"2024-09-11T00:24:41.384967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:08:39.940691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.360816+0000","last_change":"2024-09-11T00:24:41.360816+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.360816+0000","last_undegraded":"2024-09-11T00:24:41.360816+0000","last_fullsized":"2024-09-11T00:24:41.360816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T00:24:40.557406+0000","last_change":"2024-09-11T00:24:40.557406+0000","last_active":"2024-09-11T00:24:40.342329+0000","last_peered":"2024-09-11T00:24:40.342329+0000","last_clean":"2024-09-11T00:24:40.342329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:40.557406+0000","last_undegraded":"2024-09-11T00:24:40.557406+0000","last_fullsized":"2024-09-11T00:24:40.557406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:24:41.347717+0000","last_change":"2024-09-11T00:24:41.347717+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.347717+0000","last_undegraded":"2024-09-11T00:24:41.347717+0000","last_fullsized":"2024-09-11T00:24:41.347717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.377779+0000","last_change":"2024-09-11T00:24:41.373838+0000","last_active":"2024-09-11T00:24:41.377779+0000","last_peered":"2024-09-11T00:24:41.377779+0000","last_clean":"2024-09-11T00:24:41.377779+0000","last_became_active":"2024-09-11T00:24:41.373526+0000","last_became_peered":"2024-09-11T00:24:41.373526+0000","last_unstale":"2024-09-11T00:24:41.377779+0000","last_undegraded":"2024-09-11T00:24:41.377779+0000","last_fullsized":"2024-09-11T00:24:41.377779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:09.436702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358301+0000","last_change":"2024-09-11T00:24:41.358301+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358301+0000","last_undegraded":"2024-09-11T00:24:41.358301+0000","last_fullsized":"2024-09-11T00:24:41.358301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.376491+0000","last_change":"2024-09-11T00:24:41.372846+0000","last_active":"2024-09-11T00:24:41.376491+0000","last_peered":"2024-09-11T00:24:41.376491+0000","last_clean":"2024-09-11T00:24:41.376491+0000","last_became_active":"2024-09-11T00:24:41.371346+0000","last_became_peered":"2024-09-11T00:24:41.371346+0000","last_unstale":"2024-09-11T00:24:41.376491+0000","last_undegraded":"2024-09-11T00:24:41.376491+0000","last_fullsized":"2024-09-11T00:24:41.376491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:23.532245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.355983+0000","last_change":"2024-09-11T00:24:41.355983+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.355983+0000","last_undegraded":"2024-09-11T00:24:41.355983+0000","last_fullsized":"2024-09-11T00:24:41.355983+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.378211+0000","last_change":"2024-09-11T00:24:41.373748+0000","last_active":"2024-09-11T00:24:41.378211+0000","last_peered":"2024-09-11T00:24:41.378211+0000","last_clean":"2024-09-11T00:24:41.378211+0000","last_became_active":"2024-09-11T00:24:41.373149+0000","last_became_peered":"2024-09-11T00:24:41.373149+0000","last_unstale":"2024-09-11T00:24:41.378211+0000","last_undegraded":"2024-09-11T00:24:41.378211+0000","last_fullsized":"2024-09-11T00:24:41.378211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:04.897409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.366301+0000","last_change":"2024-09-11T00:24:41.366301+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.366301+0000","last_undegraded":"2024-09-11T00:24:41.366301+0000","last_fullsized":"2024-09-11T00:24:41.366301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.377914+0000","last_change":"2024-09-11T00:24:41.376801+0000","last_active":"2024-09-11T00:24:41.377914+0000","last_peered":"2024-09-11T00:24:41.377914+0000","last_clean":"2024-09-11T00:24:41.377914+0000","last_became_active":"2024-09-11T00:24:41.376493+0000","last_became_peered":"2024-09-11T00:24:41.376493+0000","last_unstale":"2024-09-11T00:24:41.377914+0000","last_undegraded":"2024-09-11T00:24:41.377914+0000","last_fullsized":"2024-09-11T00:24:41.377914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:56.614698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":132,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.367665+0000","last_change":"2024-09-11T00:23:38.923873+0000","last_active":"2024-09-11T00:24:41.367665+0000","last_peered":"2024-09-11T00:24:41.367665+0000","last_clean":"2024-09-11T00:24:41.367665+0000","last_became_active":"2024-09-11T00:23:38.920629+0000","last_became_peered":"2024-09-11T00:23:38.920629+0000","last_unstale":"2024-09-11T00:24:41.367665+0000","last_undegraded":"2024-09-11T00:24:41.367665+0000","last_fullsized":"2024-09-11T00:24:41.367665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_clean_scrub_stamp":"2024-09-11T00:23:37.844553+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.533941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":729259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":138891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":132624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":364544,"data_stored":138891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":138891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":132624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":138891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":933888,"data_stored":717175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:24:46.617 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:24:46.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.809+0000 7f2371000640 1 -- 172.21.15.40:0/290420017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f236c15f050 msgr2=0x7f236c15e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:46.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.809+0000 7f2371000640 1 --2- 172.21.15.40:0/290420017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f236c15f050 0x7f236c15e3b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2354005fd0 tx=0x7f235402a5d0 comp rx=0 tx=0).stop 2024-09-11T00:24:46.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.809+0000 7f2371000640 1 -- 172.21.15.40:0/290420017 shutdown_connections 2024-09-11T00:24:46.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.809+0000 7f2371000640 1 --2- 172.21.15.40:0/290420017 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f236c0cd780 0x7f236c0cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:46.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.809+0000 7f2371000640 1 --2- 172.21.15.40:0/290420017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f236c15f050 0x7f236c15e3b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:46.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.809+0000 7f2371000640 1 -- 172.21.15.40:0/290420017 >> 172.21.15.40:0/290420017 conn(0x7f236c0cfbb0 msgr2=0x7f236c0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:46.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.810+0000 7f2371000640 1 -- 172.21.15.40:0/290420017 shutdown_connections 2024-09-11T00:24:46.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.810+0000 7f2371000640 1 -- 172.21.15.40:0/290420017 wait complete. 2024-09-11T00:24:46.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.811+0000 7f2371000640 1 Processor -- start 2024-09-11T00:24:46.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.811+0000 7f2371000640 1 -- start start 2024-09-11T00:24:46.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.812+0000 7f2371000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f236c0cd780 0x7f236c144a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:46.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.812+0000 7f2371000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f236c15ec70 0x7f236c143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:46.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.812+0000 7f2371000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f236c15f050 0x7f236c0af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:46.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.812+0000 7f2371000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f236c168180 con 0x7f236c15ec70 2024-09-11T00:24:46.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.812+0000 7f2371000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f236c168000 con 0x7f236c15f050 2024-09-11T00:24:46.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.812+0000 7f2371000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f236c168300 con 0x7f236c0cd780 2024-09-11T00:24:46.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.812+0000 7f2361400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f236c15ec70 0x7f236c143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:46.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.812+0000 7f2361400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f236c15ec70 0x7f236c143df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42308/0 (socket says 172.21.15.40:42308) 2024-09-11T00:24:46.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.812+0000 7f2361400640 1 -- 172.21.15.40:0/3686636996 learned_addr learned my addr 172.21.15.40:0/3686636996 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:46.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.813+0000 7f236a800640 1 --2- 172.21.15.40:0/3686636996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f236c15f050 0x7f236c0af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:46.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.813+0000 7f2369e00640 1 --2- 172.21.15.40:0/3686636996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f236c0cd780 0x7f236c144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:46.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.813+0000 7f2361400640 1 -- 172.21.15.40:0/3686636996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f236c0cd780 msgr2=0x7f236c144a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:46.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.813+0000 7f2361400640 1 --2- 172.21.15.40:0/3686636996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f236c0cd780 0x7f236c144a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:46.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.813+0000 7f2361400640 1 -- 172.21.15.40:0/3686636996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f236c15f050 msgr2=0x7f236c0af4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:46.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.813+0000 7f2361400640 1 --2- 172.21.15.40:0/3686636996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f236c15f050 0x7f236c0af4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:46.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.813+0000 7f2361400640 1 -- 172.21.15.40:0/3686636996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236c0c1810 con 0x7f236c15ec70 2024-09-11T00:24:46.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.813+0000 7f2361400640 1 --2- 172.21.15.40:0/3686636996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f236c15ec70 0x7f236c143df0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2354034040 tx=0x7f23540038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:46.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.813+0000 7f2362a00640 1 -- 172.21.15.40:0/3686636996 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235403e030 con 0x7f236c15ec70 2024-09-11T00:24:46.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.814+0000 7f2362a00640 1 -- 172.21.15.40:0/3686636996 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2354003ca0 con 0x7f236c15ec70 2024-09-11T00:24:46.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.814+0000 7f2362a00640 1 -- 172.21.15.40:0/3686636996 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2354035040 con 0x7f236c15ec70 2024-09-11T00:24:46.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.814+0000 7f2371000640 1 -- 172.21.15.40:0/3686636996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f236c0cb7f0 con 0x7f236c15ec70 2024-09-11T00:24:46.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.814+0000 7f2371000640 1 -- 172.21.15.40:0/3686636996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f236c0cbad0 con 0x7f236c15ec70 2024-09-11T00:24:46.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.815+0000 7f2371000640 1 -- 172.21.15.40:0/3686636996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f236c0cdbb0 con 0x7f236c15ec70 2024-09-11T00:24:46.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.816+0000 7f2362a00640 1 -- 172.21.15.40:0/3686636996 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f23540049e0 con 0x7f236c15ec70 2024-09-11T00:24:46.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.817+0000 7f2362a00640 1 --2- 172.21.15.40:0/3686636996 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2348077f70 0x7f234807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:46.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.817+0000 7f2362a00640 1 -- 172.21.15.40:0/3686636996 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f23540ba4b0 con 0x7f236c15ec70 2024-09-11T00:24:46.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.817+0000 7f2369e00640 1 --2- 172.21.15.40:0/3686636996 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2348077f70 0x7f234807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:46.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.818+0000 7f2369e00640 1 --2- 172.21.15.40:0/3686636996 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2348077f70 0x7f234807a430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f236c06f780 tx=0x7f235c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:46.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:46.821+0000 7f2362a00640 1 -- 172.21.15.40:0/3686636996 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f23540828c0 con 0x7f236c15ec70 2024-09-11T00:24:47.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.011+0000 7f2371000640 1 -- 172.21.15.40:0/3686636996 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f236c144330 con 0x7f2348077f70 2024-09-11T00:24:47.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.016+0000 7f2362a00640 1 -- 172.21.15.40:0/3686636996 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245888 (secure 0 0 0) 0x7f236c144330 con 0x7f2348077f70 2024-09-11T00:24:47.022 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:47.023 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T00:24:47.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.020+0000 7f2371000640 1 -- 172.21.15.40:0/3686636996 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2348077f70 msgr2=0x7f234807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:47.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.020+0000 7f2371000640 1 --2- 172.21.15.40:0/3686636996 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2348077f70 0x7f234807a430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f236c06f780 tx=0x7f235c009040 comp rx=0 tx=0).stop 2024-09-11T00:24:47.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.020+0000 7f2371000640 1 -- 172.21.15.40:0/3686636996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f236c15ec70 msgr2=0x7f236c143df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:47.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.020+0000 7f2371000640 1 --2- 172.21.15.40:0/3686636996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f236c15ec70 0x7f236c143df0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2354034040 tx=0x7f23540038a0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.020+0000 7f2371000640 1 -- 172.21.15.40:0/3686636996 shutdown_connections 2024-09-11T00:24:47.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.020+0000 7f2371000640 1 --2- 172.21.15.40:0/3686636996 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2348077f70 0x7f234807a430 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.020+0000 7f2371000640 1 --2- 172.21.15.40:0/3686636996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f236c15f050 0x7f236c0af4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.020+0000 7f2371000640 1 --2- 172.21.15.40:0/3686636996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f236c15ec70 0x7f236c143df0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.020+0000 7f2371000640 1 --2- 172.21.15.40:0/3686636996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f236c0cd780 0x7f236c144a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.020+0000 7f2371000640 1 -- 172.21.15.40:0/3686636996 >> 172.21.15.40:0/3686636996 conn(0x7f236c0cfbb0 msgr2=0x7f236c0c9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:47.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.020+0000 7f2371000640 1 -- 172.21.15.40:0/3686636996 shutdown_connections 2024-09-11T00:24:47.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.020+0000 7f2371000640 1 -- 172.21.15.40:0/3686636996 wait complete. 2024-09-11T00:24:47.039 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-09-11T00:24:45.790182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224356,"kb_used_data":3960,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750364,"statfs":{"total":773094113280,"available":772864372736,"internally_reserved":0,"allocated":4055040,"data_stored":2267246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.441787"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.363156+0000","last_change":"2024-09-11T00:24:41.363156+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.363156+0000","last_undegraded":"2024-09-11T00:24:41.363156+0000","last_fullsized":"2024-09-11T00:24:41.363156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359801+0000","last_change":"2024-09-11T00:24:41.359801+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359801+0000","last_undegraded":"2024-09-11T00:24:41.359801+0000","last_fullsized":"2024-09-11T00:24:41.359801+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358253+0000","last_change":"2024-09-11T00:24:41.358253+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358253+0000","last_undegraded":"2024-09-11T00:24:41.358253+0000","last_fullsized":"2024-09-11T00:24:41.358253+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.366219+0000","last_change":"2024-09-11T00:24:41.366219+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.366219+0000","last_undegraded":"2024-09-11T00:24:41.366219+0000","last_fullsized":"2024-09-11T00:24:41.366219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.367083+0000","last_change":"2024-09-11T00:24:41.367083+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.367083+0000","last_undegraded":"2024-09-11T00:24:41.367083+0000","last_fullsized":"2024-09-11T00:24:41.367083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359992+0000","last_change":"2024-09-11T00:24:41.359992+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359992+0000","last_undegraded":"2024-09-11T00:24:41.359992+0000","last_fullsized":"2024-09-11T00:24:41.359992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.363690+0000","last_change":"2024-09-11T00:24:41.363690+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.363690+0000","last_undegraded":"2024-09-11T00:24:41.363690+0000","last_fullsized":"2024-09-11T00:24:41.363690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.365050+0000","last_change":"2024-09-11T00:24:41.365050+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.365050+0000","last_undegraded":"2024-09-11T00:24:41.365050+0000","last_fullsized":"2024-09-11T00:24:41.365050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359277+0000","last_change":"2024-09-11T00:24:41.359277+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359277+0000","last_undegraded":"2024-09-11T00:24:41.359277+0000","last_fullsized":"2024-09-11T00:24:41.359277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.366933+0000","last_change":"2024-09-11T00:24:41.366933+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.366933+0000","last_undegraded":"2024-09-11T00:24:41.366933+0000","last_fullsized":"2024-09-11T00:24:41.366933+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.365535+0000","last_change":"2024-09-11T00:24:41.365535+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.365535+0000","last_undegraded":"2024-09-11T00:24:41.365535+0000","last_fullsized":"2024-09-11T00:24:41.365535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.356887+0000","last_change":"2024-09-11T00:24:41.356887+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.356887+0000","last_undegraded":"2024-09-11T00:24:41.356887+0000","last_fullsized":"2024-09-11T00:24:41.356887+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.366274+0000","last_change":"2024-09-11T00:24:41.366274+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.366274+0000","last_undegraded":"2024-09-11T00:24:41.366274+0000","last_fullsized":"2024-09-11T00:24:41.366274+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359440+0000","last_change":"2024-09-11T00:24:41.359440+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359440+0000","last_undegraded":"2024-09-11T00:24:41.359440+0000","last_fullsized":"2024-09-11T00:24:41.359440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.357471+0000","last_change":"2024-09-11T00:24:41.357471+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.357471+0000","last_undegraded":"2024-09-11T00:24:41.357471+0000","last_fullsized":"2024-09-11T00:24:41.357471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.362678+0000","last_change":"2024-09-11T00:24:41.362678+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.362678+0000","last_undegraded":"2024-09-11T00:24:41.362678+0000","last_fullsized":"2024-09-11T00:24:41.362678+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.365193+0000","last_change":"2024-09-11T00:24:41.365193+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.365193+0000","last_undegraded":"2024-09-11T00:24:41.365193+0000","last_fullsized":"2024-09-11T00:24:41.365193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359315+0000","last_change":"2024-09-11T00:24:41.359315+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359315+0000","last_undegraded":"2024-09-11T00:24:41.359315+0000","last_fullsized":"2024-09-11T00:24:41.359315+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358922+0000","last_change":"2024-09-11T00:24:41.358922+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358922+0000","last_undegraded":"2024-09-11T00:24:41.358922+0000","last_fullsized":"2024-09-11T00:24:41.358922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.367696+0000","last_change":"2024-09-11T00:24:41.367696+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.367696+0000","last_undegraded":"2024-09-11T00:24:41.367696+0000","last_fullsized":"2024-09-11T00:24:41.367696+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358377+0000","last_change":"2024-09-11T00:24:41.358377+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358377+0000","last_undegraded":"2024-09-11T00:24:41.358377+0000","last_fullsized":"2024-09-11T00:24:41.358377+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.356661+0000","last_change":"2024-09-11T00:24:41.356661+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.356661+0000","last_undegraded":"2024-09-11T00:24:41.356661+0000","last_fullsized":"2024-09-11T00:24:41.356661+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:24:41.347717+0000","last_change":"2024-09-11T00:24:41.347717+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.347717+0000","last_undegraded":"2024-09-11T00:24:41.347717+0000","last_fullsized":"2024-09-11T00:24:41.347717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358657+0000","last_change":"2024-09-11T00:24:41.358657+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358657+0000","last_undegraded":"2024-09-11T00:24:41.358657+0000","last_fullsized":"2024-09-11T00:24:41.358657+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.366120+0000","last_change":"2024-09-11T00:24:41.366120+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.366120+0000","last_undegraded":"2024-09-11T00:24:41.366120+0000","last_fullsized":"2024-09-11T00:24:41.366120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358232+0000","last_change":"2024-09-11T00:24:41.358232+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358232+0000","last_undegraded":"2024-09-11T00:24:41.358232+0000","last_fullsized":"2024-09-11T00:24:41.358232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364192+0000","last_change":"2024-09-11T00:24:41.364192+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364192+0000","last_undegraded":"2024-09-11T00:24:41.364192+0000","last_fullsized":"2024-09-11T00:24:41.364192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.356413+0000","last_change":"2024-09-11T00:24:41.356413+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.356413+0000","last_undegraded":"2024-09-11T00:24:41.356413+0000","last_fullsized":"2024-09-11T00:24:41.356413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.357262+0000","last_change":"2024-09-11T00:24:41.357262+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.357262+0000","last_undegraded":"2024-09-11T00:24:41.357262+0000","last_fullsized":"2024-09-11T00:24:41.357262+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.366640+0000","last_change":"2024-09-11T00:24:41.366640+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.366640+0000","last_undegraded":"2024-09-11T00:24:41.366640+0000","last_fullsized":"2024-09-11T00:24:41.366640+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.361893+0000","last_change":"2024-09-11T00:24:41.361893+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.361893+0000","last_undegraded":"2024-09-11T00:24:41.361893+0000","last_fullsized":"2024-09-11T00:24:41.361893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364630+0000","last_change":"2024-09-11T00:24:41.364630+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364630+0000","last_undegraded":"2024-09-11T00:24:41.364630+0000","last_fullsized":"2024-09-11T00:24:41.364630+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:24:41.347717+0000","last_change":"2024-09-11T00:24:41.347717+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.347717+0000","last_undegraded":"2024-09-11T00:24:41.347717+0000","last_fullsized":"2024-09-11T00:24:41.347717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.377572+0000","last_change":"2024-09-11T00:24:41.375539+0000","last_active":"2024-09-11T00:24:41.377572+0000","last_peered":"2024-09-11T00:24:41.377572+0000","last_clean":"2024-09-11T00:24:41.377572+0000","last_became_active":"2024-09-11T00:24:41.375222+0000","last_became_peered":"2024-09-11T00:24:41.375222+0000","last_unstale":"2024-09-11T00:24:41.377572+0000","last_undegraded":"2024-09-11T00:24:41.377572+0000","last_fullsized":"2024-09-11T00:24:41.377572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:09.436702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.361244+0000","last_change":"2024-09-11T00:24:41.361244+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.361244+0000","last_undegraded":"2024-09-11T00:24:41.361244+0000","last_fullsized":"2024-09-11T00:24:41.361244+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T00:24:40.558594+0000","last_change":"2024-09-11T00:24:40.558594+0000","last_active":"2024-09-11T00:24:40.342329+0000","last_peered":"2024-09-11T00:24:40.342329+0000","last_clean":"2024-09-11T00:24:40.342329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:40.558594+0000","last_undegraded":"2024-09-11T00:24:40.558594+0000","last_fullsized":"2024-09-11T00:24:40.558594+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358279+0000","last_change":"2024-09-11T00:24:41.358279+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358279+0000","last_undegraded":"2024-09-11T00:24:41.358279+0000","last_fullsized":"2024-09-11T00:24:41.358279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.385350+0000","last_change":"2024-09-11T00:24:41.378757+0000","last_active":"2024-09-11T00:24:41.385350+0000","last_peered":"2024-09-11T00:24:41.385350+0000","last_clean":"2024-09-11T00:24:41.385350+0000","last_became_active":"2024-09-11T00:24:41.376929+0000","last_became_peered":"2024-09-11T00:24:41.376929+0000","last_unstale":"2024-09-11T00:24:41.385350+0000","last_undegraded":"2024-09-11T00:24:41.385350+0000","last_fullsized":"2024-09-11T00:24:41.385350+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:29.892657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.363720+0000","last_change":"2024-09-11T00:24:41.363720+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.363720+0000","last_undegraded":"2024-09-11T00:24:41.363720+0000","last_fullsized":"2024-09-11T00:24:41.363720+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.387589+0000","last_change":"2024-09-11T00:24:41.383340+0000","last_active":"2024-09-11T00:24:41.387589+0000","last_peered":"2024-09-11T00:24:41.387589+0000","last_clean":"2024-09-11T00:24:41.387589+0000","last_became_active":"2024-09-11T00:24:41.383103+0000","last_became_peered":"2024-09-11T00:24:41.383103+0000","last_unstale":"2024-09-11T00:24:41.387589+0000","last_undegraded":"2024-09-11T00:24:41.387589+0000","last_fullsized":"2024-09-11T00:24:41.387589+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:42.587573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364020+0000","last_change":"2024-09-11T00:24:41.364020+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364020+0000","last_undegraded":"2024-09-11T00:24:41.364020+0000","last_fullsized":"2024-09-11T00:24:41.364020+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.369770+0000","last_change":"2024-09-11T00:24:41.364406+0000","last_active":"2024-09-11T00:24:41.369770+0000","last_peered":"2024-09-11T00:24:41.369770+0000","last_clean":"2024-09-11T00:24:41.369770+0000","last_became_active":"2024-09-11T00:24:41.362829+0000","last_became_peered":"2024-09-11T00:24:41.362829+0000","last_unstale":"2024-09-11T00:24:41.369770+0000","last_undegraded":"2024-09-11T00:24:41.369770+0000","last_fullsized":"2024-09-11T00:24:41.369770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:25.588635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.355754+0000","last_change":"2024-09-11T00:24:41.355754+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.355754+0000","last_undegraded":"2024-09-11T00:24:41.355754+0000","last_fullsized":"2024-09-11T00:24:41.355754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.374255+0000","last_change":"2024-09-11T00:24:41.367444+0000","last_active":"2024-09-11T00:24:41.374255+0000","last_peered":"2024-09-11T00:24:41.374255+0000","last_clean":"2024-09-11T00:24:41.374255+0000","last_became_active":"2024-09-11T00:24:41.367132+0000","last_became_peered":"2024-09-11T00:24:41.367132+0000","last_unstale":"2024-09-11T00:24:41.374255+0000","last_undegraded":"2024-09-11T00:24:41.374255+0000","last_fullsized":"2024-09-11T00:24:41.374255+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:01.435017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.356222+0000","last_change":"2024-09-11T00:24:41.356222+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.356222+0000","last_undegraded":"2024-09-11T00:24:41.356222+0000","last_fullsized":"2024-09-11T00:24:41.356222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.385330+0000","last_change":"2024-09-11T00:24:41.379745+0000","last_active":"2024-09-11T00:24:41.385330+0000","last_peered":"2024-09-11T00:24:41.385330+0000","last_clean":"2024-09-11T00:24:41.385330+0000","last_became_active":"2024-09-11T00:24:41.379450+0000","last_became_peered":"2024-09-11T00:24:41.379450+0000","last_unstale":"2024-09-11T00:24:41.385330+0000","last_undegraded":"2024-09-11T00:24:41.385330+0000","last_fullsized":"2024-09-11T00:24:41.385330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:52.909342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.363964+0000","last_change":"2024-09-11T00:24:41.363964+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.363964+0000","last_undegraded":"2024-09-11T00:24:41.363964+0000","last_fullsized":"2024-09-11T00:24:41.363964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.375868+0000","last_change":"2024-09-11T00:24:41.369910+0000","last_active":"2024-09-11T00:24:41.375868+0000","last_peered":"2024-09-11T00:24:41.375868+0000","last_clean":"2024-09-11T00:24:41.375868+0000","last_became_active":"2024-09-11T00:24:41.366429+0000","last_became_peered":"2024-09-11T00:24:41.366429+0000","last_unstale":"2024-09-11T00:24:41.375868+0000","last_undegraded":"2024-09-11T00:24:41.375868+0000","last_fullsized":"2024-09-11T00:24:41.375868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:35.033907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.355750+0000","last_change":"2024-09-11T00:24:41.355750+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.355750+0000","last_undegraded":"2024-09-11T00:24:41.355750+0000","last_fullsized":"2024-09-11T00:24:41.355750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.380006+0000","last_change":"2024-09-11T00:24:41.375561+0000","last_active":"2024-09-11T00:24:41.380006+0000","last_peered":"2024-09-11T00:24:41.380006+0000","last_clean":"2024-09-11T00:24:41.380006+0000","last_became_active":"2024-09-11T00:24:41.375291+0000","last_became_peered":"2024-09-11T00:24:41.375291+0000","last_unstale":"2024-09-11T00:24:41.380006+0000","last_undegraded":"2024-09-11T00:24:41.380006+0000","last_fullsized":"2024-09-11T00:24:41.380006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:01.861466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364001+0000","last_change":"2024-09-11T00:24:41.364001+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364001+0000","last_undegraded":"2024-09-11T00:24:41.364001+0000","last_fullsized":"2024-09-11T00:24:41.364001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T00:24:40.557402+0000","last_change":"2024-09-11T00:24:40.557402+0000","last_active":"2024-09-11T00:24:40.342329+0000","last_peered":"2024-09-11T00:24:40.342329+0000","last_clean":"2024-09-11T00:24:40.342329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:40.557402+0000","last_undegraded":"2024-09-11T00:24:40.557402+0000","last_fullsized":"2024-09-11T00:24:40.557402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358380+0000","last_change":"2024-09-11T00:24:41.358380+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358380+0000","last_undegraded":"2024-09-11T00:24:41.358380+0000","last_fullsized":"2024-09-11T00:24:41.358380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.379223+0000","last_change":"2024-09-11T00:24:41.374576+0000","last_active":"2024-09-11T00:24:41.379223+0000","last_peered":"2024-09-11T00:24:41.379223+0000","last_clean":"2024-09-11T00:24:41.379223+0000","last_became_active":"2024-09-11T00:24:41.373816+0000","last_became_peered":"2024-09-11T00:24:41.373816+0000","last_unstale":"2024-09-11T00:24:41.379223+0000","last_undegraded":"2024-09-11T00:24:41.379223+0000","last_fullsized":"2024-09-11T00:24:41.379223+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:29.892657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359741+0000","last_change":"2024-09-11T00:24:41.359741+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359741+0000","last_undegraded":"2024-09-11T00:24:41.359741+0000","last_fullsized":"2024-09-11T00:24:41.359741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.384673+0000","last_change":"2024-09-11T00:24:41.378401+0000","last_active":"2024-09-11T00:24:41.384673+0000","last_peered":"2024-09-11T00:24:41.384673+0000","last_clean":"2024-09-11T00:24:41.384673+0000","last_became_active":"2024-09-11T00:24:41.377514+0000","last_became_peered":"2024-09-11T00:24:41.377514+0000","last_unstale":"2024-09-11T00:24:41.384673+0000","last_undegraded":"2024-09-11T00:24:41.384673+0000","last_fullsized":"2024-09-11T00:24:41.384673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:21:49.397863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364749+0000","last_change":"2024-09-11T00:24:41.364749+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364749+0000","last_undegraded":"2024-09-11T00:24:41.364749+0000","last_fullsized":"2024-09-11T00:24:41.364749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.373962+0000","last_change":"2024-09-11T00:24:41.369376+0000","last_active":"2024-09-11T00:24:41.373962+0000","last_peered":"2024-09-11T00:24:41.373962+0000","last_clean":"2024-09-11T00:24:41.373962+0000","last_became_active":"2024-09-11T00:24:41.369126+0000","last_became_peered":"2024-09-11T00:24:41.369126+0000","last_unstale":"2024-09-11T00:24:41.373962+0000","last_undegraded":"2024-09-11T00:24:41.373962+0000","last_fullsized":"2024-09-11T00:24:41.373962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:20.420194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358214+0000","last_change":"2024-09-11T00:24:41.358214+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358214+0000","last_undegraded":"2024-09-11T00:24:41.358214+0000","last_fullsized":"2024-09-11T00:24:41.358214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.382785+0000","last_change":"2024-09-11T00:24:41.378892+0000","last_active":"2024-09-11T00:24:41.382785+0000","last_peered":"2024-09-11T00:24:41.382785+0000","last_clean":"2024-09-11T00:24:41.382785+0000","last_became_active":"2024-09-11T00:24:41.378470+0000","last_became_peered":"2024-09-11T00:24:41.378470+0000","last_unstale":"2024-09-11T00:24:41.382785+0000","last_undegraded":"2024-09-11T00:24:41.382785+0000","last_fullsized":"2024-09-11T00:24:41.382785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:19.462270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364191+0000","last_change":"2024-09-11T00:24:41.364191+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364191+0000","last_undegraded":"2024-09-11T00:24:41.364191+0000","last_fullsized":"2024-09-11T00:24:41.364191+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.378069+0000","last_change":"2024-09-11T00:24:41.372351+0000","last_active":"2024-09-11T00:24:41.378069+0000","last_peered":"2024-09-11T00:24:41.378069+0000","last_clean":"2024-09-11T00:24:41.378069+0000","last_became_active":"2024-09-11T00:24:41.372125+0000","last_became_peered":"2024-09-11T00:24:41.372125+0000","last_unstale":"2024-09-11T00:24:41.378069+0000","last_undegraded":"2024-09-11T00:24:41.378069+0000","last_fullsized":"2024-09-11T00:24:41.378069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:28.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.360605+0000","last_change":"2024-09-11T00:24:41.360605+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.360605+0000","last_undegraded":"2024-09-11T00:24:41.360605+0000","last_fullsized":"2024-09-11T00:24:41.360605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.376463+0000","last_change":"2024-09-11T00:24:41.364238+0000","last_active":"2024-09-11T00:24:41.376463+0000","last_peered":"2024-09-11T00:24:41.376463+0000","last_clean":"2024-09-11T00:24:41.376463+0000","last_became_active":"2024-09-11T00:24:41.362593+0000","last_became_peered":"2024-09-11T00:24:41.362593+0000","last_unstale":"2024-09-11T00:24:41.376463+0000","last_undegraded":"2024-09-11T00:24:41.376463+0000","last_fullsized":"2024-09-11T00:24:41.376463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:08:39.940691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.356154+0000","last_change":"2024-09-11T00:24:41.356154+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.356154+0000","last_undegraded":"2024-09-11T00:24:41.356154+0000","last_fullsized":"2024-09-11T00:24:41.356154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.387589+0000","last_change":"2024-09-11T00:24:41.381321+0000","last_active":"2024-09-11T00:24:41.387589+0000","last_peered":"2024-09-11T00:24:41.387589+0000","last_clean":"2024-09-11T00:24:41.387589+0000","last_became_active":"2024-09-11T00:24:41.381052+0000","last_became_peered":"2024-09-11T00:24:41.381052+0000","last_unstale":"2024-09-11T00:24:41.387589+0000","last_undegraded":"2024-09-11T00:24:41.387589+0000","last_fullsized":"2024-09-11T00:24:41.387589+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:28.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359000+0000","last_change":"2024-09-11T00:24:41.359000+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359000+0000","last_undegraded":"2024-09-11T00:24:41.359000+0000","last_fullsized":"2024-09-11T00:24:41.359000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.376175+0000","last_change":"2024-09-11T00:24:41.372282+0000","last_active":"2024-09-11T00:24:41.376175+0000","last_peered":"2024-09-11T00:24:41.376175+0000","last_clean":"2024-09-11T00:24:41.376175+0000","last_became_active":"2024-09-11T00:24:41.371783+0000","last_became_peered":"2024-09-11T00:24:41.371783+0000","last_unstale":"2024-09-11T00:24:41.376175+0000","last_undegraded":"2024-09-11T00:24:41.376175+0000","last_fullsized":"2024-09-11T00:24:41.376175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:32.728539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.365454+0000","last_change":"2024-09-11T00:24:41.365454+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.365454+0000","last_undegraded":"2024-09-11T00:24:41.365454+0000","last_fullsized":"2024-09-11T00:24:41.365454+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.382993+0000","last_change":"2024-09-11T00:24:41.382162+0000","last_active":"2024-09-11T00:24:41.382993+0000","last_peered":"2024-09-11T00:24:41.382993+0000","last_clean":"2024-09-11T00:24:41.382993+0000","last_became_active":"2024-09-11T00:24:41.381878+0000","last_became_peered":"2024-09-11T00:24:41.381878+0000","last_unstale":"2024-09-11T00:24:41.382993+0000","last_undegraded":"2024-09-11T00:24:41.382993+0000","last_fullsized":"2024-09-11T00:24:41.382993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:10.872755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.372574+0000","last_change":"2024-09-11T00:24:41.372574+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.372574+0000","last_undegraded":"2024-09-11T00:24:41.372574+0000","last_fullsized":"2024-09-11T00:24:41.372574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.378249+0000","last_change":"2024-09-11T00:24:41.376338+0000","last_active":"2024-09-11T00:24:41.378249+0000","last_peered":"2024-09-11T00:24:41.378249+0000","last_clean":"2024-09-11T00:24:41.378249+0000","last_became_active":"2024-09-11T00:24:41.376049+0000","last_became_peered":"2024-09-11T00:24:41.376049+0000","last_unstale":"2024-09-11T00:24:41.378249+0000","last_undegraded":"2024-09-11T00:24:41.378249+0000","last_fullsized":"2024-09-11T00:24:41.378249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:30.444734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364446+0000","last_change":"2024-09-11T00:24:41.364446+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364446+0000","last_undegraded":"2024-09-11T00:24:41.364446+0000","last_fullsized":"2024-09-11T00:24:41.364446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T00:24:40.558040+0000","last_change":"2024-09-11T00:24:40.558040+0000","last_active":"2024-09-11T00:24:40.342329+0000","last_peered":"2024-09-11T00:24:40.342329+0000","last_clean":"2024-09-11T00:24:40.342329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:40.558040+0000","last_undegraded":"2024-09-11T00:24:40.558040+0000","last_fullsized":"2024-09-11T00:24:40.558040+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.365738+0000","last_change":"2024-09-11T00:24:41.365738+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.365738+0000","last_undegraded":"2024-09-11T00:24:41.365738+0000","last_fullsized":"2024-09-11T00:24:41.365738+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.379779+0000","last_change":"2024-09-11T00:24:41.378707+0000","last_active":"2024-09-11T00:24:41.379779+0000","last_peered":"2024-09-11T00:24:41.379779+0000","last_clean":"2024-09-11T00:24:41.379779+0000","last_became_active":"2024-09-11T00:24:41.378352+0000","last_became_peered":"2024-09-11T00:24:41.378352+0000","last_unstale":"2024-09-11T00:24:41.379779+0000","last_undegraded":"2024-09-11T00:24:41.379779+0000","last_fullsized":"2024-09-11T00:24:41.379779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:19.462270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.367480+0000","last_change":"2024-09-11T00:24:41.367480+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.367480+0000","last_undegraded":"2024-09-11T00:24:41.367480+0000","last_fullsized":"2024-09-11T00:24:41.367480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.376514+0000","last_change":"2024-09-11T00:24:41.375301+0000","last_active":"2024-09-11T00:24:41.376514+0000","last_peered":"2024-09-11T00:24:41.376514+0000","last_clean":"2024-09-11T00:24:41.376514+0000","last_became_active":"2024-09-11T00:24:41.375027+0000","last_became_peered":"2024-09-11T00:24:41.375027+0000","last_unstale":"2024-09-11T00:24:41.376514+0000","last_undegraded":"2024-09-11T00:24:41.376514+0000","last_fullsized":"2024-09-11T00:24:41.376514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:57:18.064050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364200+0000","last_change":"2024-09-11T00:24:41.364200+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364200+0000","last_undegraded":"2024-09-11T00:24:41.364200+0000","last_fullsized":"2024-09-11T00:24:41.364200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.374401+0000","last_change":"2024-09-11T00:24:41.369826+0000","last_active":"2024-09-11T00:24:41.374401+0000","last_peered":"2024-09-11T00:24:41.374401+0000","last_clean":"2024-09-11T00:24:41.374401+0000","last_became_active":"2024-09-11T00:24:41.369533+0000","last_became_peered":"2024-09-11T00:24:41.369533+0000","last_unstale":"2024-09-11T00:24:41.374401+0000","last_undegraded":"2024-09-11T00:24:41.374401+0000","last_fullsized":"2024-09-11T00:24:41.374401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:52.909342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.369899+0000","last_change":"2024-09-11T00:24:41.369899+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.369899+0000","last_undegraded":"2024-09-11T00:24:41.369899+0000","last_fullsized":"2024-09-11T00:24:41.369899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.377264+0000","last_change":"2024-09-11T00:24:41.373957+0000","last_active":"2024-09-11T00:24:41.377264+0000","last_peered":"2024-09-11T00:24:41.377264+0000","last_clean":"2024-09-11T00:24:41.377264+0000","last_became_active":"2024-09-11T00:24:41.373644+0000","last_became_peered":"2024-09-11T00:24:41.373644+0000","last_unstale":"2024-09-11T00:24:41.377264+0000","last_undegraded":"2024-09-11T00:24:41.377264+0000","last_fullsized":"2024-09-11T00:24:41.377264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:56.614698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358544+0000","last_change":"2024-09-11T00:24:41.358544+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358544+0000","last_undegraded":"2024-09-11T00:24:41.358544+0000","last_fullsized":"2024-09-11T00:24:41.358544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T00:24:40.558006+0000","last_change":"2024-09-11T00:24:40.558006+0000","last_active":"2024-09-11T00:24:40.342329+0000","last_peered":"2024-09-11T00:24:40.342329+0000","last_clean":"2024-09-11T00:24:40.342329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:40.558006+0000","last_undegraded":"2024-09-11T00:24:40.558006+0000","last_fullsized":"2024-09-11T00:24:40.558006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:24:41.347717+0000","last_change":"2024-09-11T00:24:41.347717+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.347717+0000","last_undegraded":"2024-09-11T00:24:41.347717+0000","last_fullsized":"2024-09-11T00:24:41.347717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.384967+0000","last_change":"2024-09-11T00:24:41.381021+0000","last_active":"2024-09-11T00:24:41.384967+0000","last_peered":"2024-09-11T00:24:41.384967+0000","last_clean":"2024-09-11T00:24:41.384967+0000","last_became_active":"2024-09-11T00:24:41.380749+0000","last_became_peered":"2024-09-11T00:24:41.380749+0000","last_unstale":"2024-09-11T00:24:41.384967+0000","last_undegraded":"2024-09-11T00:24:41.384967+0000","last_fullsized":"2024-09-11T00:24:41.384967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:08:39.940691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.360816+0000","last_change":"2024-09-11T00:24:41.360816+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.360816+0000","last_undegraded":"2024-09-11T00:24:41.360816+0000","last_fullsized":"2024-09-11T00:24:41.360816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T00:24:40.557406+0000","last_change":"2024-09-11T00:24:40.557406+0000","last_active":"2024-09-11T00:24:40.342329+0000","last_peered":"2024-09-11T00:24:40.342329+0000","last_clean":"2024-09-11T00:24:40.342329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:40.557406+0000","last_undegraded":"2024-09-11T00:24:40.557406+0000","last_fullsized":"2024-09-11T00:24:40.557406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:24:41.347717+0000","last_change":"2024-09-11T00:24:41.347717+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.347717+0000","last_undegraded":"2024-09-11T00:24:41.347717+0000","last_fullsized":"2024-09-11T00:24:41.347717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.377779+0000","last_change":"2024-09-11T00:24:41.373838+0000","last_active":"2024-09-11T00:24:41.377779+0000","last_peered":"2024-09-11T00:24:41.377779+0000","last_clean":"2024-09-11T00:24:41.377779+0000","last_became_active":"2024-09-11T00:24:41.373526+0000","last_became_peered":"2024-09-11T00:24:41.373526+0000","last_unstale":"2024-09-11T00:24:41.377779+0000","last_undegraded":"2024-09-11T00:24:41.377779+0000","last_fullsized":"2024-09-11T00:24:41.377779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:09.436702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358301+0000","last_change":"2024-09-11T00:24:41.358301+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358301+0000","last_undegraded":"2024-09-11T00:24:41.358301+0000","last_fullsized":"2024-09-11T00:24:41.358301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.376491+0000","last_change":"2024-09-11T00:24:41.372846+0000","last_active":"2024-09-11T00:24:41.376491+0000","last_peered":"2024-09-11T00:24:41.376491+0000","last_clean":"2024-09-11T00:24:41.376491+0000","last_became_active":"2024-09-11T00:24:41.371346+0000","last_became_peered":"2024-09-11T00:24:41.371346+0000","last_unstale":"2024-09-11T00:24:41.376491+0000","last_undegraded":"2024-09-11T00:24:41.376491+0000","last_fullsized":"2024-09-11T00:24:41.376491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:23.532245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.355983+0000","last_change":"2024-09-11T00:24:41.355983+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.355983+0000","last_undegraded":"2024-09-11T00:24:41.355983+0000","last_fullsized":"2024-09-11T00:24:41.355983+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.378211+0000","last_change":"2024-09-11T00:24:41.373748+0000","last_active":"2024-09-11T00:24:41.378211+0000","last_peered":"2024-09-11T00:24:41.378211+0000","last_clean":"2024-09-11T00:24:41.378211+0000","last_became_active":"2024-09-11T00:24:41.373149+0000","last_became_peered":"2024-09-11T00:24:41.373149+0000","last_unstale":"2024-09-11T00:24:41.378211+0000","last_undegraded":"2024-09-11T00:24:41.378211+0000","last_fullsized":"2024-09-11T00:24:41.378211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:04.897409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.366301+0000","last_change":"2024-09-11T00:24:41.366301+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.366301+0000","last_undegraded":"2024-09-11T00:24:41.366301+0000","last_fullsized":"2024-09-11T00:24:41.366301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.377914+0000","last_change":"2024-09-11T00:24:41.376801+0000","last_active":"2024-09-11T00:24:41.377914+0000","last_peered":"2024-09-11T00:24:41.377914+0000","last_clean":"2024-09-11T00:24:41.377914+0000","last_became_active":"2024-09-11T00:24:41.376493+0000","last_became_peered":"2024-09-11T00:24:41.376493+0000","last_unstale":"2024-09-11T00:24:41.377914+0000","last_undegraded":"2024-09-11T00:24:41.377914+0000","last_fullsized":"2024-09-11T00:24:41.377914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:56.614698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":132,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.367665+0000","last_change":"2024-09-11T00:23:38.923873+0000","last_active":"2024-09-11T00:24:41.367665+0000","last_peered":"2024-09-11T00:24:41.367665+0000","last_clean":"2024-09-11T00:24:41.367665+0000","last_became_active":"2024-09-11T00:23:38.920629+0000","last_became_peered":"2024-09-11T00:23:38.920629+0000","last_unstale":"2024-09-11T00:24:41.367665+0000","last_undegraded":"2024-09-11T00:24:41.367665+0000","last_fullsized":"2024-09-11T00:24:41.367665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_clean_scrub_stamp":"2024-09-11T00:23:37.844553+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.533941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":729259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":138891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":132624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":364544,"data_stored":138891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":138891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":132624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":138891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":933888,"data_stored":717175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:24:47.043 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:24:47.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.236+0000 7f3653c00640 1 -- 172.21.15.40:0/3994541236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f364c0cba70 msgr2=0x7f364c0cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:47.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.236+0000 7f3653c00640 1 --2- 172.21.15.40:0/3994541236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f364c0cba70 0x7f364c0cbec0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3638005fd0 tx=0x7f363802a620 comp rx=0 tx=0).stop 2024-09-11T00:24:47.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.236+0000 7f3653c00640 1 -- 172.21.15.40:0/3994541236 shutdown_connections 2024-09-11T00:24:47.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.236+0000 7f3653c00640 1 --2- 172.21.15.40:0/3994541236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f364c0cba70 0x7f364c0cbec0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.236+0000 7f3653c00640 1 --2- 172.21.15.40:0/3994541236 >> v2:172.21.15.175:3300/0 conn(0x7f364c15bcc0 0x7f364c0cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.236+0000 7f3653c00640 1 -- 172.21.15.40:0/3994541236 >> 172.21.15.40:0/3994541236 conn(0x7f364c0cfbb0 msgr2=0x7f364c0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:47.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.236+0000 7f3653c00640 1 -- 172.21.15.40:0/3994541236 shutdown_connections 2024-09-11T00:24:47.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.236+0000 7f3653c00640 1 -- 172.21.15.40:0/3994541236 wait complete. 2024-09-11T00:24:47.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.238+0000 7f3653c00640 1 Processor -- start 2024-09-11T00:24:47.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.238+0000 7f3653c00640 1 -- start start 2024-09-11T00:24:47.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.239+0000 7f3653c00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f364c0ca200 0x7f364c159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:47.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.239+0000 7f3653c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f364c0cba70 0x7f364c15a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:47.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.239+0000 7f3653c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f364c15bcc0 0x7f364c1f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:47.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.239+0000 7f3653c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f364c15f940 con 0x7f364c0cba70 2024-09-11T00:24:47.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.239+0000 7f3653c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f364c15f7c0 con 0x7f364c15bcc0 2024-09-11T00:24:47.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.239+0000 7f3653c00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f364c0cad60 con 0x7f364c0ca200 2024-09-11T00:24:47.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.239+0000 7f364be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f364c0cba70 0x7f364c15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:47.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.239+0000 7f364be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f364c0cba70 0x7f364c15a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42332/0 (socket says 172.21.15.40:42332) 2024-09-11T00:24:47.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.239+0000 7f364be00640 1 -- 172.21.15.40:0/2968488757 learned_addr learned my addr 172.21.15.40:0/2968488757 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:47.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.239+0000 7f3651c00640 1 --2- 172.21.15.40:0/2968488757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f364c15bcc0 0x7f364c1f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:47.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.240+0000 7f3651200640 1 --2- 172.21.15.40:0/2968488757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f364c0ca200 0x7f364c159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:47.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.240+0000 7f364be00640 1 -- 172.21.15.40:0/2968488757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f364c0ca200 msgr2=0x7f364c159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.240+0000 7f364be00640 1 --2- 172.21.15.40:0/2968488757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f364c0ca200 0x7f364c159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.240+0000 7f364be00640 1 -- 172.21.15.40:0/2968488757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f364c15bcc0 msgr2=0x7f364c1f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.240+0000 7f364be00640 1 --2- 172.21.15.40:0/2968488757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f364c15bcc0 0x7f364c1f4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.240+0000 7f364be00640 1 -- 172.21.15.40:0/2968488757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364c0c8b50 con 0x7f364c0cba70 2024-09-11T00:24:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.240+0000 7f364be00640 1 --2- 172.21.15.40:0/2968488757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f364c0cba70 0x7f364c15a500 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3638009850 tx=0x7f363802ae70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.240+0000 7f3648c00640 1 -- 172.21.15.40:0/2968488757 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363803f070 con 0x7f364c0cba70 2024-09-11T00:24:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.241+0000 7f3648c00640 1 -- 172.21.15.40:0/2968488757 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3638004d20 con 0x7f364c0cba70 2024-09-11T00:24:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.241+0000 7f3648c00640 1 -- 172.21.15.40:0/2968488757 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3638035030 con 0x7f364c0cba70 2024-09-11T00:24:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.241+0000 7f3653c00640 1 -- 172.21.15.40:0/2968488757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f364c0c8e30 con 0x7f364c0cba70 2024-09-11T00:24:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.241+0000 7f3653c00640 1 -- 172.21.15.40:0/2968488757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f364c0c93f0 con 0x7f364c0cba70 2024-09-11T00:24:47.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.242+0000 7f3653c00640 1 -- 172.21.15.40:0/2968488757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f364c0cbec0 con 0x7f364c0cba70 2024-09-11T00:24:47.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.243+0000 7f3648c00640 1 -- 172.21.15.40:0/2968488757 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3638004ed0 con 0x7f364c0cba70 2024-09-11T00:24:47.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.244+0000 7f3648c00640 1 --2- 172.21.15.40:0/2968488757 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f362c077f70 0x7f362c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:47.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.244+0000 7f3648c00640 1 -- 172.21.15.40:0/2968488757 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f36380bac10 con 0x7f364c0cba70 2024-09-11T00:24:47.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.244+0000 7f3651200640 1 --2- 172.21.15.40:0/2968488757 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f362c077f70 0x7f362c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.245+0000 7f3651200640 1 --2- 172.21.15.40:0/2968488757 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f362c077f70 0x7f362c07a430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f364c0b1330 tx=0x7f363c00b2e0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:47.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.248+0000 7f3648c00640 1 -- 172.21.15.40:0/2968488757 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3638083020 con 0x7f364c0cba70 2024-09-11T00:24:47.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.438+0000 7f3653c00640 1 -- 172.21.15.40:0/2968488757 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f364c0c8900 con 0x7f362c077f70 2024-09-11T00:24:47.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.443+0000 7f3648c00640 1 -- 172.21.15.40:0/2968488757 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245888 (secure 0 0 0) 0x7f364c0c8900 con 0x7f362c077f70 2024-09-11T00:24:47.448 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:47.449 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T00:24:47.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.446+0000 7f3653c00640 1 -- 172.21.15.40:0/2968488757 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f362c077f70 msgr2=0x7f362c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:47.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.446+0000 7f3653c00640 1 --2- 172.21.15.40:0/2968488757 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f362c077f70 0x7f362c07a430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f364c0b1330 tx=0x7f363c00b2e0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.446+0000 7f3653c00640 1 -- 172.21.15.40:0/2968488757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f364c0cba70 msgr2=0x7f364c15a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:47.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.446+0000 7f3653c00640 1 --2- 172.21.15.40:0/2968488757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f364c0cba70 0x7f364c15a500 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3638009850 tx=0x7f363802ae70 comp rx=0 tx=0).stop 2024-09-11T00:24:47.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.446+0000 7f3653c00640 1 -- 172.21.15.40:0/2968488757 shutdown_connections 2024-09-11T00:24:47.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.446+0000 7f3653c00640 1 --2- 172.21.15.40:0/2968488757 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f362c077f70 0x7f362c07a430 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.446+0000 7f3653c00640 1 --2- 172.21.15.40:0/2968488757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f364c15bcc0 0x7f364c1f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.446+0000 7f3653c00640 1 --2- 172.21.15.40:0/2968488757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f364c0cba70 0x7f364c15a500 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.446+0000 7f3653c00640 1 --2- 172.21.15.40:0/2968488757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f364c0ca200 0x7f364c159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.446+0000 7f3653c00640 1 -- 172.21.15.40:0/2968488757 >> 172.21.15.40:0/2968488757 conn(0x7f364c0cfbb0 msgr2=0x7f364c0b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:47.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.447+0000 7f3653c00640 1 -- 172.21.15.40:0/2968488757 shutdown_connections 2024-09-11T00:24:47.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.447+0000 7f3653c00640 1 -- 172.21.15.40:0/2968488757 wait complete. 2024-09-11T00:24:47.465 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-09-11T00:24:45.790182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224356,"kb_used_data":3960,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750364,"statfs":{"total":773094113280,"available":772864372736,"internally_reserved":0,"allocated":4055040,"data_stored":2267246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.441787"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.363156+0000","last_change":"2024-09-11T00:24:41.363156+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.363156+0000","last_undegraded":"2024-09-11T00:24:41.363156+0000","last_fullsized":"2024-09-11T00:24:41.363156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359801+0000","last_change":"2024-09-11T00:24:41.359801+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359801+0000","last_undegraded":"2024-09-11T00:24:41.359801+0000","last_fullsized":"2024-09-11T00:24:41.359801+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358253+0000","last_change":"2024-09-11T00:24:41.358253+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358253+0000","last_undegraded":"2024-09-11T00:24:41.358253+0000","last_fullsized":"2024-09-11T00:24:41.358253+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.366219+0000","last_change":"2024-09-11T00:24:41.366219+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.366219+0000","last_undegraded":"2024-09-11T00:24:41.366219+0000","last_fullsized":"2024-09-11T00:24:41.366219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.367083+0000","last_change":"2024-09-11T00:24:41.367083+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.367083+0000","last_undegraded":"2024-09-11T00:24:41.367083+0000","last_fullsized":"2024-09-11T00:24:41.367083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359992+0000","last_change":"2024-09-11T00:24:41.359992+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359992+0000","last_undegraded":"2024-09-11T00:24:41.359992+0000","last_fullsized":"2024-09-11T00:24:41.359992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.363690+0000","last_change":"2024-09-11T00:24:41.363690+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.363690+0000","last_undegraded":"2024-09-11T00:24:41.363690+0000","last_fullsized":"2024-09-11T00:24:41.363690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.365050+0000","last_change":"2024-09-11T00:24:41.365050+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.365050+0000","last_undegraded":"2024-09-11T00:24:41.365050+0000","last_fullsized":"2024-09-11T00:24:41.365050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359277+0000","last_change":"2024-09-11T00:24:41.359277+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359277+0000","last_undegraded":"2024-09-11T00:24:41.359277+0000","last_fullsized":"2024-09-11T00:24:41.359277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.366933+0000","last_change":"2024-09-11T00:24:41.366933+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.366933+0000","last_undegraded":"2024-09-11T00:24:41.366933+0000","last_fullsized":"2024-09-11T00:24:41.366933+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.365535+0000","last_change":"2024-09-11T00:24:41.365535+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.365535+0000","last_undegraded":"2024-09-11T00:24:41.365535+0000","last_fullsized":"2024-09-11T00:24:41.365535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.356887+0000","last_change":"2024-09-11T00:24:41.356887+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.356887+0000","last_undegraded":"2024-09-11T00:24:41.356887+0000","last_fullsized":"2024-09-11T00:24:41.356887+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.366274+0000","last_change":"2024-09-11T00:24:41.366274+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.366274+0000","last_undegraded":"2024-09-11T00:24:41.366274+0000","last_fullsized":"2024-09-11T00:24:41.366274+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359440+0000","last_change":"2024-09-11T00:24:41.359440+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359440+0000","last_undegraded":"2024-09-11T00:24:41.359440+0000","last_fullsized":"2024-09-11T00:24:41.359440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.357471+0000","last_change":"2024-09-11T00:24:41.357471+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.357471+0000","last_undegraded":"2024-09-11T00:24:41.357471+0000","last_fullsized":"2024-09-11T00:24:41.357471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.362678+0000","last_change":"2024-09-11T00:24:41.362678+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.362678+0000","last_undegraded":"2024-09-11T00:24:41.362678+0000","last_fullsized":"2024-09-11T00:24:41.362678+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.365193+0000","last_change":"2024-09-11T00:24:41.365193+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.365193+0000","last_undegraded":"2024-09-11T00:24:41.365193+0000","last_fullsized":"2024-09-11T00:24:41.365193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359315+0000","last_change":"2024-09-11T00:24:41.359315+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359315+0000","last_undegraded":"2024-09-11T00:24:41.359315+0000","last_fullsized":"2024-09-11T00:24:41.359315+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358922+0000","last_change":"2024-09-11T00:24:41.358922+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358922+0000","last_undegraded":"2024-09-11T00:24:41.358922+0000","last_fullsized":"2024-09-11T00:24:41.358922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.367696+0000","last_change":"2024-09-11T00:24:41.367696+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.367696+0000","last_undegraded":"2024-09-11T00:24:41.367696+0000","last_fullsized":"2024-09-11T00:24:41.367696+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358377+0000","last_change":"2024-09-11T00:24:41.358377+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358377+0000","last_undegraded":"2024-09-11T00:24:41.358377+0000","last_fullsized":"2024-09-11T00:24:41.358377+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.356661+0000","last_change":"2024-09-11T00:24:41.356661+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.356661+0000","last_undegraded":"2024-09-11T00:24:41.356661+0000","last_fullsized":"2024-09-11T00:24:41.356661+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:24:41.347717+0000","last_change":"2024-09-11T00:24:41.347717+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.347717+0000","last_undegraded":"2024-09-11T00:24:41.347717+0000","last_fullsized":"2024-09-11T00:24:41.347717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358657+0000","last_change":"2024-09-11T00:24:41.358657+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358657+0000","last_undegraded":"2024-09-11T00:24:41.358657+0000","last_fullsized":"2024-09-11T00:24:41.358657+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.366120+0000","last_change":"2024-09-11T00:24:41.366120+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.366120+0000","last_undegraded":"2024-09-11T00:24:41.366120+0000","last_fullsized":"2024-09-11T00:24:41.366120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358232+0000","last_change":"2024-09-11T00:24:41.358232+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358232+0000","last_undegraded":"2024-09-11T00:24:41.358232+0000","last_fullsized":"2024-09-11T00:24:41.358232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364192+0000","last_change":"2024-09-11T00:24:41.364192+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364192+0000","last_undegraded":"2024-09-11T00:24:41.364192+0000","last_fullsized":"2024-09-11T00:24:41.364192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.356413+0000","last_change":"2024-09-11T00:24:41.356413+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.356413+0000","last_undegraded":"2024-09-11T00:24:41.356413+0000","last_fullsized":"2024-09-11T00:24:41.356413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.357262+0000","last_change":"2024-09-11T00:24:41.357262+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.357262+0000","last_undegraded":"2024-09-11T00:24:41.357262+0000","last_fullsized":"2024-09-11T00:24:41.357262+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.366640+0000","last_change":"2024-09-11T00:24:41.366640+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.366640+0000","last_undegraded":"2024-09-11T00:24:41.366640+0000","last_fullsized":"2024-09-11T00:24:41.366640+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.361893+0000","last_change":"2024-09-11T00:24:41.361893+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.361893+0000","last_undegraded":"2024-09-11T00:24:41.361893+0000","last_fullsized":"2024-09-11T00:24:41.361893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364630+0000","last_change":"2024-09-11T00:24:41.364630+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364630+0000","last_undegraded":"2024-09-11T00:24:41.364630+0000","last_fullsized":"2024-09-11T00:24:41.364630+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:24:41.347717+0000","last_change":"2024-09-11T00:24:41.347717+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.347717+0000","last_undegraded":"2024-09-11T00:24:41.347717+0000","last_fullsized":"2024-09-11T00:24:41.347717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.377572+0000","last_change":"2024-09-11T00:24:41.375539+0000","last_active":"2024-09-11T00:24:41.377572+0000","last_peered":"2024-09-11T00:24:41.377572+0000","last_clean":"2024-09-11T00:24:41.377572+0000","last_became_active":"2024-09-11T00:24:41.375222+0000","last_became_peered":"2024-09-11T00:24:41.375222+0000","last_unstale":"2024-09-11T00:24:41.377572+0000","last_undegraded":"2024-09-11T00:24:41.377572+0000","last_fullsized":"2024-09-11T00:24:41.377572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:09.436702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.361244+0000","last_change":"2024-09-11T00:24:41.361244+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.361244+0000","last_undegraded":"2024-09-11T00:24:41.361244+0000","last_fullsized":"2024-09-11T00:24:41.361244+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T00:24:40.558594+0000","last_change":"2024-09-11T00:24:40.558594+0000","last_active":"2024-09-11T00:24:40.342329+0000","last_peered":"2024-09-11T00:24:40.342329+0000","last_clean":"2024-09-11T00:24:40.342329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:40.558594+0000","last_undegraded":"2024-09-11T00:24:40.558594+0000","last_fullsized":"2024-09-11T00:24:40.558594+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358279+0000","last_change":"2024-09-11T00:24:41.358279+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358279+0000","last_undegraded":"2024-09-11T00:24:41.358279+0000","last_fullsized":"2024-09-11T00:24:41.358279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.385350+0000","last_change":"2024-09-11T00:24:41.378757+0000","last_active":"2024-09-11T00:24:41.385350+0000","last_peered":"2024-09-11T00:24:41.385350+0000","last_clean":"2024-09-11T00:24:41.385350+0000","last_became_active":"2024-09-11T00:24:41.376929+0000","last_became_peered":"2024-09-11T00:24:41.376929+0000","last_unstale":"2024-09-11T00:24:41.385350+0000","last_undegraded":"2024-09-11T00:24:41.385350+0000","last_fullsized":"2024-09-11T00:24:41.385350+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:29.892657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.363720+0000","last_change":"2024-09-11T00:24:41.363720+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.363720+0000","last_undegraded":"2024-09-11T00:24:41.363720+0000","last_fullsized":"2024-09-11T00:24:41.363720+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.387589+0000","last_change":"2024-09-11T00:24:41.383340+0000","last_active":"2024-09-11T00:24:41.387589+0000","last_peered":"2024-09-11T00:24:41.387589+0000","last_clean":"2024-09-11T00:24:41.387589+0000","last_became_active":"2024-09-11T00:24:41.383103+0000","last_became_peered":"2024-09-11T00:24:41.383103+0000","last_unstale":"2024-09-11T00:24:41.387589+0000","last_undegraded":"2024-09-11T00:24:41.387589+0000","last_fullsized":"2024-09-11T00:24:41.387589+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:42.587573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364020+0000","last_change":"2024-09-11T00:24:41.364020+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364020+0000","last_undegraded":"2024-09-11T00:24:41.364020+0000","last_fullsized":"2024-09-11T00:24:41.364020+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.369770+0000","last_change":"2024-09-11T00:24:41.364406+0000","last_active":"2024-09-11T00:24:41.369770+0000","last_peered":"2024-09-11T00:24:41.369770+0000","last_clean":"2024-09-11T00:24:41.369770+0000","last_became_active":"2024-09-11T00:24:41.362829+0000","last_became_peered":"2024-09-11T00:24:41.362829+0000","last_unstale":"2024-09-11T00:24:41.369770+0000","last_undegraded":"2024-09-11T00:24:41.369770+0000","last_fullsized":"2024-09-11T00:24:41.369770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:25.588635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.355754+0000","last_change":"2024-09-11T00:24:41.355754+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.355754+0000","last_undegraded":"2024-09-11T00:24:41.355754+0000","last_fullsized":"2024-09-11T00:24:41.355754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.374255+0000","last_change":"2024-09-11T00:24:41.367444+0000","last_active":"2024-09-11T00:24:41.374255+0000","last_peered":"2024-09-11T00:24:41.374255+0000","last_clean":"2024-09-11T00:24:41.374255+0000","last_became_active":"2024-09-11T00:24:41.367132+0000","last_became_peered":"2024-09-11T00:24:41.367132+0000","last_unstale":"2024-09-11T00:24:41.374255+0000","last_undegraded":"2024-09-11T00:24:41.374255+0000","last_fullsized":"2024-09-11T00:24:41.374255+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:01.435017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.356222+0000","last_change":"2024-09-11T00:24:41.356222+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.356222+0000","last_undegraded":"2024-09-11T00:24:41.356222+0000","last_fullsized":"2024-09-11T00:24:41.356222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.385330+0000","last_change":"2024-09-11T00:24:41.379745+0000","last_active":"2024-09-11T00:24:41.385330+0000","last_peered":"2024-09-11T00:24:41.385330+0000","last_clean":"2024-09-11T00:24:41.385330+0000","last_became_active":"2024-09-11T00:24:41.379450+0000","last_became_peered":"2024-09-11T00:24:41.379450+0000","last_unstale":"2024-09-11T00:24:41.385330+0000","last_undegraded":"2024-09-11T00:24:41.385330+0000","last_fullsized":"2024-09-11T00:24:41.385330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:52.909342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.363964+0000","last_change":"2024-09-11T00:24:41.363964+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.363964+0000","last_undegraded":"2024-09-11T00:24:41.363964+0000","last_fullsized":"2024-09-11T00:24:41.363964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.375868+0000","last_change":"2024-09-11T00:24:41.369910+0000","last_active":"2024-09-11T00:24:41.375868+0000","last_peered":"2024-09-11T00:24:41.375868+0000","last_clean":"2024-09-11T00:24:41.375868+0000","last_became_active":"2024-09-11T00:24:41.366429+0000","last_became_peered":"2024-09-11T00:24:41.366429+0000","last_unstale":"2024-09-11T00:24:41.375868+0000","last_undegraded":"2024-09-11T00:24:41.375868+0000","last_fullsized":"2024-09-11T00:24:41.375868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:35.033907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.355750+0000","last_change":"2024-09-11T00:24:41.355750+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.355750+0000","last_undegraded":"2024-09-11T00:24:41.355750+0000","last_fullsized":"2024-09-11T00:24:41.355750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.380006+0000","last_change":"2024-09-11T00:24:41.375561+0000","last_active":"2024-09-11T00:24:41.380006+0000","last_peered":"2024-09-11T00:24:41.380006+0000","last_clean":"2024-09-11T00:24:41.380006+0000","last_became_active":"2024-09-11T00:24:41.375291+0000","last_became_peered":"2024-09-11T00:24:41.375291+0000","last_unstale":"2024-09-11T00:24:41.380006+0000","last_undegraded":"2024-09-11T00:24:41.380006+0000","last_fullsized":"2024-09-11T00:24:41.380006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:01.861466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364001+0000","last_change":"2024-09-11T00:24:41.364001+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364001+0000","last_undegraded":"2024-09-11T00:24:41.364001+0000","last_fullsized":"2024-09-11T00:24:41.364001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T00:24:40.557402+0000","last_change":"2024-09-11T00:24:40.557402+0000","last_active":"2024-09-11T00:24:40.342329+0000","last_peered":"2024-09-11T00:24:40.342329+0000","last_clean":"2024-09-11T00:24:40.342329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:40.557402+0000","last_undegraded":"2024-09-11T00:24:40.557402+0000","last_fullsized":"2024-09-11T00:24:40.557402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358380+0000","last_change":"2024-09-11T00:24:41.358380+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358380+0000","last_undegraded":"2024-09-11T00:24:41.358380+0000","last_fullsized":"2024-09-11T00:24:41.358380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.379223+0000","last_change":"2024-09-11T00:24:41.374576+0000","last_active":"2024-09-11T00:24:41.379223+0000","last_peered":"2024-09-11T00:24:41.379223+0000","last_clean":"2024-09-11T00:24:41.379223+0000","last_became_active":"2024-09-11T00:24:41.373816+0000","last_became_peered":"2024-09-11T00:24:41.373816+0000","last_unstale":"2024-09-11T00:24:41.379223+0000","last_undegraded":"2024-09-11T00:24:41.379223+0000","last_fullsized":"2024-09-11T00:24:41.379223+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:29.892657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359741+0000","last_change":"2024-09-11T00:24:41.359741+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359741+0000","last_undegraded":"2024-09-11T00:24:41.359741+0000","last_fullsized":"2024-09-11T00:24:41.359741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.384673+0000","last_change":"2024-09-11T00:24:41.378401+0000","last_active":"2024-09-11T00:24:41.384673+0000","last_peered":"2024-09-11T00:24:41.384673+0000","last_clean":"2024-09-11T00:24:41.384673+0000","last_became_active":"2024-09-11T00:24:41.377514+0000","last_became_peered":"2024-09-11T00:24:41.377514+0000","last_unstale":"2024-09-11T00:24:41.384673+0000","last_undegraded":"2024-09-11T00:24:41.384673+0000","last_fullsized":"2024-09-11T00:24:41.384673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:21:49.397863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364749+0000","last_change":"2024-09-11T00:24:41.364749+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364749+0000","last_undegraded":"2024-09-11T00:24:41.364749+0000","last_fullsized":"2024-09-11T00:24:41.364749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.373962+0000","last_change":"2024-09-11T00:24:41.369376+0000","last_active":"2024-09-11T00:24:41.373962+0000","last_peered":"2024-09-11T00:24:41.373962+0000","last_clean":"2024-09-11T00:24:41.373962+0000","last_became_active":"2024-09-11T00:24:41.369126+0000","last_became_peered":"2024-09-11T00:24:41.369126+0000","last_unstale":"2024-09-11T00:24:41.373962+0000","last_undegraded":"2024-09-11T00:24:41.373962+0000","last_fullsized":"2024-09-11T00:24:41.373962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:20.420194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358214+0000","last_change":"2024-09-11T00:24:41.358214+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358214+0000","last_undegraded":"2024-09-11T00:24:41.358214+0000","last_fullsized":"2024-09-11T00:24:41.358214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.382785+0000","last_change":"2024-09-11T00:24:41.378892+0000","last_active":"2024-09-11T00:24:41.382785+0000","last_peered":"2024-09-11T00:24:41.382785+0000","last_clean":"2024-09-11T00:24:41.382785+0000","last_became_active":"2024-09-11T00:24:41.378470+0000","last_became_peered":"2024-09-11T00:24:41.378470+0000","last_unstale":"2024-09-11T00:24:41.382785+0000","last_undegraded":"2024-09-11T00:24:41.382785+0000","last_fullsized":"2024-09-11T00:24:41.382785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:19.462270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364191+0000","last_change":"2024-09-11T00:24:41.364191+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364191+0000","last_undegraded":"2024-09-11T00:24:41.364191+0000","last_fullsized":"2024-09-11T00:24:41.364191+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.378069+0000","last_change":"2024-09-11T00:24:41.372351+0000","last_active":"2024-09-11T00:24:41.378069+0000","last_peered":"2024-09-11T00:24:41.378069+0000","last_clean":"2024-09-11T00:24:41.378069+0000","last_became_active":"2024-09-11T00:24:41.372125+0000","last_became_peered":"2024-09-11T00:24:41.372125+0000","last_unstale":"2024-09-11T00:24:41.378069+0000","last_undegraded":"2024-09-11T00:24:41.378069+0000","last_fullsized":"2024-09-11T00:24:41.378069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:28.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.360605+0000","last_change":"2024-09-11T00:24:41.360605+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.360605+0000","last_undegraded":"2024-09-11T00:24:41.360605+0000","last_fullsized":"2024-09-11T00:24:41.360605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.376463+0000","last_change":"2024-09-11T00:24:41.364238+0000","last_active":"2024-09-11T00:24:41.376463+0000","last_peered":"2024-09-11T00:24:41.376463+0000","last_clean":"2024-09-11T00:24:41.376463+0000","last_became_active":"2024-09-11T00:24:41.362593+0000","last_became_peered":"2024-09-11T00:24:41.362593+0000","last_unstale":"2024-09-11T00:24:41.376463+0000","last_undegraded":"2024-09-11T00:24:41.376463+0000","last_fullsized":"2024-09-11T00:24:41.376463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:08:39.940691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.356154+0000","last_change":"2024-09-11T00:24:41.356154+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.356154+0000","last_undegraded":"2024-09-11T00:24:41.356154+0000","last_fullsized":"2024-09-11T00:24:41.356154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.387589+0000","last_change":"2024-09-11T00:24:41.381321+0000","last_active":"2024-09-11T00:24:41.387589+0000","last_peered":"2024-09-11T00:24:41.387589+0000","last_clean":"2024-09-11T00:24:41.387589+0000","last_became_active":"2024-09-11T00:24:41.381052+0000","last_became_peered":"2024-09-11T00:24:41.381052+0000","last_unstale":"2024-09-11T00:24:41.387589+0000","last_undegraded":"2024-09-11T00:24:41.387589+0000","last_fullsized":"2024-09-11T00:24:41.387589+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:28.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.359000+0000","last_change":"2024-09-11T00:24:41.359000+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.359000+0000","last_undegraded":"2024-09-11T00:24:41.359000+0000","last_fullsized":"2024-09-11T00:24:41.359000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.376175+0000","last_change":"2024-09-11T00:24:41.372282+0000","last_active":"2024-09-11T00:24:41.376175+0000","last_peered":"2024-09-11T00:24:41.376175+0000","last_clean":"2024-09-11T00:24:41.376175+0000","last_became_active":"2024-09-11T00:24:41.371783+0000","last_became_peered":"2024-09-11T00:24:41.371783+0000","last_unstale":"2024-09-11T00:24:41.376175+0000","last_undegraded":"2024-09-11T00:24:41.376175+0000","last_fullsized":"2024-09-11T00:24:41.376175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:32.728539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.365454+0000","last_change":"2024-09-11T00:24:41.365454+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.365454+0000","last_undegraded":"2024-09-11T00:24:41.365454+0000","last_fullsized":"2024-09-11T00:24:41.365454+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.382993+0000","last_change":"2024-09-11T00:24:41.382162+0000","last_active":"2024-09-11T00:24:41.382993+0000","last_peered":"2024-09-11T00:24:41.382993+0000","last_clean":"2024-09-11T00:24:41.382993+0000","last_became_active":"2024-09-11T00:24:41.381878+0000","last_became_peered":"2024-09-11T00:24:41.381878+0000","last_unstale":"2024-09-11T00:24:41.382993+0000","last_undegraded":"2024-09-11T00:24:41.382993+0000","last_fullsized":"2024-09-11T00:24:41.382993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:10.872755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.372574+0000","last_change":"2024-09-11T00:24:41.372574+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.372574+0000","last_undegraded":"2024-09-11T00:24:41.372574+0000","last_fullsized":"2024-09-11T00:24:41.372574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.378249+0000","last_change":"2024-09-11T00:24:41.376338+0000","last_active":"2024-09-11T00:24:41.378249+0000","last_peered":"2024-09-11T00:24:41.378249+0000","last_clean":"2024-09-11T00:24:41.378249+0000","last_became_active":"2024-09-11T00:24:41.376049+0000","last_became_peered":"2024-09-11T00:24:41.376049+0000","last_unstale":"2024-09-11T00:24:41.378249+0000","last_undegraded":"2024-09-11T00:24:41.378249+0000","last_fullsized":"2024-09-11T00:24:41.378249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:30.444734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364446+0000","last_change":"2024-09-11T00:24:41.364446+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364446+0000","last_undegraded":"2024-09-11T00:24:41.364446+0000","last_fullsized":"2024-09-11T00:24:41.364446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T00:24:40.558040+0000","last_change":"2024-09-11T00:24:40.558040+0000","last_active":"2024-09-11T00:24:40.342329+0000","last_peered":"2024-09-11T00:24:40.342329+0000","last_clean":"2024-09-11T00:24:40.342329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:40.558040+0000","last_undegraded":"2024-09-11T00:24:40.558040+0000","last_fullsized":"2024-09-11T00:24:40.558040+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.365738+0000","last_change":"2024-09-11T00:24:41.365738+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.365738+0000","last_undegraded":"2024-09-11T00:24:41.365738+0000","last_fullsized":"2024-09-11T00:24:41.365738+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.379779+0000","last_change":"2024-09-11T00:24:41.378707+0000","last_active":"2024-09-11T00:24:41.379779+0000","last_peered":"2024-09-11T00:24:41.379779+0000","last_clean":"2024-09-11T00:24:41.379779+0000","last_became_active":"2024-09-11T00:24:41.378352+0000","last_became_peered":"2024-09-11T00:24:41.378352+0000","last_unstale":"2024-09-11T00:24:41.379779+0000","last_undegraded":"2024-09-11T00:24:41.379779+0000","last_fullsized":"2024-09-11T00:24:41.379779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:19.462270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.367480+0000","last_change":"2024-09-11T00:24:41.367480+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.367480+0000","last_undegraded":"2024-09-11T00:24:41.367480+0000","last_fullsized":"2024-09-11T00:24:41.367480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.376514+0000","last_change":"2024-09-11T00:24:41.375301+0000","last_active":"2024-09-11T00:24:41.376514+0000","last_peered":"2024-09-11T00:24:41.376514+0000","last_clean":"2024-09-11T00:24:41.376514+0000","last_became_active":"2024-09-11T00:24:41.375027+0000","last_became_peered":"2024-09-11T00:24:41.375027+0000","last_unstale":"2024-09-11T00:24:41.376514+0000","last_undegraded":"2024-09-11T00:24:41.376514+0000","last_fullsized":"2024-09-11T00:24:41.376514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:57:18.064050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.364200+0000","last_change":"2024-09-11T00:24:41.364200+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.364200+0000","last_undegraded":"2024-09-11T00:24:41.364200+0000","last_fullsized":"2024-09-11T00:24:41.364200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.374401+0000","last_change":"2024-09-11T00:24:41.369826+0000","last_active":"2024-09-11T00:24:41.374401+0000","last_peered":"2024-09-11T00:24:41.374401+0000","last_clean":"2024-09-11T00:24:41.374401+0000","last_became_active":"2024-09-11T00:24:41.369533+0000","last_became_peered":"2024-09-11T00:24:41.369533+0000","last_unstale":"2024-09-11T00:24:41.374401+0000","last_undegraded":"2024-09-11T00:24:41.374401+0000","last_fullsized":"2024-09-11T00:24:41.374401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:52.909342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.369899+0000","last_change":"2024-09-11T00:24:41.369899+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.369899+0000","last_undegraded":"2024-09-11T00:24:41.369899+0000","last_fullsized":"2024-09-11T00:24:41.369899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.377264+0000","last_change":"2024-09-11T00:24:41.373957+0000","last_active":"2024-09-11T00:24:41.377264+0000","last_peered":"2024-09-11T00:24:41.377264+0000","last_clean":"2024-09-11T00:24:41.377264+0000","last_became_active":"2024-09-11T00:24:41.373644+0000","last_became_peered":"2024-09-11T00:24:41.373644+0000","last_unstale":"2024-09-11T00:24:41.377264+0000","last_undegraded":"2024-09-11T00:24:41.377264+0000","last_fullsized":"2024-09-11T00:24:41.377264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:56.614698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358544+0000","last_change":"2024-09-11T00:24:41.358544+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358544+0000","last_undegraded":"2024-09-11T00:24:41.358544+0000","last_fullsized":"2024-09-11T00:24:41.358544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T00:24:40.558006+0000","last_change":"2024-09-11T00:24:40.558006+0000","last_active":"2024-09-11T00:24:40.342329+0000","last_peered":"2024-09-11T00:24:40.342329+0000","last_clean":"2024-09-11T00:24:40.342329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:40.558006+0000","last_undegraded":"2024-09-11T00:24:40.558006+0000","last_fullsized":"2024-09-11T00:24:40.558006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:24:41.347717+0000","last_change":"2024-09-11T00:24:41.347717+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.347717+0000","last_undegraded":"2024-09-11T00:24:41.347717+0000","last_fullsized":"2024-09-11T00:24:41.347717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.384967+0000","last_change":"2024-09-11T00:24:41.381021+0000","last_active":"2024-09-11T00:24:41.384967+0000","last_peered":"2024-09-11T00:24:41.384967+0000","last_clean":"2024-09-11T00:24:41.384967+0000","last_became_active":"2024-09-11T00:24:41.380749+0000","last_became_peered":"2024-09-11T00:24:41.380749+0000","last_unstale":"2024-09-11T00:24:41.384967+0000","last_undegraded":"2024-09-11T00:24:41.384967+0000","last_fullsized":"2024-09-11T00:24:41.384967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:08:39.940691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.360816+0000","last_change":"2024-09-11T00:24:41.360816+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.360816+0000","last_undegraded":"2024-09-11T00:24:41.360816+0000","last_fullsized":"2024-09-11T00:24:41.360816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T00:24:40.557406+0000","last_change":"2024-09-11T00:24:40.557406+0000","last_active":"2024-09-11T00:24:40.342329+0000","last_peered":"2024-09-11T00:24:40.342329+0000","last_clean":"2024-09-11T00:24:40.342329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:40.557406+0000","last_undegraded":"2024-09-11T00:24:40.557406+0000","last_fullsized":"2024-09-11T00:24:40.557406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T00:24:41.347717+0000","last_change":"2024-09-11T00:24:41.347717+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.347717+0000","last_undegraded":"2024-09-11T00:24:41.347717+0000","last_fullsized":"2024-09-11T00:24:41.347717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.377779+0000","last_change":"2024-09-11T00:24:41.373838+0000","last_active":"2024-09-11T00:24:41.377779+0000","last_peered":"2024-09-11T00:24:41.377779+0000","last_clean":"2024-09-11T00:24:41.377779+0000","last_became_active":"2024-09-11T00:24:41.373526+0000","last_became_peered":"2024-09-11T00:24:41.373526+0000","last_unstale":"2024-09-11T00:24:41.377779+0000","last_undegraded":"2024-09-11T00:24:41.377779+0000","last_fullsized":"2024-09-11T00:24:41.377779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:09.436702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.358301+0000","last_change":"2024-09-11T00:24:41.358301+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.358301+0000","last_undegraded":"2024-09-11T00:24:41.358301+0000","last_fullsized":"2024-09-11T00:24:41.358301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.376491+0000","last_change":"2024-09-11T00:24:41.372846+0000","last_active":"2024-09-11T00:24:41.376491+0000","last_peered":"2024-09-11T00:24:41.376491+0000","last_clean":"2024-09-11T00:24:41.376491+0000","last_became_active":"2024-09-11T00:24:41.371346+0000","last_became_peered":"2024-09-11T00:24:41.371346+0000","last_unstale":"2024-09-11T00:24:41.376491+0000","last_undegraded":"2024-09-11T00:24:41.376491+0000","last_fullsized":"2024-09-11T00:24:41.376491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:23.532245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.355983+0000","last_change":"2024-09-11T00:24:41.355983+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.355983+0000","last_undegraded":"2024-09-11T00:24:41.355983+0000","last_fullsized":"2024-09-11T00:24:41.355983+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.378211+0000","last_change":"2024-09-11T00:24:41.373748+0000","last_active":"2024-09-11T00:24:41.378211+0000","last_peered":"2024-09-11T00:24:41.378211+0000","last_clean":"2024-09-11T00:24:41.378211+0000","last_became_active":"2024-09-11T00:24:41.373149+0000","last_became_peered":"2024-09-11T00:24:41.373149+0000","last_unstale":"2024-09-11T00:24:41.378211+0000","last_undegraded":"2024-09-11T00:24:41.378211+0000","last_fullsized":"2024-09-11T00:24:41.378211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:04.897409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T00:24:41.366301+0000","last_change":"2024-09-11T00:24:41.366301+0000","last_active":"2024-09-11T00:24:41.347717+0000","last_peered":"2024-09-11T00:24:41.347717+0000","last_clean":"2024-09-11T00:24:41.347717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T00:24:41.366301+0000","last_undegraded":"2024-09-11T00:24:41.366301+0000","last_fullsized":"2024-09-11T00:24:41.366301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.377914+0000","last_change":"2024-09-11T00:24:41.376801+0000","last_active":"2024-09-11T00:24:41.377914+0000","last_peered":"2024-09-11T00:24:41.377914+0000","last_clean":"2024-09-11T00:24:41.377914+0000","last_became_active":"2024-09-11T00:24:41.376493+0000","last_became_peered":"2024-09-11T00:24:41.376493+0000","last_unstale":"2024-09-11T00:24:41.377914+0000","last_undegraded":"2024-09-11T00:24:41.377914+0000","last_fullsized":"2024-09-11T00:24:41.377914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:56.614698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":132,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T00:24:41.367665+0000","last_change":"2024-09-11T00:23:38.923873+0000","last_active":"2024-09-11T00:24:41.367665+0000","last_peered":"2024-09-11T00:24:41.367665+0000","last_clean":"2024-09-11T00:24:41.367665+0000","last_became_active":"2024-09-11T00:23:38.920629+0000","last_became_peered":"2024-09-11T00:23:38.920629+0000","last_unstale":"2024-09-11T00:24:41.367665+0000","last_undegraded":"2024-09-11T00:24:41.367665+0000","last_fullsized":"2024-09-11T00:24:41.367665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_clean_scrub_stamp":"2024-09-11T00:23:37.844553+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.533941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":729259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":138891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":132624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":364544,"data_stored":138891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":138891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":132624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":138891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":933888,"data_stored":717175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:24:47.469 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3f is not active+clean 2024-09-11T00:24:47.469 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.363156+0000', 'last_change': '2024-09-11T00:24:41.363156+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.363156+0000', 'last_undegraded': '2024-09-11T00:24:41.363156+0000', 'last_fullsized': '2024-09-11T00:24:41.363156+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T00:24:47.469 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-09-11T00:24:47.469 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.359801+0000', 'last_change': '2024-09-11T00:24:41.359801+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.359801+0000', 'last_undegraded': '2024-09-11T00:24:41.359801+0000', 'last_fullsized': '2024-09-11T00:24:41.359801+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T00:24:47.469 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-09-11T00:24:47.469 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.358253+0000', 'last_change': '2024-09-11T00:24:41.358253+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.358253+0000', 'last_undegraded': '2024-09-11T00:24:41.358253+0000', 'last_fullsized': '2024-09-11T00:24:41.358253+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T00:24:47.469 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-09-11T00:24:47.469 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.366219+0000', 'last_change': '2024-09-11T00:24:41.366219+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.366219+0000', 'last_undegraded': '2024-09-11T00:24:41.366219+0000', 'last_fullsized': '2024-09-11T00:24:41.366219+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T00:24:47.469 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-09-11T00:24:47.469 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.367083+0000', 'last_change': '2024-09-11T00:24:41.367083+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.367083+0000', 'last_undegraded': '2024-09-11T00:24:41.367083+0000', 'last_fullsized': '2024-09-11T00:24:41.367083+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T00:24:47.470 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-09-11T00:24:47.470 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.359992+0000', 'last_change': '2024-09-11T00:24:41.359992+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.359992+0000', 'last_undegraded': '2024-09-11T00:24:41.359992+0000', 'last_fullsized': '2024-09-11T00:24:41.359992+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T00:24:47.470 INFO:tasks.ceph.ceph_manager.ceph:PG 5.39 is not active+clean 2024-09-11T00:24:47.470 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.363690+0000', 'last_change': '2024-09-11T00:24:41.363690+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.363690+0000', 'last_undegraded': '2024-09-11T00:24:41.363690+0000', 'last_fullsized': '2024-09-11T00:24:41.363690+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T00:24:47.470 INFO:tasks.ceph.ceph_manager.ceph:PG 5.38 is not active+clean 2024-09-11T00:24:47.470 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.365050+0000', 'last_change': '2024-09-11T00:24:41.365050+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.365050+0000', 'last_undegraded': '2024-09-11T00:24:41.365050+0000', 'last_fullsized': '2024-09-11T00:24:41.365050+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T00:24:47.470 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-09-11T00:24:47.470 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.359277+0000', 'last_change': '2024-09-11T00:24:41.359277+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.359277+0000', 'last_undegraded': '2024-09-11T00:24:41.359277+0000', 'last_fullsized': '2024-09-11T00:24:41.359277+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T00:24:47.470 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-09-11T00:24:47.470 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.366933+0000', 'last_change': '2024-09-11T00:24:41.366933+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.366933+0000', 'last_undegraded': '2024-09-11T00:24:41.366933+0000', 'last_fullsized': '2024-09-11T00:24:41.366933+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T00:24:47.470 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-09-11T00:24:47.470 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.365535+0000', 'last_change': '2024-09-11T00:24:41.365535+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.365535+0000', 'last_undegraded': '2024-09-11T00:24:41.365535+0000', 'last_fullsized': '2024-09-11T00:24:41.365535+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T00:24:47.471 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-09-11T00:24:47.471 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.356887+0000', 'last_change': '2024-09-11T00:24:41.356887+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.356887+0000', 'last_undegraded': '2024-09-11T00:24:41.356887+0000', 'last_fullsized': '2024-09-11T00:24:41.356887+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T00:24:47.471 INFO:tasks.ceph.ceph_manager.ceph:PG 5.33 is not active+clean 2024-09-11T00:24:47.471 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.366274+0000', 'last_change': '2024-09-11T00:24:41.366274+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.366274+0000', 'last_undegraded': '2024-09-11T00:24:41.366274+0000', 'last_fullsized': '2024-09-11T00:24:41.366274+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T00:24:47.471 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-09-11T00:24:47.471 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.359440+0000', 'last_change': '2024-09-11T00:24:41.359440+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.359440+0000', 'last_undegraded': '2024-09-11T00:24:41.359440+0000', 'last_fullsized': '2024-09-11T00:24:41.359440+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T00:24:47.471 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-09-11T00:24:47.471 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.357471+0000', 'last_change': '2024-09-11T00:24:41.357471+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.357471+0000', 'last_undegraded': '2024-09-11T00:24:41.357471+0000', 'last_fullsized': '2024-09-11T00:24:41.357471+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T00:24:47.471 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-09-11T00:24:47.471 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.362678+0000', 'last_change': '2024-09-11T00:24:41.362678+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.362678+0000', 'last_undegraded': '2024-09-11T00:24:41.362678+0000', 'last_fullsized': '2024-09-11T00:24:41.362678+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T00:24:47.472 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-09-11T00:24:47.472 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.365193+0000', 'last_change': '2024-09-11T00:24:41.365193+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.365193+0000', 'last_undegraded': '2024-09-11T00:24:41.365193+0000', 'last_fullsized': '2024-09-11T00:24:41.365193+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T00:24:47.472 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-09-11T00:24:47.472 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.359315+0000', 'last_change': '2024-09-11T00:24:41.359315+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.359315+0000', 'last_undegraded': '2024-09-11T00:24:41.359315+0000', 'last_fullsized': '2024-09-11T00:24:41.359315+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T00:24:47.472 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-09-11T00:24:47.472 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.358922+0000', 'last_change': '2024-09-11T00:24:41.358922+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.358922+0000', 'last_undegraded': '2024-09-11T00:24:41.358922+0000', 'last_fullsized': '2024-09-11T00:24:41.358922+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T00:24:47.472 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2c is not active+clean 2024-09-11T00:24:47.472 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.367696+0000', 'last_change': '2024-09-11T00:24:41.367696+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.367696+0000', 'last_undegraded': '2024-09-11T00:24:41.367696+0000', 'last_fullsized': '2024-09-11T00:24:41.367696+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T00:24:47.472 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-09-11T00:24:47.472 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.358377+0000', 'last_change': '2024-09-11T00:24:41.358377+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.358377+0000', 'last_undegraded': '2024-09-11T00:24:41.358377+0000', 'last_fullsized': '2024-09-11T00:24:41.358377+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T00:24:47.472 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2a is not active+clean 2024-09-11T00:24:47.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.356661+0000', 'last_change': '2024-09-11T00:24:41.356661+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.356661+0000', 'last_undegraded': '2024-09-11T00:24:41.356661+0000', 'last_fullsized': '2024-09-11T00:24:41.356661+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T00:24:47.473 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-09-11T00:24:47.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T00:24:41.347717+0000', 'last_change': '2024-09-11T00:24:41.347717+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.347717+0000', 'last_undegraded': '2024-09-11T00:24:41.347717+0000', 'last_fullsized': '2024-09-11T00:24:41.347717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T00:24:47.473 INFO:tasks.ceph.ceph_manager.ceph:PG 5.28 is not active+clean 2024-09-11T00:24:47.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.358657+0000', 'last_change': '2024-09-11T00:24:41.358657+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.358657+0000', 'last_undegraded': '2024-09-11T00:24:41.358657+0000', 'last_fullsized': '2024-09-11T00:24:41.358657+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T00:24:47.473 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-11T00:24:47.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.366120+0000', 'last_change': '2024-09-11T00:24:41.366120+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.366120+0000', 'last_undegraded': '2024-09-11T00:24:41.366120+0000', 'last_fullsized': '2024-09-11T00:24:41.366120+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T00:24:47.473 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-09-11T00:24:47.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.358232+0000', 'last_change': '2024-09-11T00:24:41.358232+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.358232+0000', 'last_undegraded': '2024-09-11T00:24:41.358232+0000', 'last_fullsized': '2024-09-11T00:24:41.358232+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T00:24:47.473 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-09-11T00:24:47.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.364192+0000', 'last_change': '2024-09-11T00:24:41.364192+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.364192+0000', 'last_undegraded': '2024-09-11T00:24:41.364192+0000', 'last_fullsized': '2024-09-11T00:24:41.364192+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T00:24:47.474 INFO:tasks.ceph.ceph_manager.ceph:PG 5.24 is not active+clean 2024-09-11T00:24:47.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.356413+0000', 'last_change': '2024-09-11T00:24:41.356413+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.356413+0000', 'last_undegraded': '2024-09-11T00:24:41.356413+0000', 'last_fullsized': '2024-09-11T00:24:41.356413+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T00:24:47.474 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-09-11T00:24:47.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.357262+0000', 'last_change': '2024-09-11T00:24:41.357262+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.357262+0000', 'last_undegraded': '2024-09-11T00:24:41.357262+0000', 'last_fullsized': '2024-09-11T00:24:41.357262+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T00:24:47.474 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-09-11T00:24:47.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.366640+0000', 'last_change': '2024-09-11T00:24:41.366640+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.366640+0000', 'last_undegraded': '2024-09-11T00:24:41.366640+0000', 'last_fullsized': '2024-09-11T00:24:41.366640+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T00:24:47.474 INFO:tasks.ceph.ceph_manager.ceph:PG 5.21 is not active+clean 2024-09-11T00:24:47.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.361893+0000', 'last_change': '2024-09-11T00:24:41.361893+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.361893+0000', 'last_undegraded': '2024-09-11T00:24:41.361893+0000', 'last_fullsized': '2024-09-11T00:24:41.361893+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T00:24:47.474 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-09-11T00:24:47.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.364630+0000', 'last_change': '2024-09-11T00:24:41.364630+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.364630+0000', 'last_undegraded': '2024-09-11T00:24:41.364630+0000', 'last_fullsized': '2024-09-11T00:24:41.364630+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T00:24:47.474 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-09-11T00:24:47.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T00:24:41.347717+0000', 'last_change': '2024-09-11T00:24:41.347717+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.347717+0000', 'last_undegraded': '2024-09-11T00:24:41.347717+0000', 'last_fullsized': '2024-09-11T00:24:41.347717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T00:24:47.475 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-09-11T00:24:47.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.361244+0000', 'last_change': '2024-09-11T00:24:41.361244+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.361244+0000', 'last_undegraded': '2024-09-11T00:24:41.361244+0000', 'last_fullsized': '2024-09-11T00:24:41.361244+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T00:24:47.475 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-09-11T00:24:47.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:40.558594+0000', 'last_change': '2024-09-11T00:24:40.558594+0000', 'last_active': '2024-09-11T00:24:40.342329+0000', 'last_peered': '2024-09-11T00:24:40.342329+0000', 'last_clean': '2024-09-11T00:24:40.342329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:40.558594+0000', 'last_undegraded': '2024-09-11T00:24:40.558594+0000', 'last_fullsized': '2024-09-11T00:24:40.558594+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:40.342329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:40.342329+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:40.342329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T00:24:47.475 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-09-11T00:24:47.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.358279+0000', 'last_change': '2024-09-11T00:24:41.358279+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.358279+0000', 'last_undegraded': '2024-09-11T00:24:41.358279+0000', 'last_fullsized': '2024-09-11T00:24:41.358279+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T00:24:47.475 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-09-11T00:24:47.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.363720+0000', 'last_change': '2024-09-11T00:24:41.363720+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.363720+0000', 'last_undegraded': '2024-09-11T00:24:41.363720+0000', 'last_fullsized': '2024-09-11T00:24:41.363720+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T00:24:47.475 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-09-11T00:24:47.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.364020+0000', 'last_change': '2024-09-11T00:24:41.364020+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.364020+0000', 'last_undegraded': '2024-09-11T00:24:41.364020+0000', 'last_fullsized': '2024-09-11T00:24:41.364020+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T00:24:47.475 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-09-11T00:24:47.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.355754+0000', 'last_change': '2024-09-11T00:24:41.355754+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.355754+0000', 'last_undegraded': '2024-09-11T00:24:41.355754+0000', 'last_fullsized': '2024-09-11T00:24:41.355754+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T00:24:47.476 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-09-11T00:24:47.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.356222+0000', 'last_change': '2024-09-11T00:24:41.356222+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.356222+0000', 'last_undegraded': '2024-09-11T00:24:41.356222+0000', 'last_fullsized': '2024-09-11T00:24:41.356222+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T00:24:47.476 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-09-11T00:24:47.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.363964+0000', 'last_change': '2024-09-11T00:24:41.363964+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.363964+0000', 'last_undegraded': '2024-09-11T00:24:41.363964+0000', 'last_fullsized': '2024-09-11T00:24:41.363964+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T00:24:47.476 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-09-11T00:24:47.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.355750+0000', 'last_change': '2024-09-11T00:24:41.355750+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.355750+0000', 'last_undegraded': '2024-09-11T00:24:41.355750+0000', 'last_fullsized': '2024-09-11T00:24:41.355750+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T00:24:47.476 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-09-11T00:24:47.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.364001+0000', 'last_change': '2024-09-11T00:24:41.364001+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.364001+0000', 'last_undegraded': '2024-09-11T00:24:41.364001+0000', 'last_fullsized': '2024-09-11T00:24:41.364001+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T00:24:47.476 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-09-11T00:24:47.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:40.557402+0000', 'last_change': '2024-09-11T00:24:40.557402+0000', 'last_active': '2024-09-11T00:24:40.342329+0000', 'last_peered': '2024-09-11T00:24:40.342329+0000', 'last_clean': '2024-09-11T00:24:40.342329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:40.557402+0000', 'last_undegraded': '2024-09-11T00:24:40.557402+0000', 'last_fullsized': '2024-09-11T00:24:40.557402+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:40.342329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:40.342329+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:40.342329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T00:24:47.477 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-09-11T00:24:47.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.358380+0000', 'last_change': '2024-09-11T00:24:41.358380+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.358380+0000', 'last_undegraded': '2024-09-11T00:24:41.358380+0000', 'last_fullsized': '2024-09-11T00:24:41.358380+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T00:24:47.477 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-09-11T00:24:47.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.359741+0000', 'last_change': '2024-09-11T00:24:41.359741+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.359741+0000', 'last_undegraded': '2024-09-11T00:24:41.359741+0000', 'last_fullsized': '2024-09-11T00:24:41.359741+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T00:24:47.477 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-09-11T00:24:47.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.364749+0000', 'last_change': '2024-09-11T00:24:41.364749+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.364749+0000', 'last_undegraded': '2024-09-11T00:24:41.364749+0000', 'last_fullsized': '2024-09-11T00:24:41.364749+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T00:24:47.477 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-09-11T00:24:47.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.358214+0000', 'last_change': '2024-09-11T00:24:41.358214+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.358214+0000', 'last_undegraded': '2024-09-11T00:24:41.358214+0000', 'last_fullsized': '2024-09-11T00:24:41.358214+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T00:24:47.477 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-09-11T00:24:47.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.364191+0000', 'last_change': '2024-09-11T00:24:41.364191+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.364191+0000', 'last_undegraded': '2024-09-11T00:24:41.364191+0000', 'last_fullsized': '2024-09-11T00:24:41.364191+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T00:24:47.477 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-09-11T00:24:47.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.360605+0000', 'last_change': '2024-09-11T00:24:41.360605+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.360605+0000', 'last_undegraded': '2024-09-11T00:24:41.360605+0000', 'last_fullsized': '2024-09-11T00:24:41.360605+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T00:24:47.478 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-09-11T00:24:47.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.356154+0000', 'last_change': '2024-09-11T00:24:41.356154+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.356154+0000', 'last_undegraded': '2024-09-11T00:24:41.356154+0000', 'last_fullsized': '2024-09-11T00:24:41.356154+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T00:24:47.478 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-09-11T00:24:47.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.359000+0000', 'last_change': '2024-09-11T00:24:41.359000+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.359000+0000', 'last_undegraded': '2024-09-11T00:24:41.359000+0000', 'last_fullsized': '2024-09-11T00:24:41.359000+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T00:24:47.478 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-11T00:24:47.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.365454+0000', 'last_change': '2024-09-11T00:24:41.365454+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.365454+0000', 'last_undegraded': '2024-09-11T00:24:41.365454+0000', 'last_fullsized': '2024-09-11T00:24:41.365454+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T00:24:47.478 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-09-11T00:24:47.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.372574+0000', 'last_change': '2024-09-11T00:24:41.372574+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.372574+0000', 'last_undegraded': '2024-09-11T00:24:41.372574+0000', 'last_fullsized': '2024-09-11T00:24:41.372574+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T00:24:47.478 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-09-11T00:24:47.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.364446+0000', 'last_change': '2024-09-11T00:24:41.364446+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.364446+0000', 'last_undegraded': '2024-09-11T00:24:41.364446+0000', 'last_fullsized': '2024-09-11T00:24:41.364446+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T00:24:47.479 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-09-11T00:24:47.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:40.558040+0000', 'last_change': '2024-09-11T00:24:40.558040+0000', 'last_active': '2024-09-11T00:24:40.342329+0000', 'last_peered': '2024-09-11T00:24:40.342329+0000', 'last_clean': '2024-09-11T00:24:40.342329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:40.558040+0000', 'last_undegraded': '2024-09-11T00:24:40.558040+0000', 'last_fullsized': '2024-09-11T00:24:40.558040+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:40.342329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:40.342329+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:40.342329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T00:24:47.479 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-09-11T00:24:47.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.365738+0000', 'last_change': '2024-09-11T00:24:41.365738+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.365738+0000', 'last_undegraded': '2024-09-11T00:24:41.365738+0000', 'last_fullsized': '2024-09-11T00:24:41.365738+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T00:24:47.479 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-09-11T00:24:47.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.367480+0000', 'last_change': '2024-09-11T00:24:41.367480+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.367480+0000', 'last_undegraded': '2024-09-11T00:24:41.367480+0000', 'last_fullsized': '2024-09-11T00:24:41.367480+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T00:24:47.479 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-09-11T00:24:47.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.364200+0000', 'last_change': '2024-09-11T00:24:41.364200+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.364200+0000', 'last_undegraded': '2024-09-11T00:24:41.364200+0000', 'last_fullsized': '2024-09-11T00:24:41.364200+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T00:24:47.479 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-09-11T00:24:47.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.369899+0000', 'last_change': '2024-09-11T00:24:41.369899+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.369899+0000', 'last_undegraded': '2024-09-11T00:24:41.369899+0000', 'last_fullsized': '2024-09-11T00:24:41.369899+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T00:24:47.479 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-09-11T00:24:47.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.358544+0000', 'last_change': '2024-09-11T00:24:41.358544+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.358544+0000', 'last_undegraded': '2024-09-11T00:24:41.358544+0000', 'last_fullsized': '2024-09-11T00:24:41.358544+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T00:24:47.480 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-09-11T00:24:47.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:40.558006+0000', 'last_change': '2024-09-11T00:24:40.558006+0000', 'last_active': '2024-09-11T00:24:40.342329+0000', 'last_peered': '2024-09-11T00:24:40.342329+0000', 'last_clean': '2024-09-11T00:24:40.342329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:40.558006+0000', 'last_undegraded': '2024-09-11T00:24:40.558006+0000', 'last_fullsized': '2024-09-11T00:24:40.558006+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:40.342329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:40.342329+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:40.342329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T00:24:47.480 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-11T00:24:47.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T00:24:41.347717+0000', 'last_change': '2024-09-11T00:24:41.347717+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.347717+0000', 'last_undegraded': '2024-09-11T00:24:41.347717+0000', 'last_fullsized': '2024-09-11T00:24:41.347717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T00:24:47.480 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-09-11T00:24:47.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.360816+0000', 'last_change': '2024-09-11T00:24:41.360816+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.360816+0000', 'last_undegraded': '2024-09-11T00:24:41.360816+0000', 'last_fullsized': '2024-09-11T00:24:41.360816+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T00:24:47.480 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-09-11T00:24:47.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:40.557406+0000', 'last_change': '2024-09-11T00:24:40.557406+0000', 'last_active': '2024-09-11T00:24:40.342329+0000', 'last_peered': '2024-09-11T00:24:40.342329+0000', 'last_clean': '2024-09-11T00:24:40.342329+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:40.557406+0000', 'last_undegraded': '2024-09-11T00:24:40.557406+0000', 'last_fullsized': '2024-09-11T00:24:40.557406+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:40.342329+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:40.342329+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:40.342329+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T00:24:47.480 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-11T00:24:47.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T00:24:41.347717+0000', 'last_change': '2024-09-11T00:24:41.347717+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.347717+0000', 'last_undegraded': '2024-09-11T00:24:41.347717+0000', 'last_fullsized': '2024-09-11T00:24:41.347717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T00:24:47.480 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-09-11T00:24:47.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.358301+0000', 'last_change': '2024-09-11T00:24:41.358301+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.358301+0000', 'last_undegraded': '2024-09-11T00:24:41.358301+0000', 'last_fullsized': '2024-09-11T00:24:41.358301+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T00:24:47.481 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-09-11T00:24:47.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.355983+0000', 'last_change': '2024-09-11T00:24:41.355983+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.355983+0000', 'last_undegraded': '2024-09-11T00:24:41.355983+0000', 'last_fullsized': '2024-09-11T00:24:41.355983+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T00:24:47.481 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-09-11T00:24:47.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T00:24:41.366301+0000', 'last_change': '2024-09-11T00:24:41.366301+0000', 'last_active': '2024-09-11T00:24:41.347717+0000', 'last_peered': '2024-09-11T00:24:41.347717+0000', 'last_clean': '2024-09-11T00:24:41.347717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T00:24:41.366301+0000', 'last_undegraded': '2024-09-11T00:24:41.366301+0000', 'last_fullsized': '2024-09-11T00:24:41.366301+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'last_clean_scrub_stamp': '2024-09-11T00:24:41.347717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T00:24:47.481 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T00:24:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.662+0000 7fcdc2200640 1 -- 172.21.15.40:0/1397482423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdbc15bcc0 msgr2=0x7fcdbc0cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.662+0000 7fcdc2200640 1 --2- 172.21.15.40:0/1397482423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdbc15bcc0 0x7fcdbc0cb420 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc074980 tx=0x7fcdac02a560 comp rx=0 tx=0).stop 2024-09-11T00:24:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.662+0000 7fcdc2200640 1 -- 172.21.15.40:0/1397482423 shutdown_connections 2024-09-11T00:24:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.662+0000 7fcdc2200640 1 --2- 172.21.15.40:0/1397482423 >> v2:172.21.15.175:3300/0 conn(0x7fcdbc0ca200 0x7fcdbc0ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.662+0000 7fcdc2200640 1 --2- 172.21.15.40:0/1397482423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcdbc0cba70 0x7fcdbc0cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.662+0000 7fcdc2200640 1 --2- 172.21.15.40:0/1397482423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdbc15bcc0 0x7fcdbc0cb420 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.662+0000 7fcdc2200640 1 -- 172.21.15.40:0/1397482423 >> 172.21.15.40:0/1397482423 conn(0x7fcdbc0cfbb0 msgr2=0x7fcdbc0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.662+0000 7fcdc2200640 1 -- 172.21.15.40:0/1397482423 shutdown_connections 2024-09-11T00:24:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.662+0000 7fcdc2200640 1 -- 172.21.15.40:0/1397482423 wait complete. 2024-09-11T00:24:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.664+0000 7fcdc2200640 1 Processor -- start 2024-09-11T00:24:47.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.664+0000 7fcdc2200640 1 -- start start 2024-09-11T00:24:47.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.665+0000 7fcdc2200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdbc0ca200 0x7fcdbc1486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:47.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.665+0000 7fcdc2200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdbc0cba70 0x7fcdbc14af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:47.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.665+0000 7fcdc2200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcdbc15bcc0 0x7fcdbc15df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:47.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.665+0000 7fcdc2200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc15f940 con 0x7fcdbc0ca200 2024-09-11T00:24:47.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.665+0000 7fcdc2200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc15f7c0 con 0x7fcdbc0cba70 2024-09-11T00:24:47.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.665+0000 7fcdc2200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fcdbc0cabd0 con 0x7fcdbc15bcc0 2024-09-11T00:24:47.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.665+0000 7fcdbb400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdbc0ca200 0x7fcdbc1486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:47.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.665+0000 7fcdbb400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdbc0ca200 0x7fcdbc1486b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42346/0 (socket says 172.21.15.40:42346) 2024-09-11T00:24:47.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.665+0000 7fcdbb400640 1 -- 172.21.15.40:0/1808752327 learned_addr learned my addr 172.21.15.40:0/1808752327 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:47.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.665+0000 7fcdbb400640 1 -- 172.21.15.40:0/1808752327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcdbc15bcc0 msgr2=0x7fcdbc15df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:47.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.665+0000 7fcdbb400640 1 --2- 172.21.15.40:0/1808752327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcdbc15bcc0 0x7fcdbc15df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.665+0000 7fcdbb400640 1 -- 172.21.15.40:0/1808752327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdbc0cba70 msgr2=0x7fcdbc14af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:47.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.665+0000 7fcdb2a00640 1 --2- 172.21.15.40:0/1808752327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdbc0cba70 0x7fcdbc14af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:47.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.666+0000 7fcdbb400640 1 --2- 172.21.15.40:0/1808752327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdbc0cba70 0x7fcdbc14af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.666+0000 7fcdbb400640 1 -- 172.21.15.40:0/1808752327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdbc14b900 con 0x7fcdbc0ca200 2024-09-11T00:24:47.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.666+0000 7fcdb2a00640 1 --2- 172.21.15.40:0/1808752327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdbc0cba70 0x7fcdbc14af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:47.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.666+0000 7fcdbb400640 1 --2- 172.21.15.40:0/1808752327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdbc0ca200 0x7fcdbc1486b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcdac034040 tx=0x7fcdac003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:47.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.666+0000 7fcdb3e00640 1 -- 172.21.15.40:0/1808752327 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac03e030 con 0x7fcdbc0ca200 2024-09-11T00:24:47.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.666+0000 7fcdb3e00640 1 -- 172.21.15.40:0/1808752327 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdac003e00 con 0x7fcdbc0ca200 2024-09-11T00:24:47.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.666+0000 7fcdc2200640 1 -- 172.21.15.40:0/1808752327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdbc14bbe0 con 0x7fcdbc0ca200 2024-09-11T00:24:47.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.666+0000 7fcdb3e00640 1 -- 172.21.15.40:0/1808752327 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac035040 con 0x7fcdbc0ca200 2024-09-11T00:24:47.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.666+0000 7fcdc2200640 1 -- 172.21.15.40:0/1808752327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdbc0c7100 con 0x7fcdbc0ca200 2024-09-11T00:24:47.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.667+0000 7fcdc2200640 1 -- 172.21.15.40:0/1808752327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdbc14be00 con 0x7fcdbc0ca200 2024-09-11T00:24:47.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.668+0000 7fcdb3e00640 1 -- 172.21.15.40:0/1808752327 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcdac0049c0 con 0x7fcdbc0ca200 2024-09-11T00:24:47.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.669+0000 7fcdb3e00640 1 --2- 172.21.15.40:0/1808752327 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fcd98077f70 0x7fcd9807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:47.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.670+0000 7fcdb3e00640 1 -- 172.21.15.40:0/1808752327 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fcdac0ba7e0 con 0x7fcdbc0ca200 2024-09-11T00:24:47.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.670+0000 7fcdb2a00640 1 --2- 172.21.15.40:0/1808752327 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fcd98077f70 0x7fcd9807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:47.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.670+0000 7fcdb2a00640 1 --2- 172.21.15.40:0/1808752327 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fcd98077f70 0x7fcd9807a430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc06c970 tx=0x7fcda4005e50 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:47.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.674+0000 7fcdb3e00640 1 -- 172.21.15.40:0/1808752327 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcdac083240 con 0x7fcdbc0ca200 2024-09-11T00:24:47.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.944+0000 7fcdc2200640 1 -- 172.21.15.40:0/1808752327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fcdbc0c6c20 con 0x7fcdbc0ca200 2024-09-11T00:24:47.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.944+0000 7fcdb3e00640 1 -- 172.21.15.40:0/1808752327 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1699 (secure 0 0 0) 0x7fcdac082b40 con 0x7fcdbc0ca200 2024-09-11T00:24:47.947 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:47.947 INFO:teuthology.orchestra.run.smithi040.stdout:{"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":85,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1726014216,"num_in_osds":8,"osd_in_since":1726014206,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":65},{"state_name":"active+clean","count":28},{"state_name":"unknown","count":4}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":229740544,"bytes_avail":772864372736,"bytes_total":773094113280,"unknown_pgs_ratio":0.041237112134695053,"inactive_pgs_ratio":0.67010307312011719},"fsmap":{"epoch":16,"btime":"2024-09-11T00:24:45:383933+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4944}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-11T00:24:37.788161+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T00:24:47.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.947+0000 7fcdc2200640 1 -- 172.21.15.40:0/1808752327 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fcd98077f70 msgr2=0x7fcd9807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:47.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.947+0000 7fcdc2200640 1 --2- 172.21.15.40:0/1808752327 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fcd98077f70 0x7fcd9807a430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc06c970 tx=0x7fcda4005e50 comp rx=0 tx=0).stop 2024-09-11T00:24:47.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.947+0000 7fcdc2200640 1 -- 172.21.15.40:0/1808752327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdbc0ca200 msgr2=0x7fcdbc1486b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:47.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.947+0000 7fcdc2200640 1 --2- 172.21.15.40:0/1808752327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdbc0ca200 0x7fcdbc1486b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcdac034040 tx=0x7fcdac003910 comp rx=0 tx=0).stop 2024-09-11T00:24:47.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.947+0000 7fcdc2200640 1 -- 172.21.15.40:0/1808752327 shutdown_connections 2024-09-11T00:24:47.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.947+0000 7fcdc2200640 1 --2- 172.21.15.40:0/1808752327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcdbc15bcc0 0x7fcdbc15df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.947+0000 7fcdc2200640 1 --2- 172.21.15.40:0/1808752327 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fcd98077f70 0x7fcd9807a430 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.947+0000 7fcdc2200640 1 --2- 172.21.15.40:0/1808752327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdbc0cba70 0x7fcdbc14af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.947+0000 7fcdc2200640 1 --2- 172.21.15.40:0/1808752327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdbc0ca200 0x7fcdbc1486b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:47.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.947+0000 7fcdc2200640 1 -- 172.21.15.40:0/1808752327 >> 172.21.15.40:0/1808752327 conn(0x7fcdbc0cfbb0 msgr2=0x7fcdbc0cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:47.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.947+0000 7fcdc2200640 1 -- 172.21.15.40:0/1808752327 shutdown_connections 2024-09-11T00:24:47.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:47.947+0000 7fcdc2200640 1 -- 172.21.15.40:0/1808752327 wait complete. 2024-09-11T00:24:47.966 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T00:24:47.966 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:24:48.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.123+0000 7f4e15400640 1 -- 172.21.15.40:0/1334838274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e100cb420 msgr2=0x7f4e1006f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:48.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.123+0000 7f4e15400640 1 --2- 172.21.15.40:0/1334838274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e100cb420 0x7f4e1006f020 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4e08005fd0 tx=0x7f4e0802a940 comp rx=0 tx=0).stop 2024-09-11T00:24:48.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.123+0000 7f4e15400640 1 -- 172.21.15.40:0/1334838274 shutdown_connections 2024-09-11T00:24:48.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.123+0000 7f4e15400640 1 --2- 172.21.15.40:0/1334838274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e100cb420 0x7f4e1006f020 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:48.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.123+0000 7f4e15400640 1 -- 172.21.15.40:0/1334838274 >> 172.21.15.40:0/1334838274 conn(0x7f4e100cfbb0 msgr2=0x7f4e100cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:48.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.123+0000 7f4e15400640 1 -- 172.21.15.40:0/1334838274 shutdown_connections 2024-09-11T00:24:48.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.123+0000 7f4e15400640 1 -- 172.21.15.40:0/1334838274 wait complete. 2024-09-11T00:24:48.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.125+0000 7f4e15400640 1 Processor -- start 2024-09-11T00:24:48.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.125+0000 7f4e15400640 1 -- start start 2024-09-11T00:24:48.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.126+0000 7f4e15400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e100cb420 0x7f4e1015e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:48.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.126+0000 7f4e15400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e100cc180 0x7f4e1015a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:48.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.126+0000 7f4e15400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e1015bcc0 0x7f4e101f42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:48.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.126+0000 7f4e15400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1006f560 con 0x7f4e100cb420 2024-09-11T00:24:48.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.126+0000 7f4e15400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1015f9d0 con 0x7f4e100cc180 2024-09-11T00:24:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.126+0000 7f4e15400640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4e1006f6e0 con 0x7f4e1015bcc0 2024-09-11T00:24:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.126+0000 7f4e0e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e100cb420 0x7f4e1015e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.126+0000 7f4e0e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e100cb420 0x7f4e1015e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47292/0 (socket says 172.21.15.40:47292) 2024-09-11T00:24:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.126+0000 7f4e0e800640 1 -- 172.21.15.40:0/1176775571 learned_addr learned my addr 172.21.15.40:0/1176775571 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.127+0000 7f4e0de00640 1 --2- 172.21.15.40:0/1176775571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e100cc180 0x7f4e1015a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.127+0000 7f4e0f200640 1 --2- 172.21.15.40:0/1176775571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e1015bcc0 0x7f4e101f42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.127+0000 7f4e0e800640 1 -- 172.21.15.40:0/1176775571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e1015bcc0 msgr2=0x7f4e101f42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.127+0000 7f4e0e800640 1 --2- 172.21.15.40:0/1176775571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e1015bcc0 0x7f4e101f42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.127+0000 7f4e0e800640 1 -- 172.21.15.40:0/1176775571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e100cc180 msgr2=0x7f4e1015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.127+0000 7f4e0e800640 1 --2- 172.21.15.40:0/1176775571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e100cc180 0x7f4e1015a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.127+0000 7f4e0e800640 1 -- 172.21.15.40:0/1176775571 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e1015aa50 con 0x7f4e100cb420 2024-09-11T00:24:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.127+0000 7f4e0e800640 1 --2- 172.21.15.40:0/1176775571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e100cb420 0x7f4e1015e0e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4e00001240 tx=0x7f4e0000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:48.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.127+0000 7f4e06a00640 1 -- 172.21.15.40:0/1176775571 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e00011790 con 0x7f4e100cb420 2024-09-11T00:24:48.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.127+0000 7f4e06a00640 1 -- 172.21.15.40:0/1176775571 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e00017070 con 0x7f4e100cb420 2024-09-11T00:24:48.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.127+0000 7f4e06a00640 1 -- 172.21.15.40:0/1176775571 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e00011c60 con 0x7f4e100cb420 2024-09-11T00:24:48.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.127+0000 7f4e15400640 1 -- 172.21.15.40:0/1176775571 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e1015ed30 con 0x7f4e100cb420 2024-09-11T00:24:48.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.128+0000 7f4e15400640 1 -- 172.21.15.40:0/1176775571 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e1015d1f0 con 0x7f4e100cb420 2024-09-11T00:24:48.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.129+0000 7f4e15400640 1 -- 172.21.15.40:0/1176775571 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e1006fb90 con 0x7f4e100cb420 2024-09-11T00:24:48.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.130+0000 7f4e06a00640 1 -- 172.21.15.40:0/1176775571 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4e0001c460 con 0x7f4e100cb420 2024-09-11T00:24:48.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.131+0000 7f4e06a00640 1 --2- 172.21.15.40:0/1176775571 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4df0077f70 0x7f4df007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:48.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.131+0000 7f4e06a00640 1 -- 172.21.15.40:0/1176775571 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f4e00099a80 con 0x7f4e100cb420 2024-09-11T00:24:48.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.132+0000 7f4e0de00640 1 --2- 172.21.15.40:0/1176775571 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4df0077f70 0x7f4df007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:48.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.132+0000 7f4e0de00640 1 --2- 172.21.15.40:0/1176775571 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4df0077f70 0x7f4df007a430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc000c00 tx=0x7f4dfc009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:48.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.136+0000 7f4e06a00640 1 -- 172.21.15.40:0/1176775571 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4e0009be20 con 0x7f4e100cb420 2024-09-11T00:24:48.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.325+0000 7f4e15400640 1 -- 172.21.15.40:0/1176775571 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4e10076260 con 0x7f4df0077f70 2024-09-11T00:24:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.330+0000 7f4e06a00640 1 -- 172.21.15.40:0/1176775571 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251940 (secure 0 0 0) 0x7f4e10076260 con 0x7f4df0077f70 2024-09-11T00:24:48.335 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:48.336 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T00:24:48.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.334+0000 7f4e15400640 1 -- 172.21.15.40:0/1176775571 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4df0077f70 msgr2=0x7f4df007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:48.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.334+0000 7f4e15400640 1 --2- 172.21.15.40:0/1176775571 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4df0077f70 0x7f4df007a430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc000c00 tx=0x7f4dfc009040 comp rx=0 tx=0).stop 2024-09-11T00:24:48.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.334+0000 7f4e15400640 1 -- 172.21.15.40:0/1176775571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e100cb420 msgr2=0x7f4e1015e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:48.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.334+0000 7f4e15400640 1 --2- 172.21.15.40:0/1176775571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e100cb420 0x7f4e1015e0e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4e00001240 tx=0x7f4e0000c890 comp rx=0 tx=0).stop 2024-09-11T00:24:48.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.334+0000 7f4e15400640 1 -- 172.21.15.40:0/1176775571 shutdown_connections 2024-09-11T00:24:48.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.334+0000 7f4e15400640 1 --2- 172.21.15.40:0/1176775571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e1015bcc0 0x7f4e101f42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:48.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.334+0000 7f4e15400640 1 --2- 172.21.15.40:0/1176775571 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4df0077f70 0x7f4df007a430 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:48.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.334+0000 7f4e15400640 1 --2- 172.21.15.40:0/1176775571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e100cc180 0x7f4e1015a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:48.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.334+0000 7f4e15400640 1 --2- 172.21.15.40:0/1176775571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e100cb420 0x7f4e1015e0e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:48.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.334+0000 7f4e15400640 1 -- 172.21.15.40:0/1176775571 >> 172.21.15.40:0/1176775571 conn(0x7f4e100cfbb0 msgr2=0x7f4e100cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:48.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.335+0000 7f4e15400640 1 -- 172.21.15.40:0/1176775571 shutdown_connections 2024-09-11T00:24:48.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:48.335+0000 7f4e15400640 1 -- 172.21.15.40:0/1176775571 wait complete. 2024-09-11T00:24:48.354 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-09-11T00:24:47.790527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224708,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750012,"statfs":{"total":773094113280,"available":772864012288,"internally_reserved":0,"allocated":4366336,"data_stored":2401284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.438741"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376553+0000","last_change":"2024-09-11T00:24:42.384769+0000","last_active":"2024-09-11T00:24:43.376553+0000","last_peered":"2024-09-11T00:24:43.376553+0000","last_clean":"2024-09-11T00:24:43.376553+0000","last_became_active":"2024-09-11T00:24:42.384138+0000","last_became_peered":"2024-09-11T00:24:42.384138+0000","last_unstale":"2024-09-11T00:24:43.376553+0000","last_undegraded":"2024-09-11T00:24:43.376553+0000","last_fullsized":"2024-09-11T00:24:43.376553+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:29:15.035892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376292+0000","last_change":"2024-09-11T00:24:42.386678+0000","last_active":"2024-09-11T00:24:43.376292+0000","last_peered":"2024-09-11T00:24:43.376292+0000","last_clean":"2024-09-11T00:24:43.376292+0000","last_became_active":"2024-09-11T00:24:42.386323+0000","last_became_peered":"2024-09-11T00:24:42.386323+0000","last_unstale":"2024-09-11T00:24:43.376292+0000","last_undegraded":"2024-09-11T00:24:43.376292+0000","last_fullsized":"2024-09-11T00:24:43.376292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:06:35.328169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632992+0000","last_change":"2024-09-11T00:24:42.381116+0000","last_active":"2024-09-11T00:24:43.632992+0000","last_peered":"2024-09-11T00:24:43.632992+0000","last_clean":"2024-09-11T00:24:43.632992+0000","last_became_active":"2024-09-11T00:24:42.380860+0000","last_became_peered":"2024-09-11T00:24:42.380860+0000","last_unstale":"2024-09-11T00:24:43.632992+0000","last_undegraded":"2024-09-11T00:24:43.632992+0000","last_fullsized":"2024-09-11T00:24:43.632992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:10.904009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.405637+0000","last_change":"2024-09-11T00:24:42.384156+0000","last_active":"2024-09-11T00:24:43.405637+0000","last_peered":"2024-09-11T00:24:43.405637+0000","last_clean":"2024-09-11T00:24:43.405637+0000","last_became_active":"2024-09-11T00:24:42.383894+0000","last_became_peered":"2024-09-11T00:24:42.383894+0000","last_unstale":"2024-09-11T00:24:43.405637+0000","last_undegraded":"2024-09-11T00:24:43.405637+0000","last_fullsized":"2024-09-11T00:24:43.405637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:24.484912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631645+0000","last_change":"2024-09-11T00:24:42.393665+0000","last_active":"2024-09-11T00:24:43.631645+0000","last_peered":"2024-09-11T00:24:43.631645+0000","last_clean":"2024-09-11T00:24:43.631645+0000","last_became_active":"2024-09-11T00:24:42.391969+0000","last_became_peered":"2024-09-11T00:24:42.391969+0000","last_unstale":"2024-09-11T00:24:43.631645+0000","last_undegraded":"2024-09-11T00:24:43.631645+0000","last_fullsized":"2024-09-11T00:24:43.631645+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:13.891619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375477+0000","last_change":"2024-09-11T00:24:42.380197+0000","last_active":"2024-09-11T00:24:43.375477+0000","last_peered":"2024-09-11T00:24:43.375477+0000","last_clean":"2024-09-11T00:24:43.375477+0000","last_became_active":"2024-09-11T00:24:42.379928+0000","last_became_peered":"2024-09-11T00:24:42.379928+0000","last_unstale":"2024-09-11T00:24:43.375477+0000","last_undegraded":"2024-09-11T00:24:43.375477+0000","last_fullsized":"2024-09-11T00:24:43.375477+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:48:15.761482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376162+0000","last_change":"2024-09-11T00:24:42.396270+0000","last_active":"2024-09-11T00:24:43.376162+0000","last_peered":"2024-09-11T00:24:43.376162+0000","last_clean":"2024-09-11T00:24:43.376162+0000","last_became_active":"2024-09-11T00:24:42.395938+0000","last_became_peered":"2024-09-11T00:24:42.395938+0000","last_unstale":"2024-09-11T00:24:43.376162+0000","last_undegraded":"2024-09-11T00:24:43.376162+0000","last_fullsized":"2024-09-11T00:24:43.376162+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:23.870706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375571+0000","last_change":"2024-09-11T00:24:42.401018+0000","last_active":"2024-09-11T00:24:43.375571+0000","last_peered":"2024-09-11T00:24:43.375571+0000","last_clean":"2024-09-11T00:24:43.375571+0000","last_became_active":"2024-09-11T00:24:42.399194+0000","last_became_peered":"2024-09-11T00:24:42.399194+0000","last_unstale":"2024-09-11T00:24:43.375571+0000","last_undegraded":"2024-09-11T00:24:43.375571+0000","last_fullsized":"2024-09-11T00:24:43.375571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:05.699724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.633266+0000","last_change":"2024-09-11T00:24:42.394035+0000","last_active":"2024-09-11T00:24:43.633266+0000","last_peered":"2024-09-11T00:24:43.633266+0000","last_clean":"2024-09-11T00:24:43.633266+0000","last_became_active":"2024-09-11T00:24:42.393363+0000","last_became_peered":"2024-09-11T00:24:42.393363+0000","last_unstale":"2024-09-11T00:24:43.633266+0000","last_undegraded":"2024-09-11T00:24:43.633266+0000","last_fullsized":"2024-09-11T00:24:43.633266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:05.287137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.406320+0000","last_change":"2024-09-11T00:24:42.388500+0000","last_active":"2024-09-11T00:24:43.406320+0000","last_peered":"2024-09-11T00:24:43.406320+0000","last_clean":"2024-09-11T00:24:43.406320+0000","last_became_active":"2024-09-11T00:24:42.383696+0000","last_became_peered":"2024-09-11T00:24:42.383696+0000","last_unstale":"2024-09-11T00:24:43.406320+0000","last_undegraded":"2024-09-11T00:24:43.406320+0000","last_fullsized":"2024-09-11T00:24:43.406320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:57.346239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376546+0000","last_change":"2024-09-11T00:24:42.401909+0000","last_active":"2024-09-11T00:24:43.376546+0000","last_peered":"2024-09-11T00:24:43.376546+0000","last_clean":"2024-09-11T00:24:43.376546+0000","last_became_active":"2024-09-11T00:24:42.401667+0000","last_became_peered":"2024-09-11T00:24:42.401667+0000","last_unstale":"2024-09-11T00:24:43.376546+0000","last_undegraded":"2024-09-11T00:24:43.376546+0000","last_fullsized":"2024-09-11T00:24:43.376546+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:47.293955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632553+0000","last_change":"2024-09-11T00:24:42.383425+0000","last_active":"2024-09-11T00:24:43.632553+0000","last_peered":"2024-09-11T00:24:43.632553+0000","last_clean":"2024-09-11T00:24:43.632553+0000","last_became_active":"2024-09-11T00:24:42.383121+0000","last_became_peered":"2024-09-11T00:24:42.383121+0000","last_unstale":"2024-09-11T00:24:43.632553+0000","last_undegraded":"2024-09-11T00:24:43.632553+0000","last_fullsized":"2024-09-11T00:24:43.632553+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:46.185121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631715+0000","last_change":"2024-09-11T00:24:42.394455+0000","last_active":"2024-09-11T00:24:43.631715+0000","last_peered":"2024-09-11T00:24:43.631715+0000","last_clean":"2024-09-11T00:24:43.631715+0000","last_became_active":"2024-09-11T00:24:42.393991+0000","last_became_peered":"2024-09-11T00:24:42.393991+0000","last_unstale":"2024-09-11T00:24:43.631715+0000","last_undegraded":"2024-09-11T00:24:43.631715+0000","last_fullsized":"2024-09-11T00:24:43.631715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:10.442090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375818+0000","last_change":"2024-09-11T00:24:42.395052+0000","last_active":"2024-09-11T00:24:43.375818+0000","last_peered":"2024-09-11T00:24:43.375818+0000","last_clean":"2024-09-11T00:24:43.375818+0000","last_became_active":"2024-09-11T00:24:42.393713+0000","last_became_peered":"2024-09-11T00:24:42.393713+0000","last_unstale":"2024-09-11T00:24:43.375818+0000","last_undegraded":"2024-09-11T00:24:43.375818+0000","last_fullsized":"2024-09-11T00:24:43.375818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:22.005112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632394+0000","last_change":"2024-09-11T00:24:42.379087+0000","last_active":"2024-09-11T00:24:43.632394+0000","last_peered":"2024-09-11T00:24:43.632394+0000","last_clean":"2024-09-11T00:24:43.632394+0000","last_became_active":"2024-09-11T00:24:42.378791+0000","last_became_peered":"2024-09-11T00:24:42.378791+0000","last_unstale":"2024-09-11T00:24:43.632394+0000","last_undegraded":"2024-09-11T00:24:43.632394+0000","last_fullsized":"2024-09-11T00:24:43.632394+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:25.115101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376214+0000","last_change":"2024-09-11T00:24:42.392700+0000","last_active":"2024-09-11T00:24:43.376214+0000","last_peered":"2024-09-11T00:24:43.376214+0000","last_clean":"2024-09-11T00:24:43.376214+0000","last_became_active":"2024-09-11T00:24:42.392399+0000","last_became_peered":"2024-09-11T00:24:42.392399+0000","last_unstale":"2024-09-11T00:24:43.376214+0000","last_undegraded":"2024-09-11T00:24:43.376214+0000","last_fullsized":"2024-09-11T00:24:43.376214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:39.980626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375823+0000","last_change":"2024-09-11T00:24:42.395925+0000","last_active":"2024-09-11T00:24:43.375823+0000","last_peered":"2024-09-11T00:24:43.375823+0000","last_clean":"2024-09-11T00:24:43.375823+0000","last_became_active":"2024-09-11T00:24:42.395610+0000","last_became_peered":"2024-09-11T00:24:42.395610+0000","last_unstale":"2024-09-11T00:24:43.375823+0000","last_undegraded":"2024-09-11T00:24:43.375823+0000","last_fullsized":"2024-09-11T00:24:43.375823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:10.772696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376350+0000","last_change":"2024-09-11T00:24:42.389497+0000","last_active":"2024-09-11T00:24:43.376350+0000","last_peered":"2024-09-11T00:24:43.376350+0000","last_clean":"2024-09-11T00:24:43.376350+0000","last_became_active":"2024-09-11T00:24:42.387575+0000","last_became_peered":"2024-09-11T00:24:42.387575+0000","last_unstale":"2024-09-11T00:24:43.376350+0000","last_undegraded":"2024-09-11T00:24:43.376350+0000","last_fullsized":"2024-09-11T00:24:43.376350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:02:57.009012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376090+0000","last_change":"2024-09-11T00:24:42.395057+0000","last_active":"2024-09-11T00:24:43.376090+0000","last_peered":"2024-09-11T00:24:43.376090+0000","last_clean":"2024-09-11T00:24:43.376090+0000","last_became_active":"2024-09-11T00:24:42.394320+0000","last_became_peered":"2024-09-11T00:24:42.394320+0000","last_unstale":"2024-09-11T00:24:43.376090+0000","last_undegraded":"2024-09-11T00:24:43.376090+0000","last_fullsized":"2024-09-11T00:24:43.376090+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:24.732359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631733+0000","last_change":"2024-09-11T00:24:42.380995+0000","last_active":"2024-09-11T00:24:43.631733+0000","last_peered":"2024-09-11T00:24:43.631733+0000","last_clean":"2024-09-11T00:24:43.631733+0000","last_became_active":"2024-09-11T00:24:42.380742+0000","last_became_peered":"2024-09-11T00:24:42.380742+0000","last_unstale":"2024-09-11T00:24:43.631733+0000","last_undegraded":"2024-09-11T00:24:43.631733+0000","last_fullsized":"2024-09-11T00:24:43.631733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:40.389792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632110+0000","last_change":"2024-09-11T00:24:42.385694+0000","last_active":"2024-09-11T00:24:43.632110+0000","last_peered":"2024-09-11T00:24:43.632110+0000","last_clean":"2024-09-11T00:24:43.632110+0000","last_became_active":"2024-09-11T00:24:42.385407+0000","last_became_peered":"2024-09-11T00:24:42.385407+0000","last_unstale":"2024-09-11T00:24:43.632110+0000","last_undegraded":"2024-09-11T00:24:43.632110+0000","last_fullsized":"2024-09-11T00:24:43.632110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:31.285979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631914+0000","last_change":"2024-09-11T00:24:42.391470+0000","last_active":"2024-09-11T00:24:43.631914+0000","last_peered":"2024-09-11T00:24:43.631914+0000","last_clean":"2024-09-11T00:24:43.631914+0000","last_became_active":"2024-09-11T00:24:42.391208+0000","last_became_peered":"2024-09-11T00:24:42.391208+0000","last_unstale":"2024-09-11T00:24:43.631914+0000","last_undegraded":"2024-09-11T00:24:43.631914+0000","last_fullsized":"2024-09-11T00:24:43.631914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:29:15.035892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.402076+0000","last_change":"2024-09-11T00:24:42.388682+0000","last_active":"2024-09-11T00:24:43.402076+0000","last_peered":"2024-09-11T00:24:43.402076+0000","last_clean":"2024-09-11T00:24:43.402076+0000","last_became_active":"2024-09-11T00:24:42.388104+0000","last_became_peered":"2024-09-11T00:24:42.388104+0000","last_unstale":"2024-09-11T00:24:43.402076+0000","last_undegraded":"2024-09-11T00:24:43.402076+0000","last_fullsized":"2024-09-11T00:24:43.402076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:56:07.235210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631889+0000","last_change":"2024-09-11T00:24:42.397013+0000","last_active":"2024-09-11T00:24:43.631889+0000","last_peered":"2024-09-11T00:24:43.631889+0000","last_clean":"2024-09-11T00:24:43.631889+0000","last_became_active":"2024-09-11T00:24:42.396587+0000","last_became_peered":"2024-09-11T00:24:42.396587+0000","last_unstale":"2024-09-11T00:24:43.631889+0000","last_undegraded":"2024-09-11T00:24:43.631889+0000","last_fullsized":"2024-09-11T00:24:43.631889+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:57.346239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.406428+0000","last_change":"2024-09-11T00:24:42.390236+0000","last_active":"2024-09-11T00:24:43.406428+0000","last_peered":"2024-09-11T00:24:43.406428+0000","last_clean":"2024-09-11T00:24:43.406428+0000","last_became_active":"2024-09-11T00:24:42.389942+0000","last_became_peered":"2024-09-11T00:24:42.389942+0000","last_unstale":"2024-09-11T00:24:43.406428+0000","last_undegraded":"2024-09-11T00:24:43.406428+0000","last_fullsized":"2024-09-11T00:24:43.406428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:46.185121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376477+0000","last_change":"2024-09-11T00:24:42.390701+0000","last_active":"2024-09-11T00:24:43.376477+0000","last_peered":"2024-09-11T00:24:43.376477+0000","last_clean":"2024-09-11T00:24:43.376477+0000","last_became_active":"2024-09-11T00:24:42.390372+0000","last_became_peered":"2024-09-11T00:24:42.390372+0000","last_unstale":"2024-09-11T00:24:43.376477+0000","last_undegraded":"2024-09-11T00:24:43.376477+0000","last_fullsized":"2024-09-11T00:24:43.376477+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:26.157640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.406317+0000","last_change":"2024-09-11T00:24:42.383015+0000","last_active":"2024-09-11T00:24:43.406317+0000","last_peered":"2024-09-11T00:24:43.406317+0000","last_clean":"2024-09-11T00:24:43.406317+0000","last_became_active":"2024-09-11T00:24:42.382653+0000","last_became_peered":"2024-09-11T00:24:42.382653+0000","last_unstale":"2024-09-11T00:24:43.406317+0000","last_undegraded":"2024-09-11T00:24:43.406317+0000","last_fullsized":"2024-09-11T00:24:43.406317+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:31.076560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632772+0000","last_change":"2024-09-11T00:24:42.378485+0000","last_active":"2024-09-11T00:24:43.632772+0000","last_peered":"2024-09-11T00:24:43.632772+0000","last_clean":"2024-09-11T00:24:43.632772+0000","last_became_active":"2024-09-11T00:24:42.378201+0000","last_became_peered":"2024-09-11T00:24:42.378201+0000","last_unstale":"2024-09-11T00:24:43.632772+0000","last_undegraded":"2024-09-11T00:24:43.632772+0000","last_fullsized":"2024-09-11T00:24:43.632772+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:48:15.761482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632396+0000","last_change":"2024-09-11T00:24:42.384518+0000","last_active":"2024-09-11T00:24:43.632396+0000","last_peered":"2024-09-11T00:24:43.632396+0000","last_clean":"2024-09-11T00:24:43.632396+0000","last_became_active":"2024-09-11T00:24:42.384116+0000","last_became_peered":"2024-09-11T00:24:42.384116+0000","last_unstale":"2024-09-11T00:24:43.632396+0000","last_undegraded":"2024-09-11T00:24:43.632396+0000","last_fullsized":"2024-09-11T00:24:43.632396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:43.213311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375653+0000","last_change":"2024-09-11T00:24:42.397202+0000","last_active":"2024-09-11T00:24:43.375653+0000","last_peered":"2024-09-11T00:24:43.375653+0000","last_clean":"2024-09-11T00:24:43.375653+0000","last_became_active":"2024-09-11T00:24:42.396965+0000","last_became_peered":"2024-09-11T00:24:42.396965+0000","last_unstale":"2024-09-11T00:24:43.375653+0000","last_undegraded":"2024-09-11T00:24:43.375653+0000","last_fullsized":"2024-09-11T00:24:43.375653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:33.556119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376021+0000","last_change":"2024-09-11T00:24:42.397135+0000","last_active":"2024-09-11T00:24:43.376021+0000","last_peered":"2024-09-11T00:24:43.376021+0000","last_clean":"2024-09-11T00:24:43.376021+0000","last_became_active":"2024-09-11T00:24:42.396887+0000","last_became_peered":"2024-09-11T00:24:42.396887+0000","last_unstale":"2024-09-11T00:24:43.376021+0000","last_undegraded":"2024-09-11T00:24:43.376021+0000","last_fullsized":"2024-09-11T00:24:43.376021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:04.833882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375730+0000","last_change":"2024-09-11T00:24:42.394146+0000","last_active":"2024-09-11T00:24:43.375730+0000","last_peered":"2024-09-11T00:24:43.375730+0000","last_clean":"2024-09-11T00:24:43.375730+0000","last_became_active":"2024-09-11T00:24:42.393838+0000","last_became_peered":"2024-09-11T00:24:42.393838+0000","last_unstale":"2024-09-11T00:24:43.375730+0000","last_undegraded":"2024-09-11T00:24:43.375730+0000","last_fullsized":"2024-09-11T00:24:43.375730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:52:10.202093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.402478+0000","last_change":"2024-09-11T00:24:42.389752+0000","last_active":"2024-09-11T00:24:43.402478+0000","last_peered":"2024-09-11T00:24:43.402478+0000","last_clean":"2024-09-11T00:24:43.402478+0000","last_became_active":"2024-09-11T00:24:42.389415+0000","last_became_peered":"2024-09-11T00:24:42.389415+0000","last_unstale":"2024-09-11T00:24:43.402478+0000","last_undegraded":"2024-09-11T00:24:43.402478+0000","last_fullsized":"2024-09-11T00:24:43.402478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:16.857278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376707+0000","last_change":"2024-09-11T00:24:41.375539+0000","last_active":"2024-09-11T00:24:43.376707+0000","last_peered":"2024-09-11T00:24:43.376707+0000","last_clean":"2024-09-11T00:24:43.376707+0000","last_became_active":"2024-09-11T00:24:41.375222+0000","last_became_peered":"2024-09-11T00:24:41.375222+0000","last_unstale":"2024-09-11T00:24:43.376707+0000","last_undegraded":"2024-09-11T00:24:43.376707+0000","last_fullsized":"2024-09-11T00:24:43.376707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:28.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376670+0000","last_change":"2024-09-11T00:24:42.385023+0000","last_active":"2024-09-11T00:24:43.376670+0000","last_peered":"2024-09-11T00:24:43.376670+0000","last_clean":"2024-09-11T00:24:43.376670+0000","last_became_active":"2024-09-11T00:24:42.384493+0000","last_became_peered":"2024-09-11T00:24:42.384493+0000","last_unstale":"2024-09-11T00:24:43.376670+0000","last_undegraded":"2024-09-11T00:24:43.376670+0000","last_fullsized":"2024-09-11T00:24:43.376670+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:31.285979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.402514+0000","last_change":"2024-09-11T00:24:41.376261+0000","last_active":"2024-09-11T00:24:43.402514+0000","last_peered":"2024-09-11T00:24:43.402514+0000","last_clean":"2024-09-11T00:24:43.402514+0000","last_became_active":"2024-09-11T00:24:41.375407+0000","last_became_peered":"2024-09-11T00:24:41.375407+0000","last_unstale":"2024-09-11T00:24:43.402514+0000","last_undegraded":"2024-09-11T00:24:43.402514+0000","last_fullsized":"2024-09-11T00:24:43.402514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:20.999873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.633099+0000","last_change":"2024-09-11T00:24:42.383193+0000","last_active":"2024-09-11T00:24:43.633099+0000","last_peered":"2024-09-11T00:24:43.633099+0000","last_clean":"2024-09-11T00:24:43.633099+0000","last_became_active":"2024-09-11T00:24:42.382423+0000","last_became_peered":"2024-09-11T00:24:42.382423+0000","last_unstale":"2024-09-11T00:24:43.633099+0000","last_undegraded":"2024-09-11T00:24:43.633099+0000","last_fullsized":"2024-09-11T00:24:43.633099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:03.999826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376070+0000","last_change":"2024-09-11T00:24:41.378757+0000","last_active":"2024-09-11T00:24:43.376070+0000","last_peered":"2024-09-11T00:24:43.376070+0000","last_clean":"2024-09-11T00:24:43.376070+0000","last_became_active":"2024-09-11T00:24:41.376929+0000","last_became_peered":"2024-09-11T00:24:41.376929+0000","last_unstale":"2024-09-11T00:24:43.376070+0000","last_undegraded":"2024-09-11T00:24:43.376070+0000","last_fullsized":"2024-09-11T00:24:43.376070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:42.207923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.406380+0000","last_change":"2024-09-11T00:24:42.382624+0000","last_active":"2024-09-11T00:24:43.406380+0000","last_peered":"2024-09-11T00:24:43.406380+0000","last_clean":"2024-09-11T00:24:43.406380+0000","last_became_active":"2024-09-11T00:24:42.382277+0000","last_became_peered":"2024-09-11T00:24:42.382277+0000","last_unstale":"2024-09-11T00:24:43.406380+0000","last_undegraded":"2024-09-11T00:24:43.406380+0000","last_fullsized":"2024-09-11T00:24:43.406380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:25.115101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631734+0000","last_change":"2024-09-11T00:24:41.383340+0000","last_active":"2024-09-11T00:24:43.631734+0000","last_peered":"2024-09-11T00:24:43.631734+0000","last_clean":"2024-09-11T00:24:43.631734+0000","last_became_active":"2024-09-11T00:24:41.383103+0000","last_became_peered":"2024-09-11T00:24:41.383103+0000","last_unstale":"2024-09-11T00:24:43.631734+0000","last_undegraded":"2024-09-11T00:24:43.631734+0000","last_fullsized":"2024-09-11T00:24:43.631734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:24.541403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376469+0000","last_change":"2024-09-11T00:24:42.391944+0000","last_active":"2024-09-11T00:24:43.376469+0000","last_peered":"2024-09-11T00:24:43.376469+0000","last_clean":"2024-09-11T00:24:43.376469+0000","last_became_active":"2024-09-11T00:24:42.391669+0000","last_became_peered":"2024-09-11T00:24:42.391669+0000","last_unstale":"2024-09-11T00:24:43.376469+0000","last_undegraded":"2024-09-11T00:24:43.376469+0000","last_fullsized":"2024-09-11T00:24:43.376469+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:15.319218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632561+0000","last_change":"2024-09-11T00:24:41.364406+0000","last_active":"2024-09-11T00:24:43.632561+0000","last_peered":"2024-09-11T00:24:43.632561+0000","last_clean":"2024-09-11T00:24:43.632561+0000","last_became_active":"2024-09-11T00:24:41.362829+0000","last_became_peered":"2024-09-11T00:24:41.362829+0000","last_unstale":"2024-09-11T00:24:43.632561+0000","last_undegraded":"2024-09-11T00:24:43.632561+0000","last_fullsized":"2024-09-11T00:24:43.632561+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:20.203720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632635+0000","last_change":"2024-09-11T00:24:42.378341+0000","last_active":"2024-09-11T00:24:43.632635+0000","last_peered":"2024-09-11T00:24:43.632635+0000","last_clean":"2024-09-11T00:24:43.632635+0000","last_became_active":"2024-09-11T00:24:42.378039+0000","last_became_peered":"2024-09-11T00:24:42.378039+0000","last_unstale":"2024-09-11T00:24:43.632635+0000","last_undegraded":"2024-09-11T00:24:43.632635+0000","last_fullsized":"2024-09-11T00:24:43.632635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:13.605779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632081+0000","last_change":"2024-09-11T00:24:41.367444+0000","last_active":"2024-09-11T00:24:43.632081+0000","last_peered":"2024-09-11T00:24:43.632081+0000","last_clean":"2024-09-11T00:24:43.632081+0000","last_became_active":"2024-09-11T00:24:41.367132+0000","last_became_peered":"2024-09-11T00:24:41.367132+0000","last_unstale":"2024-09-11T00:24:43.632081+0000","last_undegraded":"2024-09-11T00:24:43.632081+0000","last_fullsized":"2024-09-11T00:24:43.632081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:24.190396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631786+0000","last_change":"2024-09-11T00:24:42.382301+0000","last_active":"2024-09-11T00:24:43.631786+0000","last_peered":"2024-09-11T00:24:43.631786+0000","last_clean":"2024-09-11T00:24:43.631786+0000","last_became_active":"2024-09-11T00:24:42.381997+0000","last_became_peered":"2024-09-11T00:24:42.381997+0000","last_unstale":"2024-09-11T00:24:43.631786+0000","last_undegraded":"2024-09-11T00:24:43.631786+0000","last_fullsized":"2024-09-11T00:24:43.631786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:15.489748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375537+0000","last_change":"2024-09-11T00:24:41.379745+0000","last_active":"2024-09-11T00:24:43.375537+0000","last_peered":"2024-09-11T00:24:43.375537+0000","last_clean":"2024-09-11T00:24:43.375537+0000","last_became_active":"2024-09-11T00:24:41.379450+0000","last_became_peered":"2024-09-11T00:24:41.379450+0000","last_unstale":"2024-09-11T00:24:43.375537+0000","last_undegraded":"2024-09-11T00:24:43.375537+0000","last_fullsized":"2024-09-11T00:24:43.375537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:29:14.030504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.405495+0000","last_change":"2024-09-11T00:24:42.372682+0000","last_active":"2024-09-11T00:24:43.405495+0000","last_peered":"2024-09-11T00:24:43.405495+0000","last_clean":"2024-09-11T00:24:43.405495+0000","last_became_active":"2024-09-11T00:24:42.372378+0000","last_became_peered":"2024-09-11T00:24:42.372378+0000","last_unstale":"2024-09-11T00:24:43.405495+0000","last_undegraded":"2024-09-11T00:24:43.405495+0000","last_fullsized":"2024-09-11T00:24:43.405495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:54.931762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631696+0000","last_change":"2024-09-11T00:24:41.369910+0000","last_active":"2024-09-11T00:24:43.631696+0000","last_peered":"2024-09-11T00:24:43.631696+0000","last_clean":"2024-09-11T00:24:43.631696+0000","last_became_active":"2024-09-11T00:24:41.366429+0000","last_became_peered":"2024-09-11T00:24:41.366429+0000","last_unstale":"2024-09-11T00:24:43.631696+0000","last_undegraded":"2024-09-11T00:24:43.631696+0000","last_fullsized":"2024-09-11T00:24:43.631696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:42.748491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632650+0000","last_change":"2024-09-11T00:24:42.385691+0000","last_active":"2024-09-11T00:24:43.632650+0000","last_peered":"2024-09-11T00:24:43.632650+0000","last_clean":"2024-09-11T00:24:43.632650+0000","last_became_active":"2024-09-11T00:24:42.384627+0000","last_became_peered":"2024-09-11T00:24:42.384627+0000","last_unstale":"2024-09-11T00:24:43.632650+0000","last_undegraded":"2024-09-11T00:24:43.632650+0000","last_fullsized":"2024-09-11T00:24:43.632650+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:41.177207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376290+0000","last_change":"2024-09-11T00:24:41.375561+0000","last_active":"2024-09-11T00:24:43.376290+0000","last_peered":"2024-09-11T00:24:43.376290+0000","last_clean":"2024-09-11T00:24:43.376290+0000","last_became_active":"2024-09-11T00:24:41.375291+0000","last_became_peered":"2024-09-11T00:24:41.375291+0000","last_unstale":"2024-09-11T00:24:43.376290+0000","last_undegraded":"2024-09-11T00:24:43.376290+0000","last_fullsized":"2024-09-11T00:24:43.376290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:02.994438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376350+0000","last_change":"2024-09-11T00:24:42.391234+0000","last_active":"2024-09-11T00:24:43.376350+0000","last_peered":"2024-09-11T00:24:43.376350+0000","last_clean":"2024-09-11T00:24:43.376350+0000","last_became_active":"2024-09-11T00:24:42.390982+0000","last_became_peered":"2024-09-11T00:24:42.390982+0000","last_unstale":"2024-09-11T00:24:43.376350+0000","last_undegraded":"2024-09-11T00:24:43.376350+0000","last_fullsized":"2024-09-11T00:24:43.376350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:12.209561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.402567+0000","last_change":"2024-09-11T00:24:41.376918+0000","last_active":"2024-09-11T00:24:43.402567+0000","last_peered":"2024-09-11T00:24:43.402567+0000","last_clean":"2024-09-11T00:24:43.402567+0000","last_became_active":"2024-09-11T00:24:41.376617+0000","last_became_peered":"2024-09-11T00:24:41.376617+0000","last_unstale":"2024-09-11T00:24:43.402567+0000","last_undegraded":"2024-09-11T00:24:43.402567+0000","last_fullsized":"2024-09-11T00:24:43.402567+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:54.763135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376106+0000","last_change":"2024-09-11T00:24:42.390013+0000","last_active":"2024-09-11T00:24:43.376106+0000","last_peered":"2024-09-11T00:24:43.376106+0000","last_clean":"2024-09-11T00:24:43.376106+0000","last_became_active":"2024-09-11T00:24:42.389749+0000","last_became_peered":"2024-09-11T00:24:42.389749+0000","last_unstale":"2024-09-11T00:24:43.376106+0000","last_undegraded":"2024-09-11T00:24:43.376106+0000","last_fullsized":"2024-09-11T00:24:43.376106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:42.008650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.633081+0000","last_change":"2024-09-11T00:24:41.374576+0000","last_active":"2024-09-11T00:24:43.633081+0000","last_peered":"2024-09-11T00:24:43.633081+0000","last_clean":"2024-09-11T00:24:43.633081+0000","last_became_active":"2024-09-11T00:24:41.373816+0000","last_became_peered":"2024-09-11T00:24:41.373816+0000","last_unstale":"2024-09-11T00:24:43.633081+0000","last_undegraded":"2024-09-11T00:24:43.633081+0000","last_fullsized":"2024-09-11T00:24:43.633081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:13.967482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632913+0000","last_change":"2024-09-11T00:24:42.390789+0000","last_active":"2024-09-11T00:24:43.632913+0000","last_peered":"2024-09-11T00:24:43.632913+0000","last_clean":"2024-09-11T00:24:43.632913+0000","last_became_active":"2024-09-11T00:24:42.390504+0000","last_became_peered":"2024-09-11T00:24:42.390504+0000","last_unstale":"2024-09-11T00:24:43.632913+0000","last_undegraded":"2024-09-11T00:24:43.632913+0000","last_fullsized":"2024-09-11T00:24:43.632913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:22.005112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376048+0000","last_change":"2024-09-11T00:24:41.378401+0000","last_active":"2024-09-11T00:24:43.376048+0000","last_peered":"2024-09-11T00:24:43.376048+0000","last_clean":"2024-09-11T00:24:43.376048+0000","last_became_active":"2024-09-11T00:24:41.377514+0000","last_became_peered":"2024-09-11T00:24:41.377514+0000","last_unstale":"2024-09-11T00:24:43.376048+0000","last_undegraded":"2024-09-11T00:24:43.376048+0000","last_fullsized":"2024-09-11T00:24:43.376048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:30.280591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.405728+0000","last_change":"2024-09-11T00:24:42.382460+0000","last_active":"2024-09-11T00:24:43.405728+0000","last_peered":"2024-09-11T00:24:43.405728+0000","last_clean":"2024-09-11T00:24:43.405728+0000","last_became_active":"2024-09-11T00:24:42.380500+0000","last_became_peered":"2024-09-11T00:24:42.380500+0000","last_unstale":"2024-09-11T00:24:43.405728+0000","last_undegraded":"2024-09-11T00:24:43.405728+0000","last_fullsized":"2024-09-11T00:24:43.405728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:48.682956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632670+0000","last_change":"2024-09-11T00:24:41.369376+0000","last_active":"2024-09-11T00:24:43.632670+0000","last_peered":"2024-09-11T00:24:43.632670+0000","last_clean":"2024-09-11T00:24:43.632670+0000","last_became_active":"2024-09-11T00:24:41.369126+0000","last_became_peered":"2024-09-11T00:24:41.369126+0000","last_unstale":"2024-09-11T00:24:43.632670+0000","last_undegraded":"2024-09-11T00:24:43.632670+0000","last_fullsized":"2024-09-11T00:24:43.632670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:19:40.405372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376003+0000","last_change":"2024-09-11T00:24:42.380255+0000","last_active":"2024-09-11T00:24:43.376003+0000","last_peered":"2024-09-11T00:24:43.376003+0000","last_clean":"2024-09-11T00:24:43.376003+0000","last_became_active":"2024-09-11T00:24:42.380009+0000","last_became_peered":"2024-09-11T00:24:42.380009+0000","last_unstale":"2024-09-11T00:24:43.376003+0000","last_undegraded":"2024-09-11T00:24:43.376003+0000","last_fullsized":"2024-09-11T00:24:43.376003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:10.904009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.405716+0000","last_change":"2024-09-11T00:24:41.378892+0000","last_active":"2024-09-11T00:24:43.405716+0000","last_peered":"2024-09-11T00:24:43.405716+0000","last_clean":"2024-09-11T00:24:43.405716+0000","last_became_active":"2024-09-11T00:24:41.378470+0000","last_became_peered":"2024-09-11T00:24:41.378470+0000","last_unstale":"2024-09-11T00:24:43.405716+0000","last_undegraded":"2024-09-11T00:24:43.405716+0000","last_fullsized":"2024-09-11T00:24:43.405716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:04.897409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375939+0000","last_change":"2024-09-11T00:24:42.393736+0000","last_active":"2024-09-11T00:24:43.375939+0000","last_peered":"2024-09-11T00:24:43.375939+0000","last_clean":"2024-09-11T00:24:43.375939+0000","last_became_active":"2024-09-11T00:24:42.391657+0000","last_became_peered":"2024-09-11T00:24:42.391657+0000","last_unstale":"2024-09-11T00:24:43.375939+0000","last_undegraded":"2024-09-11T00:24:43.375939+0000","last_fullsized":"2024-09-11T00:24:43.375939+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:43.643553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375444+0000","last_change":"2024-09-11T00:24:41.372351+0000","last_active":"2024-09-11T00:24:43.375444+0000","last_peered":"2024-09-11T00:24:43.375444+0000","last_clean":"2024-09-11T00:24:43.375444+0000","last_became_active":"2024-09-11T00:24:41.372125+0000","last_became_peered":"2024-09-11T00:24:41.372125+0000","last_unstale":"2024-09-11T00:24:43.375444+0000","last_undegraded":"2024-09-11T00:24:43.375444+0000","last_fullsized":"2024-09-11T00:24:43.375444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:14.484360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376218+0000","last_change":"2024-09-11T00:24:42.391136+0000","last_active":"2024-09-11T00:24:43.376218+0000","last_peered":"2024-09-11T00:24:43.376218+0000","last_clean":"2024-09-11T00:24:43.376218+0000","last_became_active":"2024-09-11T00:24:42.389347+0000","last_became_peered":"2024-09-11T00:24:42.389347+0000","last_unstale":"2024-09-11T00:24:43.376218+0000","last_undegraded":"2024-09-11T00:24:43.376218+0000","last_fullsized":"2024-09-11T00:24:43.376218+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:15.489748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375506+0000","last_change":"2024-09-11T00:24:41.364238+0000","last_active":"2024-09-11T00:24:43.375506+0000","last_peered":"2024-09-11T00:24:43.375506+0000","last_clean":"2024-09-11T00:24:43.375506+0000","last_became_active":"2024-09-11T00:24:41.362593+0000","last_became_peered":"2024-09-11T00:24:41.362593+0000","last_unstale":"2024-09-11T00:24:43.375506+0000","last_undegraded":"2024-09-11T00:24:43.375506+0000","last_fullsized":"2024-09-11T00:24:43.375506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:03.828494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.633431+0000","last_change":"2024-09-11T00:24:42.387825+0000","last_active":"2024-09-11T00:24:43.633431+0000","last_peered":"2024-09-11T00:24:43.633431+0000","last_clean":"2024-09-11T00:24:43.633431+0000","last_became_active":"2024-09-11T00:24:42.383098+0000","last_became_peered":"2024-09-11T00:24:42.383098+0000","last_unstale":"2024-09-11T00:24:43.633431+0000","last_undegraded":"2024-09-11T00:24:43.633431+0000","last_fullsized":"2024-09-11T00:24:43.633431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:54.931762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.406650+0000","last_change":"2024-09-11T00:24:41.381321+0000","last_active":"2024-09-11T00:24:43.406650+0000","last_peered":"2024-09-11T00:24:43.406650+0000","last_clean":"2024-09-11T00:24:43.406650+0000","last_became_active":"2024-09-11T00:24:41.381052+0000","last_became_peered":"2024-09-11T00:24:41.381052+0000","last_unstale":"2024-09-11T00:24:43.406650+0000","last_undegraded":"2024-09-11T00:24:43.406650+0000","last_fullsized":"2024-09-11T00:24:43.406650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:52.909342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.633419+0000","last_change":"2024-09-11T00:24:42.384072+0000","last_active":"2024-09-11T00:24:43.633419+0000","last_peered":"2024-09-11T00:24:43.633419+0000","last_clean":"2024-09-11T00:24:43.633419+0000","last_became_active":"2024-09-11T00:24:42.382285+0000","last_became_peered":"2024-09-11T00:24:42.382285+0000","last_unstale":"2024-09-11T00:24:43.633419+0000","last_undegraded":"2024-09-11T00:24:43.633419+0000","last_fullsized":"2024-09-11T00:24:43.633419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:24.732359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.633019+0000","last_change":"2024-09-11T00:24:41.372282+0000","last_active":"2024-09-11T00:24:43.633019+0000","last_peered":"2024-09-11T00:24:43.633019+0000","last_clean":"2024-09-11T00:24:43.633019+0000","last_became_active":"2024-09-11T00:24:41.371783+0000","last_became_peered":"2024-09-11T00:24:41.371783+0000","last_unstale":"2024-09-11T00:24:43.633019+0000","last_undegraded":"2024-09-11T00:24:43.633019+0000","last_fullsized":"2024-09-11T00:24:43.633019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:39.384404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.405780+0000","last_change":"2024-09-11T00:24:42.384144+0000","last_active":"2024-09-11T00:24:43.405780+0000","last_peered":"2024-09-11T00:24:43.405780+0000","last_clean":"2024-09-11T00:24:43.405780+0000","last_became_active":"2024-09-11T00:24:42.383476+0000","last_became_peered":"2024-09-11T00:24:42.383476+0000","last_unstale":"2024-09-11T00:24:43.405780+0000","last_undegraded":"2024-09-11T00:24:43.405780+0000","last_fullsized":"2024-09-11T00:24:43.405780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:01.717183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.633092+0000","last_change":"2024-09-11T00:24:41.382162+0000","last_active":"2024-09-11T00:24:43.633092+0000","last_peered":"2024-09-11T00:24:43.633092+0000","last_clean":"2024-09-11T00:24:43.633092+0000","last_became_active":"2024-09-11T00:24:41.381878+0000","last_became_peered":"2024-09-11T00:24:41.381878+0000","last_unstale":"2024-09-11T00:24:43.633092+0000","last_undegraded":"2024-09-11T00:24:43.633092+0000","last_fullsized":"2024-09-11T00:24:43.633092+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:56.614698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631782+0000","last_change":"2024-09-11T00:24:42.391822+0000","last_active":"2024-09-11T00:24:43.631782+0000","last_peered":"2024-09-11T00:24:43.631782+0000","last_clean":"2024-09-11T00:24:43.631782+0000","last_became_active":"2024-09-11T00:24:42.391556+0000","last_became_peered":"2024-09-11T00:24:42.391556+0000","last_unstale":"2024-09-11T00:24:43.631782+0000","last_undegraded":"2024-09-11T00:24:43.631782+0000","last_fullsized":"2024-09-11T00:24:43.631782+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:20.467658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.633220+0000","last_change":"2024-09-11T00:24:41.376338+0000","last_active":"2024-09-11T00:24:43.633220+0000","last_peered":"2024-09-11T00:24:43.633220+0000","last_clean":"2024-09-11T00:24:43.633220+0000","last_became_active":"2024-09-11T00:24:41.376049+0000","last_became_peered":"2024-09-11T00:24:41.376049+0000","last_unstale":"2024-09-11T00:24:43.633220+0000","last_undegraded":"2024-09-11T00:24:43.633220+0000","last_fullsized":"2024-09-11T00:24:43.633220+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:35.522030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631671+0000","last_change":"2024-09-11T00:24:42.386314+0000","last_active":"2024-09-11T00:24:43.631671+0000","last_peered":"2024-09-11T00:24:43.631671+0000","last_clean":"2024-09-11T00:24:43.631671+0000","last_became_active":"2024-09-11T00:24:42.386029+0000","last_became_peered":"2024-09-11T00:24:42.386029+0000","last_unstale":"2024-09-11T00:24:43.631671+0000","last_undegraded":"2024-09-11T00:24:43.631671+0000","last_fullsized":"2024-09-11T00:24:43.631671+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:31.269595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.402116+0000","last_change":"2024-09-11T00:24:41.374850+0000","last_active":"2024-09-11T00:24:43.402116+0000","last_peered":"2024-09-11T00:24:43.402116+0000","last_clean":"2024-09-11T00:24:43.402116+0000","last_became_active":"2024-09-11T00:24:41.374581+0000","last_became_peered":"2024-09-11T00:24:41.374581+0000","last_unstale":"2024-09-11T00:24:43.402116+0000","last_undegraded":"2024-09-11T00:24:43.402116+0000","last_fullsized":"2024-09-11T00:24:43.402116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:04.636783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631873+0000","last_change":"2024-09-11T00:24:42.382410+0000","last_active":"2024-09-11T00:24:43.631873+0000","last_peered":"2024-09-11T00:24:43.631873+0000","last_clean":"2024-09-11T00:24:43.631873+0000","last_became_active":"2024-09-11T00:24:42.380206+0000","last_became_peered":"2024-09-11T00:24:42.380206+0000","last_unstale":"2024-09-11T00:24:43.631873+0000","last_undegraded":"2024-09-11T00:24:43.631873+0000","last_fullsized":"2024-09-11T00:24:43.631873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:08:40.946079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.377103+0000","last_change":"2024-09-11T00:24:41.378707+0000","last_active":"2024-09-11T00:24:43.377103+0000","last_peered":"2024-09-11T00:24:43.377103+0000","last_clean":"2024-09-11T00:24:43.377103+0000","last_became_active":"2024-09-11T00:24:41.378352+0000","last_became_peered":"2024-09-11T00:24:41.378352+0000","last_unstale":"2024-09-11T00:24:43.377103+0000","last_undegraded":"2024-09-11T00:24:43.377103+0000","last_fullsized":"2024-09-11T00:24:43.377103+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:04.897409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631964+0000","last_change":"2024-09-11T00:24:42.387359+0000","last_active":"2024-09-11T00:24:43.631964+0000","last_peered":"2024-09-11T00:24:43.631964+0000","last_clean":"2024-09-11T00:24:43.631964+0000","last_became_active":"2024-09-11T00:24:42.382891+0000","last_became_peered":"2024-09-11T00:24:42.382891+0000","last_unstale":"2024-09-11T00:24:43.631964+0000","last_undegraded":"2024-09-11T00:24:43.631964+0000","last_fullsized":"2024-09-11T00:24:43.631964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:29.180009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631735+0000","last_change":"2024-09-11T00:24:41.375301+0000","last_active":"2024-09-11T00:24:43.631735+0000","last_peered":"2024-09-11T00:24:43.631735+0000","last_clean":"2024-09-11T00:24:43.631735+0000","last_became_active":"2024-09-11T00:24:41.375027+0000","last_became_peered":"2024-09-11T00:24:41.375027+0000","last_unstale":"2024-09-11T00:24:43.631735+0000","last_undegraded":"2024-09-11T00:24:43.631735+0000","last_fullsized":"2024-09-11T00:24:43.631735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:40.865470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375938+0000","last_change":"2024-09-11T00:24:42.396111+0000","last_active":"2024-09-11T00:24:43.375938+0000","last_peered":"2024-09-11T00:24:43.375938+0000","last_clean":"2024-09-11T00:24:43.375938+0000","last_became_active":"2024-09-11T00:24:42.395653+0000","last_became_peered":"2024-09-11T00:24:42.395653+0000","last_unstale":"2024-09-11T00:24:43.375938+0000","last_undegraded":"2024-09-11T00:24:43.375938+0000","last_fullsized":"2024-09-11T00:24:43.375938+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:46.896567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632059+0000","last_change":"2024-09-11T00:24:41.369826+0000","last_active":"2024-09-11T00:24:43.632059+0000","last_peered":"2024-09-11T00:24:43.632059+0000","last_clean":"2024-09-11T00:24:43.632059+0000","last_became_active":"2024-09-11T00:24:41.369533+0000","last_became_peered":"2024-09-11T00:24:41.369533+0000","last_unstale":"2024-09-11T00:24:43.632059+0000","last_undegraded":"2024-09-11T00:24:43.632059+0000","last_fullsized":"2024-09-11T00:24:43.632059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:34.622969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631985+0000","last_change":"2024-09-11T00:24:42.395421+0000","last_active":"2024-09-11T00:24:43.631985+0000","last_peered":"2024-09-11T00:24:43.631985+0000","last_clean":"2024-09-11T00:24:43.631985+0000","last_became_active":"2024-09-11T00:24:42.393767+0000","last_became_peered":"2024-09-11T00:24:42.393767+0000","last_unstale":"2024-09-11T00:24:43.631985+0000","last_undegraded":"2024-09-11T00:24:43.631985+0000","last_fullsized":"2024-09-11T00:24:43.631985+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:25.145153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.406737+0000","last_change":"2024-09-11T00:24:41.373957+0000","last_active":"2024-09-11T00:24:43.406737+0000","last_peered":"2024-09-11T00:24:43.406737+0000","last_clean":"2024-09-11T00:24:43.406737+0000","last_became_active":"2024-09-11T00:24:41.373644+0000","last_became_peered":"2024-09-11T00:24:41.373644+0000","last_unstale":"2024-09-11T00:24:43.406737+0000","last_undegraded":"2024-09-11T00:24:43.406737+0000","last_fullsized":"2024-09-11T00:24:43.406737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:29.892657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.633489+0000","last_change":"2024-09-11T00:24:42.380874+0000","last_active":"2024-09-11T00:24:43.633489+0000","last_peered":"2024-09-11T00:24:43.633489+0000","last_clean":"2024-09-11T00:24:43.633489+0000","last_became_active":"2024-09-11T00:24:42.380613+0000","last_became_peered":"2024-09-11T00:24:42.380613+0000","last_unstale":"2024-09-11T00:24:43.633489+0000","last_undegraded":"2024-09-11T00:24:43.633489+0000","last_fullsized":"2024-09-11T00:24:43.633489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:42.008650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.402533+0000","last_change":"2024-09-11T00:24:41.374040+0000","last_active":"2024-09-11T00:24:43.402533+0000","last_peered":"2024-09-11T00:24:43.402533+0000","last_clean":"2024-09-11T00:24:43.402533+0000","last_became_active":"2024-09-11T00:24:41.373757+0000","last_became_peered":"2024-09-11T00:24:41.373757+0000","last_unstale":"2024-09-11T00:24:43.402533+0000","last_undegraded":"2024-09-11T00:24:43.402533+0000","last_fullsized":"2024-09-11T00:24:43.402533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:29.814276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.402440+0000","last_change":"2024-09-11T00:24:42.381262+0000","last_active":"2024-09-11T00:24:43.402440+0000","last_peered":"2024-09-11T00:24:43.402440+0000","last_clean":"2024-09-11T00:24:43.402440+0000","last_became_active":"2024-09-11T00:24:42.380984+0000","last_became_peered":"2024-09-11T00:24:42.380984+0000","last_unstale":"2024-09-11T00:24:43.402440+0000","last_undegraded":"2024-09-11T00:24:43.402440+0000","last_fullsized":"2024-09-11T00:24:43.402440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:06.007643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.406060+0000","last_change":"2024-09-11T00:24:41.381021+0000","last_active":"2024-09-11T00:24:43.406060+0000","last_peered":"2024-09-11T00:24:43.406060+0000","last_clean":"2024-09-11T00:24:43.406060+0000","last_became_active":"2024-09-11T00:24:41.380749+0000","last_became_peered":"2024-09-11T00:24:41.380749+0000","last_unstale":"2024-09-11T00:24:43.406060+0000","last_undegraded":"2024-09-11T00:24:43.406060+0000","last_fullsized":"2024-09-11T00:24:43.406060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:21:49.397863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.377103+0000","last_change":"2024-09-11T00:24:42.386921+0000","last_active":"2024-09-11T00:24:43.377103+0000","last_peered":"2024-09-11T00:24:43.377103+0000","last_clean":"2024-09-11T00:24:43.377103+0000","last_became_active":"2024-09-11T00:24:42.386618+0000","last_became_peered":"2024-09-11T00:24:42.386618+0000","last_unstale":"2024-09-11T00:24:43.377103+0000","last_undegraded":"2024-09-11T00:24:43.377103+0000","last_fullsized":"2024-09-11T00:24:43.377103+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:43.213311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.402221+0000","last_change":"2024-09-11T00:24:41.371031+0000","last_active":"2024-09-11T00:24:43.402221+0000","last_peered":"2024-09-11T00:24:43.402221+0000","last_clean":"2024-09-11T00:24:43.402221+0000","last_became_active":"2024-09-11T00:24:41.370654+0000","last_became_peered":"2024-09-11T00:24:41.370654+0000","last_unstale":"2024-09-11T00:24:43.402221+0000","last_undegraded":"2024-09-11T00:24:43.402221+0000","last_fullsized":"2024-09-11T00:24:43.402221+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:01.892760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.402175+0000","last_change":"2024-09-11T00:24:42.381473+0000","last_active":"2024-09-11T00:24:43.402175+0000","last_peered":"2024-09-11T00:24:43.402175+0000","last_clean":"2024-09-11T00:24:43.402175+0000","last_became_active":"2024-09-11T00:24:42.381062+0000","last_became_peered":"2024-09-11T00:24:42.381062+0000","last_unstale":"2024-09-11T00:24:43.402175+0000","last_undegraded":"2024-09-11T00:24:43.402175+0000","last_fullsized":"2024-09-11T00:24:43.402175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:19.032418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.405825+0000","last_change":"2024-09-11T00:24:41.373838+0000","last_active":"2024-09-11T00:24:43.405825+0000","last_peered":"2024-09-11T00:24:43.405825+0000","last_clean":"2024-09-11T00:24:43.405825+0000","last_became_active":"2024-09-11T00:24:41.373526+0000","last_became_peered":"2024-09-11T00:24:41.373526+0000","last_unstale":"2024-09-11T00:24:43.405825+0000","last_undegraded":"2024-09-11T00:24:43.405825+0000","last_fullsized":"2024-09-11T00:24:43.405825+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:01.861466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375406+0000","last_change":"2024-09-11T00:24:42.381402+0000","last_active":"2024-09-11T00:24:43.375406+0000","last_peered":"2024-09-11T00:24:43.375406+0000","last_clean":"2024-09-11T00:24:43.375406+0000","last_became_active":"2024-09-11T00:24:42.379830+0000","last_became_peered":"2024-09-11T00:24:42.379830+0000","last_unstale":"2024-09-11T00:24:43.375406+0000","last_undegraded":"2024-09-11T00:24:43.375406+0000","last_fullsized":"2024-09-11T00:24:43.375406+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:13.605779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631851+0000","last_change":"2024-09-11T00:24:41.372846+0000","last_active":"2024-09-11T00:24:43.631851+0000","last_peered":"2024-09-11T00:24:43.631851+0000","last_clean":"2024-09-11T00:24:43.631851+0000","last_became_active":"2024-09-11T00:24:41.371346+0000","last_became_peered":"2024-09-11T00:24:41.371346+0000","last_unstale":"2024-09-11T00:24:43.631851+0000","last_undegraded":"2024-09-11T00:24:43.631851+0000","last_fullsized":"2024-09-11T00:24:43.631851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:01.286926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631722+0000","last_change":"2024-09-11T00:24:42.388130+0000","last_active":"2024-09-11T00:24:43.631722+0000","last_peered":"2024-09-11T00:24:43.631722+0000","last_clean":"2024-09-11T00:24:43.631722+0000","last_became_active":"2024-09-11T00:24:42.387801+0000","last_became_peered":"2024-09-11T00:24:42.387801+0000","last_unstale":"2024-09-11T00:24:43.631722+0000","last_undegraded":"2024-09-11T00:24:43.631722+0000","last_fullsized":"2024-09-11T00:24:43.631722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:04.833882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375401+0000","last_change":"2024-09-11T00:24:41.373748+0000","last_active":"2024-09-11T00:24:43.375401+0000","last_peered":"2024-09-11T00:24:43.375401+0000","last_clean":"2024-09-11T00:24:43.375401+0000","last_became_active":"2024-09-11T00:24:41.373149+0000","last_became_peered":"2024-09-11T00:24:41.373149+0000","last_unstale":"2024-09-11T00:24:43.375401+0000","last_undegraded":"2024-09-11T00:24:43.375401+0000","last_fullsized":"2024-09-11T00:24:43.375401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:55.207874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376366+0000","last_change":"2024-09-11T00:24:42.398624+0000","last_active":"2024-09-11T00:24:43.376366+0000","last_peered":"2024-09-11T00:24:43.376366+0000","last_clean":"2024-09-11T00:24:43.376366+0000","last_became_active":"2024-09-11T00:24:42.398169+0000","last_became_peered":"2024-09-11T00:24:42.398169+0000","last_unstale":"2024-09-11T00:24:43.376366+0000","last_undegraded":"2024-09-11T00:24:43.376366+0000","last_fullsized":"2024-09-11T00:24:43.376366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:09.671286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376390+0000","last_change":"2024-09-11T00:24:41.376801+0000","last_active":"2024-09-11T00:24:43.376390+0000","last_peered":"2024-09-11T00:24:43.376390+0000","last_clean":"2024-09-11T00:24:43.376390+0000","last_became_active":"2024-09-11T00:24:41.376493+0000","last_became_peered":"2024-09-11T00:24:41.376493+0000","last_unstale":"2024-09-11T00:24:43.376390+0000","last_undegraded":"2024-09-11T00:24:43.376390+0000","last_fullsized":"2024-09-11T00:24:43.376390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:08:39.940691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":136,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376393+0000","last_change":"2024-09-11T00:23:38.923873+0000","last_active":"2024-09-11T00:24:43.376393+0000","last_peered":"2024-09-11T00:24:43.376393+0000","last_clean":"2024-09-11T00:24:43.376393+0000","last_became_active":"2024-09-11T00:23:38.920629+0000","last_became_peered":"2024-09-11T00:23:38.920629+0000","last_unstale":"2024-09-11T00:24:43.376393+0000","last_undegraded":"2024-09-11T00:24:43.376393+0000","last_fullsized":"2024-09-11T00:24:43.376393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_clean_scrub_stamp":"2024-09-11T00:23:37.844553+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.533941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":987136,"data_stored":742424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":397312,"data_stored":152582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":397312,"data_stored":152638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":397312,"data_stored":152070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":405504,"data_stored":153600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":393216,"data_stored":152036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":405504,"data_stored":153600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":983040,"data_stored":742334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:24:51.358 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:24:51.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.529+0000 7fb9e0600640 1 -- 172.21.15.40:0/2100574704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c0003c30 msgr2=0x7fb9c0004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:51.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.529+0000 7fb9e0600640 1 --2- 172.21.15.40:0/2100574704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c0003c30 0x7fb9c0004030 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc001830 tx=0x7fb9c0005830 comp rx=0 tx=0).stop 2024-09-11T00:24:51.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.529+0000 7fb9e0600640 1 -- 172.21.15.40:0/2100574704 shutdown_connections 2024-09-11T00:24:51.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.529+0000 7fb9e0600640 1 --2- 172.21.15.40:0/2100574704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c0003c30 0x7fb9c0004030 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:51.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.529+0000 7fb9e0600640 1 -- 172.21.15.40:0/2100574704 >> 172.21.15.40:0/2100574704 conn(0x7fb9d80cfbb0 msgr2=0x7fb9d80cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:51.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.529+0000 7fb9e0600640 1 -- 172.21.15.40:0/2100574704 shutdown_connections 2024-09-11T00:24:51.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.529+0000 7fb9e0600640 1 -- 172.21.15.40:0/2100574704 wait complete. 2024-09-11T00:24:51.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.531+0000 7fb9e0600640 1 Processor -- start 2024-09-11T00:24:51.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.531+0000 7fb9e0600640 1 -- start start 2024-09-11T00:24:51.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.532+0000 7fb9e0600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9c0003c30 0x7fb9d81f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:51.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.532+0000 7fb9e0600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9d80c6860 0x7fb9d806eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:51.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.532+0000 7fb9e0600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9d80c4080 0x7fb9d8157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:51.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.532+0000 7fb9e0600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d815f940 con 0x7fb9d80c6860 2024-09-11T00:24:51.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.532+0000 7fb9e0600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d815f7c0 con 0x7fb9d80c4080 2024-09-11T00:24:51.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.532+0000 7fb9e0600640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb9d80cba70 con 0x7fb9c0003c30 2024-09-11T00:24:51.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.532+0000 7fb9dd200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9d80c6860 0x7fb9d806eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:51.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.532+0000 7fb9dd200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9d80c6860 0x7fb9d806eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47298/0 (socket says 172.21.15.40:47298) 2024-09-11T00:24:51.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.532+0000 7fb9dd200640 1 -- 172.21.15.40:0/1024402573 learned_addr learned my addr 172.21.15.40:0/1024402573 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:51.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.532+0000 7fb9de600640 1 --2- 172.21.15.40:0/1024402573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9d80c4080 0x7fb9d8157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:51.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.533+0000 7fb9ddc00640 1 --2- 172.21.15.40:0/1024402573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9c0003c30 0x7fb9d81f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:51.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.533+0000 7fb9dd200640 1 -- 172.21.15.40:0/1024402573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9c0003c30 msgr2=0x7fb9d81f2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:51.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.533+0000 7fb9dd200640 1 --2- 172.21.15.40:0/1024402573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9c0003c30 0x7fb9d81f2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:51.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.533+0000 7fb9dd200640 1 -- 172.21.15.40:0/1024402573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9d80c4080 msgr2=0x7fb9d8157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:51.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.533+0000 7fb9dd200640 1 --2- 172.21.15.40:0/1024402573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9d80c4080 0x7fb9d8157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:51.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.533+0000 7fb9dd200640 1 -- 172.21.15.40:0/1024402573 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d80c3e40 con 0x7fb9d80c6860 2024-09-11T00:24:51.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.533+0000 7fb9dd200640 1 --2- 172.21.15.40:0/1024402573 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9d80c6860 0x7fb9d806eaf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4001050 tx=0x7fb9c400ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:51.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.533+0000 7fb9d5600640 1 -- 172.21.15.40:0/1024402573 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4015070 con 0x7fb9d80c6860 2024-09-11T00:24:51.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.533+0000 7fb9d5600640 1 -- 172.21.15.40:0/1024402573 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9c40109a0 con 0x7fb9d80c6860 2024-09-11T00:24:51.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.533+0000 7fb9d5600640 1 -- 172.21.15.40:0/1024402573 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4010df0 con 0x7fb9d80c6860 2024-09-11T00:24:51.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.533+0000 7fb9e0600640 1 -- 172.21.15.40:0/1024402573 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d81f3460 con 0x7fb9d80c6860 2024-09-11T00:24:51.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.534+0000 7fb9e0600640 1 -- 172.21.15.40:0/1024402573 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d81f2720 con 0x7fb9d80c6860 2024-09-11T00:24:51.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.534+0000 7fb9e0600640 1 -- 172.21.15.40:0/1024402573 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9d815b710 con 0x7fb9d80c6860 2024-09-11T00:24:51.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.536+0000 7fb9d5600640 1 -- 172.21.15.40:0/1024402573 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb9c4011460 con 0x7fb9d80c6860 2024-09-11T00:24:51.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.536+0000 7fb9d5600640 1 --2- 172.21.15.40:0/1024402573 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb9b8077f70 0x7fb9b807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:51.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.536+0000 7fb9d5600640 1 -- 172.21.15.40:0/1024402573 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fb9c409a460 con 0x7fb9d80c6860 2024-09-11T00:24:51.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.537+0000 7fb9ddc00640 1 --2- 172.21.15.40:0/1024402573 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb9b8077f70 0x7fb9b807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:51.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.537+0000 7fb9ddc00640 1 --2- 172.21.15.40:0/1024402573 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb9b8077f70 0x7fb9b807a430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc032000 tx=0x7fb9cc001360 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:51.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.541+0000 7fb9d5600640 1 -- 172.21.15.40:0/1024402573 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb9c4062ec0 con 0x7fb9d80c6860 2024-09-11T00:24:51.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.731+0000 7fb9e0600640 1 -- 172.21.15.40:0/1024402573 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb9d80c3880 con 0x7fb9b8077f70 2024-09-11T00:24:51.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.737+0000 7fb9d5600640 1 -- 172.21.15.40:0/1024402573 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251940 (secure 0 0 0) 0x7fb9d80c3880 con 0x7fb9b8077f70 2024-09-11T00:24:51.741 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:51.742 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T00:24:51.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.740+0000 7fb9e0600640 1 -- 172.21.15.40:0/1024402573 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb9b8077f70 msgr2=0x7fb9b807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:51.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.740+0000 7fb9e0600640 1 --2- 172.21.15.40:0/1024402573 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb9b8077f70 0x7fb9b807a430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc032000 tx=0x7fb9cc001360 comp rx=0 tx=0).stop 2024-09-11T00:24:51.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.740+0000 7fb9e0600640 1 -- 172.21.15.40:0/1024402573 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9d80c6860 msgr2=0x7fb9d806eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:51.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.740+0000 7fb9e0600640 1 --2- 172.21.15.40:0/1024402573 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9d80c6860 0x7fb9d806eaf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4001050 tx=0x7fb9c400ea20 comp rx=0 tx=0).stop 2024-09-11T00:24:51.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.740+0000 7fb9e0600640 1 -- 172.21.15.40:0/1024402573 shutdown_connections 2024-09-11T00:24:51.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.740+0000 7fb9e0600640 1 --2- 172.21.15.40:0/1024402573 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fb9b8077f70 0x7fb9b807a430 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:51.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.740+0000 7fb9e0600640 1 --2- 172.21.15.40:0/1024402573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9d80c4080 0x7fb9d8157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:51.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.740+0000 7fb9e0600640 1 --2- 172.21.15.40:0/1024402573 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9d80c6860 0x7fb9d806eaf0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:51.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.740+0000 7fb9e0600640 1 --2- 172.21.15.40:0/1024402573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9c0003c30 0x7fb9d81f2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:51.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.740+0000 7fb9e0600640 1 -- 172.21.15.40:0/1024402573 >> 172.21.15.40:0/1024402573 conn(0x7fb9d80cfbb0 msgr2=0x7fb9d80b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:51.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.740+0000 7fb9e0600640 1 -- 172.21.15.40:0/1024402573 shutdown_connections 2024-09-11T00:24:51.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.740+0000 7fb9e0600640 1 -- 172.21.15.40:0/1024402573 wait complete. 2024-09-11T00:24:51.758 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-09-11T00:24:49.791046+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224708,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750012,"statfs":{"total":773094113280,"available":772864012288,"internally_reserved":0,"allocated":4366336,"data_stored":2401284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001994"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376553+0000","last_change":"2024-09-11T00:24:42.384769+0000","last_active":"2024-09-11T00:24:43.376553+0000","last_peered":"2024-09-11T00:24:43.376553+0000","last_clean":"2024-09-11T00:24:43.376553+0000","last_became_active":"2024-09-11T00:24:42.384138+0000","last_became_peered":"2024-09-11T00:24:42.384138+0000","last_unstale":"2024-09-11T00:24:43.376553+0000","last_undegraded":"2024-09-11T00:24:43.376553+0000","last_fullsized":"2024-09-11T00:24:43.376553+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:29:15.035892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376292+0000","last_change":"2024-09-11T00:24:42.386678+0000","last_active":"2024-09-11T00:24:43.376292+0000","last_peered":"2024-09-11T00:24:43.376292+0000","last_clean":"2024-09-11T00:24:43.376292+0000","last_became_active":"2024-09-11T00:24:42.386323+0000","last_became_peered":"2024-09-11T00:24:42.386323+0000","last_unstale":"2024-09-11T00:24:43.376292+0000","last_undegraded":"2024-09-11T00:24:43.376292+0000","last_fullsized":"2024-09-11T00:24:43.376292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:06:35.328169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632992+0000","last_change":"2024-09-11T00:24:42.381116+0000","last_active":"2024-09-11T00:24:43.632992+0000","last_peered":"2024-09-11T00:24:43.632992+0000","last_clean":"2024-09-11T00:24:43.632992+0000","last_became_active":"2024-09-11T00:24:42.380860+0000","last_became_peered":"2024-09-11T00:24:42.380860+0000","last_unstale":"2024-09-11T00:24:43.632992+0000","last_undegraded":"2024-09-11T00:24:43.632992+0000","last_fullsized":"2024-09-11T00:24:43.632992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:10.904009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.405637+0000","last_change":"2024-09-11T00:24:42.384156+0000","last_active":"2024-09-11T00:24:43.405637+0000","last_peered":"2024-09-11T00:24:43.405637+0000","last_clean":"2024-09-11T00:24:43.405637+0000","last_became_active":"2024-09-11T00:24:42.383894+0000","last_became_peered":"2024-09-11T00:24:42.383894+0000","last_unstale":"2024-09-11T00:24:43.405637+0000","last_undegraded":"2024-09-11T00:24:43.405637+0000","last_fullsized":"2024-09-11T00:24:43.405637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:24.484912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631645+0000","last_change":"2024-09-11T00:24:42.393665+0000","last_active":"2024-09-11T00:24:43.631645+0000","last_peered":"2024-09-11T00:24:43.631645+0000","last_clean":"2024-09-11T00:24:43.631645+0000","last_became_active":"2024-09-11T00:24:42.391969+0000","last_became_peered":"2024-09-11T00:24:42.391969+0000","last_unstale":"2024-09-11T00:24:43.631645+0000","last_undegraded":"2024-09-11T00:24:43.631645+0000","last_fullsized":"2024-09-11T00:24:43.631645+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:13.891619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375477+0000","last_change":"2024-09-11T00:24:42.380197+0000","last_active":"2024-09-11T00:24:43.375477+0000","last_peered":"2024-09-11T00:24:43.375477+0000","last_clean":"2024-09-11T00:24:43.375477+0000","last_became_active":"2024-09-11T00:24:42.379928+0000","last_became_peered":"2024-09-11T00:24:42.379928+0000","last_unstale":"2024-09-11T00:24:43.375477+0000","last_undegraded":"2024-09-11T00:24:43.375477+0000","last_fullsized":"2024-09-11T00:24:43.375477+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:48:15.761482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376162+0000","last_change":"2024-09-11T00:24:42.396270+0000","last_active":"2024-09-11T00:24:43.376162+0000","last_peered":"2024-09-11T00:24:43.376162+0000","last_clean":"2024-09-11T00:24:43.376162+0000","last_became_active":"2024-09-11T00:24:42.395938+0000","last_became_peered":"2024-09-11T00:24:42.395938+0000","last_unstale":"2024-09-11T00:24:43.376162+0000","last_undegraded":"2024-09-11T00:24:43.376162+0000","last_fullsized":"2024-09-11T00:24:43.376162+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:23.870706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375571+0000","last_change":"2024-09-11T00:24:42.401018+0000","last_active":"2024-09-11T00:24:43.375571+0000","last_peered":"2024-09-11T00:24:43.375571+0000","last_clean":"2024-09-11T00:24:43.375571+0000","last_became_active":"2024-09-11T00:24:42.399194+0000","last_became_peered":"2024-09-11T00:24:42.399194+0000","last_unstale":"2024-09-11T00:24:43.375571+0000","last_undegraded":"2024-09-11T00:24:43.375571+0000","last_fullsized":"2024-09-11T00:24:43.375571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:05.699724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.633266+0000","last_change":"2024-09-11T00:24:42.394035+0000","last_active":"2024-09-11T00:24:43.633266+0000","last_peered":"2024-09-11T00:24:43.633266+0000","last_clean":"2024-09-11T00:24:43.633266+0000","last_became_active":"2024-09-11T00:24:42.393363+0000","last_became_peered":"2024-09-11T00:24:42.393363+0000","last_unstale":"2024-09-11T00:24:43.633266+0000","last_undegraded":"2024-09-11T00:24:43.633266+0000","last_fullsized":"2024-09-11T00:24:43.633266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:05.287137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.406320+0000","last_change":"2024-09-11T00:24:42.388500+0000","last_active":"2024-09-11T00:24:43.406320+0000","last_peered":"2024-09-11T00:24:43.406320+0000","last_clean":"2024-09-11T00:24:43.406320+0000","last_became_active":"2024-09-11T00:24:42.383696+0000","last_became_peered":"2024-09-11T00:24:42.383696+0000","last_unstale":"2024-09-11T00:24:43.406320+0000","last_undegraded":"2024-09-11T00:24:43.406320+0000","last_fullsized":"2024-09-11T00:24:43.406320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:57.346239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376546+0000","last_change":"2024-09-11T00:24:42.401909+0000","last_active":"2024-09-11T00:24:43.376546+0000","last_peered":"2024-09-11T00:24:43.376546+0000","last_clean":"2024-09-11T00:24:43.376546+0000","last_became_active":"2024-09-11T00:24:42.401667+0000","last_became_peered":"2024-09-11T00:24:42.401667+0000","last_unstale":"2024-09-11T00:24:43.376546+0000","last_undegraded":"2024-09-11T00:24:43.376546+0000","last_fullsized":"2024-09-11T00:24:43.376546+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:47.293955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632553+0000","last_change":"2024-09-11T00:24:42.383425+0000","last_active":"2024-09-11T00:24:43.632553+0000","last_peered":"2024-09-11T00:24:43.632553+0000","last_clean":"2024-09-11T00:24:43.632553+0000","last_became_active":"2024-09-11T00:24:42.383121+0000","last_became_peered":"2024-09-11T00:24:42.383121+0000","last_unstale":"2024-09-11T00:24:43.632553+0000","last_undegraded":"2024-09-11T00:24:43.632553+0000","last_fullsized":"2024-09-11T00:24:43.632553+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:46.185121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631715+0000","last_change":"2024-09-11T00:24:42.394455+0000","last_active":"2024-09-11T00:24:43.631715+0000","last_peered":"2024-09-11T00:24:43.631715+0000","last_clean":"2024-09-11T00:24:43.631715+0000","last_became_active":"2024-09-11T00:24:42.393991+0000","last_became_peered":"2024-09-11T00:24:42.393991+0000","last_unstale":"2024-09-11T00:24:43.631715+0000","last_undegraded":"2024-09-11T00:24:43.631715+0000","last_fullsized":"2024-09-11T00:24:43.631715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:10.442090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375818+0000","last_change":"2024-09-11T00:24:42.395052+0000","last_active":"2024-09-11T00:24:43.375818+0000","last_peered":"2024-09-11T00:24:43.375818+0000","last_clean":"2024-09-11T00:24:43.375818+0000","last_became_active":"2024-09-11T00:24:42.393713+0000","last_became_peered":"2024-09-11T00:24:42.393713+0000","last_unstale":"2024-09-11T00:24:43.375818+0000","last_undegraded":"2024-09-11T00:24:43.375818+0000","last_fullsized":"2024-09-11T00:24:43.375818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:22.005112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632394+0000","last_change":"2024-09-11T00:24:42.379087+0000","last_active":"2024-09-11T00:24:43.632394+0000","last_peered":"2024-09-11T00:24:43.632394+0000","last_clean":"2024-09-11T00:24:43.632394+0000","last_became_active":"2024-09-11T00:24:42.378791+0000","last_became_peered":"2024-09-11T00:24:42.378791+0000","last_unstale":"2024-09-11T00:24:43.632394+0000","last_undegraded":"2024-09-11T00:24:43.632394+0000","last_fullsized":"2024-09-11T00:24:43.632394+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:25.115101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376214+0000","last_change":"2024-09-11T00:24:42.392700+0000","last_active":"2024-09-11T00:24:43.376214+0000","last_peered":"2024-09-11T00:24:43.376214+0000","last_clean":"2024-09-11T00:24:43.376214+0000","last_became_active":"2024-09-11T00:24:42.392399+0000","last_became_peered":"2024-09-11T00:24:42.392399+0000","last_unstale":"2024-09-11T00:24:43.376214+0000","last_undegraded":"2024-09-11T00:24:43.376214+0000","last_fullsized":"2024-09-11T00:24:43.376214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:39.980626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375823+0000","last_change":"2024-09-11T00:24:42.395925+0000","last_active":"2024-09-11T00:24:43.375823+0000","last_peered":"2024-09-11T00:24:43.375823+0000","last_clean":"2024-09-11T00:24:43.375823+0000","last_became_active":"2024-09-11T00:24:42.395610+0000","last_became_peered":"2024-09-11T00:24:42.395610+0000","last_unstale":"2024-09-11T00:24:43.375823+0000","last_undegraded":"2024-09-11T00:24:43.375823+0000","last_fullsized":"2024-09-11T00:24:43.375823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:10.772696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376350+0000","last_change":"2024-09-11T00:24:42.389497+0000","last_active":"2024-09-11T00:24:43.376350+0000","last_peered":"2024-09-11T00:24:43.376350+0000","last_clean":"2024-09-11T00:24:43.376350+0000","last_became_active":"2024-09-11T00:24:42.387575+0000","last_became_peered":"2024-09-11T00:24:42.387575+0000","last_unstale":"2024-09-11T00:24:43.376350+0000","last_undegraded":"2024-09-11T00:24:43.376350+0000","last_fullsized":"2024-09-11T00:24:43.376350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:02:57.009012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376090+0000","last_change":"2024-09-11T00:24:42.395057+0000","last_active":"2024-09-11T00:24:43.376090+0000","last_peered":"2024-09-11T00:24:43.376090+0000","last_clean":"2024-09-11T00:24:43.376090+0000","last_became_active":"2024-09-11T00:24:42.394320+0000","last_became_peered":"2024-09-11T00:24:42.394320+0000","last_unstale":"2024-09-11T00:24:43.376090+0000","last_undegraded":"2024-09-11T00:24:43.376090+0000","last_fullsized":"2024-09-11T00:24:43.376090+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:24.732359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631733+0000","last_change":"2024-09-11T00:24:42.380995+0000","last_active":"2024-09-11T00:24:43.631733+0000","last_peered":"2024-09-11T00:24:43.631733+0000","last_clean":"2024-09-11T00:24:43.631733+0000","last_became_active":"2024-09-11T00:24:42.380742+0000","last_became_peered":"2024-09-11T00:24:42.380742+0000","last_unstale":"2024-09-11T00:24:43.631733+0000","last_undegraded":"2024-09-11T00:24:43.631733+0000","last_fullsized":"2024-09-11T00:24:43.631733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:40.389792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632110+0000","last_change":"2024-09-11T00:24:42.385694+0000","last_active":"2024-09-11T00:24:43.632110+0000","last_peered":"2024-09-11T00:24:43.632110+0000","last_clean":"2024-09-11T00:24:43.632110+0000","last_became_active":"2024-09-11T00:24:42.385407+0000","last_became_peered":"2024-09-11T00:24:42.385407+0000","last_unstale":"2024-09-11T00:24:43.632110+0000","last_undegraded":"2024-09-11T00:24:43.632110+0000","last_fullsized":"2024-09-11T00:24:43.632110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:31.285979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631914+0000","last_change":"2024-09-11T00:24:42.391470+0000","last_active":"2024-09-11T00:24:43.631914+0000","last_peered":"2024-09-11T00:24:43.631914+0000","last_clean":"2024-09-11T00:24:43.631914+0000","last_became_active":"2024-09-11T00:24:42.391208+0000","last_became_peered":"2024-09-11T00:24:42.391208+0000","last_unstale":"2024-09-11T00:24:43.631914+0000","last_undegraded":"2024-09-11T00:24:43.631914+0000","last_fullsized":"2024-09-11T00:24:43.631914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:29:15.035892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.402076+0000","last_change":"2024-09-11T00:24:42.388682+0000","last_active":"2024-09-11T00:24:43.402076+0000","last_peered":"2024-09-11T00:24:43.402076+0000","last_clean":"2024-09-11T00:24:43.402076+0000","last_became_active":"2024-09-11T00:24:42.388104+0000","last_became_peered":"2024-09-11T00:24:42.388104+0000","last_unstale":"2024-09-11T00:24:43.402076+0000","last_undegraded":"2024-09-11T00:24:43.402076+0000","last_fullsized":"2024-09-11T00:24:43.402076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:56:07.235210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631889+0000","last_change":"2024-09-11T00:24:42.397013+0000","last_active":"2024-09-11T00:24:43.631889+0000","last_peered":"2024-09-11T00:24:43.631889+0000","last_clean":"2024-09-11T00:24:43.631889+0000","last_became_active":"2024-09-11T00:24:42.396587+0000","last_became_peered":"2024-09-11T00:24:42.396587+0000","last_unstale":"2024-09-11T00:24:43.631889+0000","last_undegraded":"2024-09-11T00:24:43.631889+0000","last_fullsized":"2024-09-11T00:24:43.631889+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:57.346239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.406428+0000","last_change":"2024-09-11T00:24:42.390236+0000","last_active":"2024-09-11T00:24:43.406428+0000","last_peered":"2024-09-11T00:24:43.406428+0000","last_clean":"2024-09-11T00:24:43.406428+0000","last_became_active":"2024-09-11T00:24:42.389942+0000","last_became_peered":"2024-09-11T00:24:42.389942+0000","last_unstale":"2024-09-11T00:24:43.406428+0000","last_undegraded":"2024-09-11T00:24:43.406428+0000","last_fullsized":"2024-09-11T00:24:43.406428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:46.185121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376477+0000","last_change":"2024-09-11T00:24:42.390701+0000","last_active":"2024-09-11T00:24:43.376477+0000","last_peered":"2024-09-11T00:24:43.376477+0000","last_clean":"2024-09-11T00:24:43.376477+0000","last_became_active":"2024-09-11T00:24:42.390372+0000","last_became_peered":"2024-09-11T00:24:42.390372+0000","last_unstale":"2024-09-11T00:24:43.376477+0000","last_undegraded":"2024-09-11T00:24:43.376477+0000","last_fullsized":"2024-09-11T00:24:43.376477+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:26.157640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.406317+0000","last_change":"2024-09-11T00:24:42.383015+0000","last_active":"2024-09-11T00:24:43.406317+0000","last_peered":"2024-09-11T00:24:43.406317+0000","last_clean":"2024-09-11T00:24:43.406317+0000","last_became_active":"2024-09-11T00:24:42.382653+0000","last_became_peered":"2024-09-11T00:24:42.382653+0000","last_unstale":"2024-09-11T00:24:43.406317+0000","last_undegraded":"2024-09-11T00:24:43.406317+0000","last_fullsized":"2024-09-11T00:24:43.406317+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:31.076560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632772+0000","last_change":"2024-09-11T00:24:42.378485+0000","last_active":"2024-09-11T00:24:43.632772+0000","last_peered":"2024-09-11T00:24:43.632772+0000","last_clean":"2024-09-11T00:24:43.632772+0000","last_became_active":"2024-09-11T00:24:42.378201+0000","last_became_peered":"2024-09-11T00:24:42.378201+0000","last_unstale":"2024-09-11T00:24:43.632772+0000","last_undegraded":"2024-09-11T00:24:43.632772+0000","last_fullsized":"2024-09-11T00:24:43.632772+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:48:15.761482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632396+0000","last_change":"2024-09-11T00:24:42.384518+0000","last_active":"2024-09-11T00:24:43.632396+0000","last_peered":"2024-09-11T00:24:43.632396+0000","last_clean":"2024-09-11T00:24:43.632396+0000","last_became_active":"2024-09-11T00:24:42.384116+0000","last_became_peered":"2024-09-11T00:24:42.384116+0000","last_unstale":"2024-09-11T00:24:43.632396+0000","last_undegraded":"2024-09-11T00:24:43.632396+0000","last_fullsized":"2024-09-11T00:24:43.632396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:43.213311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375653+0000","last_change":"2024-09-11T00:24:42.397202+0000","last_active":"2024-09-11T00:24:43.375653+0000","last_peered":"2024-09-11T00:24:43.375653+0000","last_clean":"2024-09-11T00:24:43.375653+0000","last_became_active":"2024-09-11T00:24:42.396965+0000","last_became_peered":"2024-09-11T00:24:42.396965+0000","last_unstale":"2024-09-11T00:24:43.375653+0000","last_undegraded":"2024-09-11T00:24:43.375653+0000","last_fullsized":"2024-09-11T00:24:43.375653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:33.556119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376021+0000","last_change":"2024-09-11T00:24:42.397135+0000","last_active":"2024-09-11T00:24:43.376021+0000","last_peered":"2024-09-11T00:24:43.376021+0000","last_clean":"2024-09-11T00:24:43.376021+0000","last_became_active":"2024-09-11T00:24:42.396887+0000","last_became_peered":"2024-09-11T00:24:42.396887+0000","last_unstale":"2024-09-11T00:24:43.376021+0000","last_undegraded":"2024-09-11T00:24:43.376021+0000","last_fullsized":"2024-09-11T00:24:43.376021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:04.833882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375730+0000","last_change":"2024-09-11T00:24:42.394146+0000","last_active":"2024-09-11T00:24:43.375730+0000","last_peered":"2024-09-11T00:24:43.375730+0000","last_clean":"2024-09-11T00:24:43.375730+0000","last_became_active":"2024-09-11T00:24:42.393838+0000","last_became_peered":"2024-09-11T00:24:42.393838+0000","last_unstale":"2024-09-11T00:24:43.375730+0000","last_undegraded":"2024-09-11T00:24:43.375730+0000","last_fullsized":"2024-09-11T00:24:43.375730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:52:10.202093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.402478+0000","last_change":"2024-09-11T00:24:42.389752+0000","last_active":"2024-09-11T00:24:43.402478+0000","last_peered":"2024-09-11T00:24:43.402478+0000","last_clean":"2024-09-11T00:24:43.402478+0000","last_became_active":"2024-09-11T00:24:42.389415+0000","last_became_peered":"2024-09-11T00:24:42.389415+0000","last_unstale":"2024-09-11T00:24:43.402478+0000","last_undegraded":"2024-09-11T00:24:43.402478+0000","last_fullsized":"2024-09-11T00:24:43.402478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:16.857278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376707+0000","last_change":"2024-09-11T00:24:41.375539+0000","last_active":"2024-09-11T00:24:43.376707+0000","last_peered":"2024-09-11T00:24:43.376707+0000","last_clean":"2024-09-11T00:24:43.376707+0000","last_became_active":"2024-09-11T00:24:41.375222+0000","last_became_peered":"2024-09-11T00:24:41.375222+0000","last_unstale":"2024-09-11T00:24:43.376707+0000","last_undegraded":"2024-09-11T00:24:43.376707+0000","last_fullsized":"2024-09-11T00:24:43.376707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:28.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376670+0000","last_change":"2024-09-11T00:24:42.385023+0000","last_active":"2024-09-11T00:24:43.376670+0000","last_peered":"2024-09-11T00:24:43.376670+0000","last_clean":"2024-09-11T00:24:43.376670+0000","last_became_active":"2024-09-11T00:24:42.384493+0000","last_became_peered":"2024-09-11T00:24:42.384493+0000","last_unstale":"2024-09-11T00:24:43.376670+0000","last_undegraded":"2024-09-11T00:24:43.376670+0000","last_fullsized":"2024-09-11T00:24:43.376670+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:31.285979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.402514+0000","last_change":"2024-09-11T00:24:41.376261+0000","last_active":"2024-09-11T00:24:43.402514+0000","last_peered":"2024-09-11T00:24:43.402514+0000","last_clean":"2024-09-11T00:24:43.402514+0000","last_became_active":"2024-09-11T00:24:41.375407+0000","last_became_peered":"2024-09-11T00:24:41.375407+0000","last_unstale":"2024-09-11T00:24:43.402514+0000","last_undegraded":"2024-09-11T00:24:43.402514+0000","last_fullsized":"2024-09-11T00:24:43.402514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:20.999873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.633099+0000","last_change":"2024-09-11T00:24:42.383193+0000","last_active":"2024-09-11T00:24:43.633099+0000","last_peered":"2024-09-11T00:24:43.633099+0000","last_clean":"2024-09-11T00:24:43.633099+0000","last_became_active":"2024-09-11T00:24:42.382423+0000","last_became_peered":"2024-09-11T00:24:42.382423+0000","last_unstale":"2024-09-11T00:24:43.633099+0000","last_undegraded":"2024-09-11T00:24:43.633099+0000","last_fullsized":"2024-09-11T00:24:43.633099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:03.999826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376070+0000","last_change":"2024-09-11T00:24:41.378757+0000","last_active":"2024-09-11T00:24:43.376070+0000","last_peered":"2024-09-11T00:24:43.376070+0000","last_clean":"2024-09-11T00:24:43.376070+0000","last_became_active":"2024-09-11T00:24:41.376929+0000","last_became_peered":"2024-09-11T00:24:41.376929+0000","last_unstale":"2024-09-11T00:24:43.376070+0000","last_undegraded":"2024-09-11T00:24:43.376070+0000","last_fullsized":"2024-09-11T00:24:43.376070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:42.207923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.406380+0000","last_change":"2024-09-11T00:24:42.382624+0000","last_active":"2024-09-11T00:24:43.406380+0000","last_peered":"2024-09-11T00:24:43.406380+0000","last_clean":"2024-09-11T00:24:43.406380+0000","last_became_active":"2024-09-11T00:24:42.382277+0000","last_became_peered":"2024-09-11T00:24:42.382277+0000","last_unstale":"2024-09-11T00:24:43.406380+0000","last_undegraded":"2024-09-11T00:24:43.406380+0000","last_fullsized":"2024-09-11T00:24:43.406380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:25.115101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631734+0000","last_change":"2024-09-11T00:24:41.383340+0000","last_active":"2024-09-11T00:24:43.631734+0000","last_peered":"2024-09-11T00:24:43.631734+0000","last_clean":"2024-09-11T00:24:43.631734+0000","last_became_active":"2024-09-11T00:24:41.383103+0000","last_became_peered":"2024-09-11T00:24:41.383103+0000","last_unstale":"2024-09-11T00:24:43.631734+0000","last_undegraded":"2024-09-11T00:24:43.631734+0000","last_fullsized":"2024-09-11T00:24:43.631734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:24.541403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376469+0000","last_change":"2024-09-11T00:24:42.391944+0000","last_active":"2024-09-11T00:24:43.376469+0000","last_peered":"2024-09-11T00:24:43.376469+0000","last_clean":"2024-09-11T00:24:43.376469+0000","last_became_active":"2024-09-11T00:24:42.391669+0000","last_became_peered":"2024-09-11T00:24:42.391669+0000","last_unstale":"2024-09-11T00:24:43.376469+0000","last_undegraded":"2024-09-11T00:24:43.376469+0000","last_fullsized":"2024-09-11T00:24:43.376469+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:15.319218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632561+0000","last_change":"2024-09-11T00:24:41.364406+0000","last_active":"2024-09-11T00:24:43.632561+0000","last_peered":"2024-09-11T00:24:43.632561+0000","last_clean":"2024-09-11T00:24:43.632561+0000","last_became_active":"2024-09-11T00:24:41.362829+0000","last_became_peered":"2024-09-11T00:24:41.362829+0000","last_unstale":"2024-09-11T00:24:43.632561+0000","last_undegraded":"2024-09-11T00:24:43.632561+0000","last_fullsized":"2024-09-11T00:24:43.632561+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:20.203720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632635+0000","last_change":"2024-09-11T00:24:42.378341+0000","last_active":"2024-09-11T00:24:43.632635+0000","last_peered":"2024-09-11T00:24:43.632635+0000","last_clean":"2024-09-11T00:24:43.632635+0000","last_became_active":"2024-09-11T00:24:42.378039+0000","last_became_peered":"2024-09-11T00:24:42.378039+0000","last_unstale":"2024-09-11T00:24:43.632635+0000","last_undegraded":"2024-09-11T00:24:43.632635+0000","last_fullsized":"2024-09-11T00:24:43.632635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:13.605779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632081+0000","last_change":"2024-09-11T00:24:41.367444+0000","last_active":"2024-09-11T00:24:43.632081+0000","last_peered":"2024-09-11T00:24:43.632081+0000","last_clean":"2024-09-11T00:24:43.632081+0000","last_became_active":"2024-09-11T00:24:41.367132+0000","last_became_peered":"2024-09-11T00:24:41.367132+0000","last_unstale":"2024-09-11T00:24:43.632081+0000","last_undegraded":"2024-09-11T00:24:43.632081+0000","last_fullsized":"2024-09-11T00:24:43.632081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:24.190396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631786+0000","last_change":"2024-09-11T00:24:42.382301+0000","last_active":"2024-09-11T00:24:43.631786+0000","last_peered":"2024-09-11T00:24:43.631786+0000","last_clean":"2024-09-11T00:24:43.631786+0000","last_became_active":"2024-09-11T00:24:42.381997+0000","last_became_peered":"2024-09-11T00:24:42.381997+0000","last_unstale":"2024-09-11T00:24:43.631786+0000","last_undegraded":"2024-09-11T00:24:43.631786+0000","last_fullsized":"2024-09-11T00:24:43.631786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:15.489748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375537+0000","last_change":"2024-09-11T00:24:41.379745+0000","last_active":"2024-09-11T00:24:43.375537+0000","last_peered":"2024-09-11T00:24:43.375537+0000","last_clean":"2024-09-11T00:24:43.375537+0000","last_became_active":"2024-09-11T00:24:41.379450+0000","last_became_peered":"2024-09-11T00:24:41.379450+0000","last_unstale":"2024-09-11T00:24:43.375537+0000","last_undegraded":"2024-09-11T00:24:43.375537+0000","last_fullsized":"2024-09-11T00:24:43.375537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:29:14.030504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.405495+0000","last_change":"2024-09-11T00:24:42.372682+0000","last_active":"2024-09-11T00:24:43.405495+0000","last_peered":"2024-09-11T00:24:43.405495+0000","last_clean":"2024-09-11T00:24:43.405495+0000","last_became_active":"2024-09-11T00:24:42.372378+0000","last_became_peered":"2024-09-11T00:24:42.372378+0000","last_unstale":"2024-09-11T00:24:43.405495+0000","last_undegraded":"2024-09-11T00:24:43.405495+0000","last_fullsized":"2024-09-11T00:24:43.405495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:54.931762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631696+0000","last_change":"2024-09-11T00:24:41.369910+0000","last_active":"2024-09-11T00:24:43.631696+0000","last_peered":"2024-09-11T00:24:43.631696+0000","last_clean":"2024-09-11T00:24:43.631696+0000","last_became_active":"2024-09-11T00:24:41.366429+0000","last_became_peered":"2024-09-11T00:24:41.366429+0000","last_unstale":"2024-09-11T00:24:43.631696+0000","last_undegraded":"2024-09-11T00:24:43.631696+0000","last_fullsized":"2024-09-11T00:24:43.631696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:42.748491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632650+0000","last_change":"2024-09-11T00:24:42.385691+0000","last_active":"2024-09-11T00:24:43.632650+0000","last_peered":"2024-09-11T00:24:43.632650+0000","last_clean":"2024-09-11T00:24:43.632650+0000","last_became_active":"2024-09-11T00:24:42.384627+0000","last_became_peered":"2024-09-11T00:24:42.384627+0000","last_unstale":"2024-09-11T00:24:43.632650+0000","last_undegraded":"2024-09-11T00:24:43.632650+0000","last_fullsized":"2024-09-11T00:24:43.632650+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:41.177207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376290+0000","last_change":"2024-09-11T00:24:41.375561+0000","last_active":"2024-09-11T00:24:43.376290+0000","last_peered":"2024-09-11T00:24:43.376290+0000","last_clean":"2024-09-11T00:24:43.376290+0000","last_became_active":"2024-09-11T00:24:41.375291+0000","last_became_peered":"2024-09-11T00:24:41.375291+0000","last_unstale":"2024-09-11T00:24:43.376290+0000","last_undegraded":"2024-09-11T00:24:43.376290+0000","last_fullsized":"2024-09-11T00:24:43.376290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:02.994438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376350+0000","last_change":"2024-09-11T00:24:42.391234+0000","last_active":"2024-09-11T00:24:43.376350+0000","last_peered":"2024-09-11T00:24:43.376350+0000","last_clean":"2024-09-11T00:24:43.376350+0000","last_became_active":"2024-09-11T00:24:42.390982+0000","last_became_peered":"2024-09-11T00:24:42.390982+0000","last_unstale":"2024-09-11T00:24:43.376350+0000","last_undegraded":"2024-09-11T00:24:43.376350+0000","last_fullsized":"2024-09-11T00:24:43.376350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:12.209561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.402567+0000","last_change":"2024-09-11T00:24:41.376918+0000","last_active":"2024-09-11T00:24:43.402567+0000","last_peered":"2024-09-11T00:24:43.402567+0000","last_clean":"2024-09-11T00:24:43.402567+0000","last_became_active":"2024-09-11T00:24:41.376617+0000","last_became_peered":"2024-09-11T00:24:41.376617+0000","last_unstale":"2024-09-11T00:24:43.402567+0000","last_undegraded":"2024-09-11T00:24:43.402567+0000","last_fullsized":"2024-09-11T00:24:43.402567+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:54.763135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376106+0000","last_change":"2024-09-11T00:24:42.390013+0000","last_active":"2024-09-11T00:24:43.376106+0000","last_peered":"2024-09-11T00:24:43.376106+0000","last_clean":"2024-09-11T00:24:43.376106+0000","last_became_active":"2024-09-11T00:24:42.389749+0000","last_became_peered":"2024-09-11T00:24:42.389749+0000","last_unstale":"2024-09-11T00:24:43.376106+0000","last_undegraded":"2024-09-11T00:24:43.376106+0000","last_fullsized":"2024-09-11T00:24:43.376106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:42.008650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.633081+0000","last_change":"2024-09-11T00:24:41.374576+0000","last_active":"2024-09-11T00:24:43.633081+0000","last_peered":"2024-09-11T00:24:43.633081+0000","last_clean":"2024-09-11T00:24:43.633081+0000","last_became_active":"2024-09-11T00:24:41.373816+0000","last_became_peered":"2024-09-11T00:24:41.373816+0000","last_unstale":"2024-09-11T00:24:43.633081+0000","last_undegraded":"2024-09-11T00:24:43.633081+0000","last_fullsized":"2024-09-11T00:24:43.633081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:13.967482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632913+0000","last_change":"2024-09-11T00:24:42.390789+0000","last_active":"2024-09-11T00:24:43.632913+0000","last_peered":"2024-09-11T00:24:43.632913+0000","last_clean":"2024-09-11T00:24:43.632913+0000","last_became_active":"2024-09-11T00:24:42.390504+0000","last_became_peered":"2024-09-11T00:24:42.390504+0000","last_unstale":"2024-09-11T00:24:43.632913+0000","last_undegraded":"2024-09-11T00:24:43.632913+0000","last_fullsized":"2024-09-11T00:24:43.632913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:22.005112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376048+0000","last_change":"2024-09-11T00:24:41.378401+0000","last_active":"2024-09-11T00:24:43.376048+0000","last_peered":"2024-09-11T00:24:43.376048+0000","last_clean":"2024-09-11T00:24:43.376048+0000","last_became_active":"2024-09-11T00:24:41.377514+0000","last_became_peered":"2024-09-11T00:24:41.377514+0000","last_unstale":"2024-09-11T00:24:43.376048+0000","last_undegraded":"2024-09-11T00:24:43.376048+0000","last_fullsized":"2024-09-11T00:24:43.376048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:30.280591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.405728+0000","last_change":"2024-09-11T00:24:42.382460+0000","last_active":"2024-09-11T00:24:43.405728+0000","last_peered":"2024-09-11T00:24:43.405728+0000","last_clean":"2024-09-11T00:24:43.405728+0000","last_became_active":"2024-09-11T00:24:42.380500+0000","last_became_peered":"2024-09-11T00:24:42.380500+0000","last_unstale":"2024-09-11T00:24:43.405728+0000","last_undegraded":"2024-09-11T00:24:43.405728+0000","last_fullsized":"2024-09-11T00:24:43.405728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:48.682956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632670+0000","last_change":"2024-09-11T00:24:41.369376+0000","last_active":"2024-09-11T00:24:43.632670+0000","last_peered":"2024-09-11T00:24:43.632670+0000","last_clean":"2024-09-11T00:24:43.632670+0000","last_became_active":"2024-09-11T00:24:41.369126+0000","last_became_peered":"2024-09-11T00:24:41.369126+0000","last_unstale":"2024-09-11T00:24:43.632670+0000","last_undegraded":"2024-09-11T00:24:43.632670+0000","last_fullsized":"2024-09-11T00:24:43.632670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:19:40.405372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376003+0000","last_change":"2024-09-11T00:24:42.380255+0000","last_active":"2024-09-11T00:24:43.376003+0000","last_peered":"2024-09-11T00:24:43.376003+0000","last_clean":"2024-09-11T00:24:43.376003+0000","last_became_active":"2024-09-11T00:24:42.380009+0000","last_became_peered":"2024-09-11T00:24:42.380009+0000","last_unstale":"2024-09-11T00:24:43.376003+0000","last_undegraded":"2024-09-11T00:24:43.376003+0000","last_fullsized":"2024-09-11T00:24:43.376003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:10.904009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.405716+0000","last_change":"2024-09-11T00:24:41.378892+0000","last_active":"2024-09-11T00:24:43.405716+0000","last_peered":"2024-09-11T00:24:43.405716+0000","last_clean":"2024-09-11T00:24:43.405716+0000","last_became_active":"2024-09-11T00:24:41.378470+0000","last_became_peered":"2024-09-11T00:24:41.378470+0000","last_unstale":"2024-09-11T00:24:43.405716+0000","last_undegraded":"2024-09-11T00:24:43.405716+0000","last_fullsized":"2024-09-11T00:24:43.405716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:04.897409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375939+0000","last_change":"2024-09-11T00:24:42.393736+0000","last_active":"2024-09-11T00:24:43.375939+0000","last_peered":"2024-09-11T00:24:43.375939+0000","last_clean":"2024-09-11T00:24:43.375939+0000","last_became_active":"2024-09-11T00:24:42.391657+0000","last_became_peered":"2024-09-11T00:24:42.391657+0000","last_unstale":"2024-09-11T00:24:43.375939+0000","last_undegraded":"2024-09-11T00:24:43.375939+0000","last_fullsized":"2024-09-11T00:24:43.375939+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:43.643553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375444+0000","last_change":"2024-09-11T00:24:41.372351+0000","last_active":"2024-09-11T00:24:43.375444+0000","last_peered":"2024-09-11T00:24:43.375444+0000","last_clean":"2024-09-11T00:24:43.375444+0000","last_became_active":"2024-09-11T00:24:41.372125+0000","last_became_peered":"2024-09-11T00:24:41.372125+0000","last_unstale":"2024-09-11T00:24:43.375444+0000","last_undegraded":"2024-09-11T00:24:43.375444+0000","last_fullsized":"2024-09-11T00:24:43.375444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:14.484360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376218+0000","last_change":"2024-09-11T00:24:42.391136+0000","last_active":"2024-09-11T00:24:43.376218+0000","last_peered":"2024-09-11T00:24:43.376218+0000","last_clean":"2024-09-11T00:24:43.376218+0000","last_became_active":"2024-09-11T00:24:42.389347+0000","last_became_peered":"2024-09-11T00:24:42.389347+0000","last_unstale":"2024-09-11T00:24:43.376218+0000","last_undegraded":"2024-09-11T00:24:43.376218+0000","last_fullsized":"2024-09-11T00:24:43.376218+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:15.489748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375506+0000","last_change":"2024-09-11T00:24:41.364238+0000","last_active":"2024-09-11T00:24:43.375506+0000","last_peered":"2024-09-11T00:24:43.375506+0000","last_clean":"2024-09-11T00:24:43.375506+0000","last_became_active":"2024-09-11T00:24:41.362593+0000","last_became_peered":"2024-09-11T00:24:41.362593+0000","last_unstale":"2024-09-11T00:24:43.375506+0000","last_undegraded":"2024-09-11T00:24:43.375506+0000","last_fullsized":"2024-09-11T00:24:43.375506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:03.828494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.633431+0000","last_change":"2024-09-11T00:24:42.387825+0000","last_active":"2024-09-11T00:24:43.633431+0000","last_peered":"2024-09-11T00:24:43.633431+0000","last_clean":"2024-09-11T00:24:43.633431+0000","last_became_active":"2024-09-11T00:24:42.383098+0000","last_became_peered":"2024-09-11T00:24:42.383098+0000","last_unstale":"2024-09-11T00:24:43.633431+0000","last_undegraded":"2024-09-11T00:24:43.633431+0000","last_fullsized":"2024-09-11T00:24:43.633431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:54.931762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.406650+0000","last_change":"2024-09-11T00:24:41.381321+0000","last_active":"2024-09-11T00:24:43.406650+0000","last_peered":"2024-09-11T00:24:43.406650+0000","last_clean":"2024-09-11T00:24:43.406650+0000","last_became_active":"2024-09-11T00:24:41.381052+0000","last_became_peered":"2024-09-11T00:24:41.381052+0000","last_unstale":"2024-09-11T00:24:43.406650+0000","last_undegraded":"2024-09-11T00:24:43.406650+0000","last_fullsized":"2024-09-11T00:24:43.406650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:52.909342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.633419+0000","last_change":"2024-09-11T00:24:42.384072+0000","last_active":"2024-09-11T00:24:43.633419+0000","last_peered":"2024-09-11T00:24:43.633419+0000","last_clean":"2024-09-11T00:24:43.633419+0000","last_became_active":"2024-09-11T00:24:42.382285+0000","last_became_peered":"2024-09-11T00:24:42.382285+0000","last_unstale":"2024-09-11T00:24:43.633419+0000","last_undegraded":"2024-09-11T00:24:43.633419+0000","last_fullsized":"2024-09-11T00:24:43.633419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:24.732359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.633019+0000","last_change":"2024-09-11T00:24:41.372282+0000","last_active":"2024-09-11T00:24:43.633019+0000","last_peered":"2024-09-11T00:24:43.633019+0000","last_clean":"2024-09-11T00:24:43.633019+0000","last_became_active":"2024-09-11T00:24:41.371783+0000","last_became_peered":"2024-09-11T00:24:41.371783+0000","last_unstale":"2024-09-11T00:24:43.633019+0000","last_undegraded":"2024-09-11T00:24:43.633019+0000","last_fullsized":"2024-09-11T00:24:43.633019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:39.384404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.405780+0000","last_change":"2024-09-11T00:24:42.384144+0000","last_active":"2024-09-11T00:24:43.405780+0000","last_peered":"2024-09-11T00:24:43.405780+0000","last_clean":"2024-09-11T00:24:43.405780+0000","last_became_active":"2024-09-11T00:24:42.383476+0000","last_became_peered":"2024-09-11T00:24:42.383476+0000","last_unstale":"2024-09-11T00:24:43.405780+0000","last_undegraded":"2024-09-11T00:24:43.405780+0000","last_fullsized":"2024-09-11T00:24:43.405780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:01.717183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.633092+0000","last_change":"2024-09-11T00:24:41.382162+0000","last_active":"2024-09-11T00:24:43.633092+0000","last_peered":"2024-09-11T00:24:43.633092+0000","last_clean":"2024-09-11T00:24:43.633092+0000","last_became_active":"2024-09-11T00:24:41.381878+0000","last_became_peered":"2024-09-11T00:24:41.381878+0000","last_unstale":"2024-09-11T00:24:43.633092+0000","last_undegraded":"2024-09-11T00:24:43.633092+0000","last_fullsized":"2024-09-11T00:24:43.633092+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:56.614698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631782+0000","last_change":"2024-09-11T00:24:42.391822+0000","last_active":"2024-09-11T00:24:43.631782+0000","last_peered":"2024-09-11T00:24:43.631782+0000","last_clean":"2024-09-11T00:24:43.631782+0000","last_became_active":"2024-09-11T00:24:42.391556+0000","last_became_peered":"2024-09-11T00:24:42.391556+0000","last_unstale":"2024-09-11T00:24:43.631782+0000","last_undegraded":"2024-09-11T00:24:43.631782+0000","last_fullsized":"2024-09-11T00:24:43.631782+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:20.467658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.633220+0000","last_change":"2024-09-11T00:24:41.376338+0000","last_active":"2024-09-11T00:24:43.633220+0000","last_peered":"2024-09-11T00:24:43.633220+0000","last_clean":"2024-09-11T00:24:43.633220+0000","last_became_active":"2024-09-11T00:24:41.376049+0000","last_became_peered":"2024-09-11T00:24:41.376049+0000","last_unstale":"2024-09-11T00:24:43.633220+0000","last_undegraded":"2024-09-11T00:24:43.633220+0000","last_fullsized":"2024-09-11T00:24:43.633220+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:35.522030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631671+0000","last_change":"2024-09-11T00:24:42.386314+0000","last_active":"2024-09-11T00:24:43.631671+0000","last_peered":"2024-09-11T00:24:43.631671+0000","last_clean":"2024-09-11T00:24:43.631671+0000","last_became_active":"2024-09-11T00:24:42.386029+0000","last_became_peered":"2024-09-11T00:24:42.386029+0000","last_unstale":"2024-09-11T00:24:43.631671+0000","last_undegraded":"2024-09-11T00:24:43.631671+0000","last_fullsized":"2024-09-11T00:24:43.631671+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:31.269595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.402116+0000","last_change":"2024-09-11T00:24:41.374850+0000","last_active":"2024-09-11T00:24:43.402116+0000","last_peered":"2024-09-11T00:24:43.402116+0000","last_clean":"2024-09-11T00:24:43.402116+0000","last_became_active":"2024-09-11T00:24:41.374581+0000","last_became_peered":"2024-09-11T00:24:41.374581+0000","last_unstale":"2024-09-11T00:24:43.402116+0000","last_undegraded":"2024-09-11T00:24:43.402116+0000","last_fullsized":"2024-09-11T00:24:43.402116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:04.636783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631873+0000","last_change":"2024-09-11T00:24:42.382410+0000","last_active":"2024-09-11T00:24:43.631873+0000","last_peered":"2024-09-11T00:24:43.631873+0000","last_clean":"2024-09-11T00:24:43.631873+0000","last_became_active":"2024-09-11T00:24:42.380206+0000","last_became_peered":"2024-09-11T00:24:42.380206+0000","last_unstale":"2024-09-11T00:24:43.631873+0000","last_undegraded":"2024-09-11T00:24:43.631873+0000","last_fullsized":"2024-09-11T00:24:43.631873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:08:40.946079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.377103+0000","last_change":"2024-09-11T00:24:41.378707+0000","last_active":"2024-09-11T00:24:43.377103+0000","last_peered":"2024-09-11T00:24:43.377103+0000","last_clean":"2024-09-11T00:24:43.377103+0000","last_became_active":"2024-09-11T00:24:41.378352+0000","last_became_peered":"2024-09-11T00:24:41.378352+0000","last_unstale":"2024-09-11T00:24:43.377103+0000","last_undegraded":"2024-09-11T00:24:43.377103+0000","last_fullsized":"2024-09-11T00:24:43.377103+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:04.897409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631964+0000","last_change":"2024-09-11T00:24:42.387359+0000","last_active":"2024-09-11T00:24:43.631964+0000","last_peered":"2024-09-11T00:24:43.631964+0000","last_clean":"2024-09-11T00:24:43.631964+0000","last_became_active":"2024-09-11T00:24:42.382891+0000","last_became_peered":"2024-09-11T00:24:42.382891+0000","last_unstale":"2024-09-11T00:24:43.631964+0000","last_undegraded":"2024-09-11T00:24:43.631964+0000","last_fullsized":"2024-09-11T00:24:43.631964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:29.180009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631735+0000","last_change":"2024-09-11T00:24:41.375301+0000","last_active":"2024-09-11T00:24:43.631735+0000","last_peered":"2024-09-11T00:24:43.631735+0000","last_clean":"2024-09-11T00:24:43.631735+0000","last_became_active":"2024-09-11T00:24:41.375027+0000","last_became_peered":"2024-09-11T00:24:41.375027+0000","last_unstale":"2024-09-11T00:24:43.631735+0000","last_undegraded":"2024-09-11T00:24:43.631735+0000","last_fullsized":"2024-09-11T00:24:43.631735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:40.865470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375938+0000","last_change":"2024-09-11T00:24:42.396111+0000","last_active":"2024-09-11T00:24:43.375938+0000","last_peered":"2024-09-11T00:24:43.375938+0000","last_clean":"2024-09-11T00:24:43.375938+0000","last_became_active":"2024-09-11T00:24:42.395653+0000","last_became_peered":"2024-09-11T00:24:42.395653+0000","last_unstale":"2024-09-11T00:24:43.375938+0000","last_undegraded":"2024-09-11T00:24:43.375938+0000","last_fullsized":"2024-09-11T00:24:43.375938+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:46.896567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.632059+0000","last_change":"2024-09-11T00:24:41.369826+0000","last_active":"2024-09-11T00:24:43.632059+0000","last_peered":"2024-09-11T00:24:43.632059+0000","last_clean":"2024-09-11T00:24:43.632059+0000","last_became_active":"2024-09-11T00:24:41.369533+0000","last_became_peered":"2024-09-11T00:24:41.369533+0000","last_unstale":"2024-09-11T00:24:43.632059+0000","last_undegraded":"2024-09-11T00:24:43.632059+0000","last_fullsized":"2024-09-11T00:24:43.632059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:34.622969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631985+0000","last_change":"2024-09-11T00:24:42.395421+0000","last_active":"2024-09-11T00:24:43.631985+0000","last_peered":"2024-09-11T00:24:43.631985+0000","last_clean":"2024-09-11T00:24:43.631985+0000","last_became_active":"2024-09-11T00:24:42.393767+0000","last_became_peered":"2024-09-11T00:24:42.393767+0000","last_unstale":"2024-09-11T00:24:43.631985+0000","last_undegraded":"2024-09-11T00:24:43.631985+0000","last_fullsized":"2024-09-11T00:24:43.631985+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:25.145153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.406737+0000","last_change":"2024-09-11T00:24:41.373957+0000","last_active":"2024-09-11T00:24:43.406737+0000","last_peered":"2024-09-11T00:24:43.406737+0000","last_clean":"2024-09-11T00:24:43.406737+0000","last_became_active":"2024-09-11T00:24:41.373644+0000","last_became_peered":"2024-09-11T00:24:41.373644+0000","last_unstale":"2024-09-11T00:24:43.406737+0000","last_undegraded":"2024-09-11T00:24:43.406737+0000","last_fullsized":"2024-09-11T00:24:43.406737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:29.892657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.633489+0000","last_change":"2024-09-11T00:24:42.380874+0000","last_active":"2024-09-11T00:24:43.633489+0000","last_peered":"2024-09-11T00:24:43.633489+0000","last_clean":"2024-09-11T00:24:43.633489+0000","last_became_active":"2024-09-11T00:24:42.380613+0000","last_became_peered":"2024-09-11T00:24:42.380613+0000","last_unstale":"2024-09-11T00:24:43.633489+0000","last_undegraded":"2024-09-11T00:24:43.633489+0000","last_fullsized":"2024-09-11T00:24:43.633489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:42.008650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.402533+0000","last_change":"2024-09-11T00:24:41.374040+0000","last_active":"2024-09-11T00:24:43.402533+0000","last_peered":"2024-09-11T00:24:43.402533+0000","last_clean":"2024-09-11T00:24:43.402533+0000","last_became_active":"2024-09-11T00:24:41.373757+0000","last_became_peered":"2024-09-11T00:24:41.373757+0000","last_unstale":"2024-09-11T00:24:43.402533+0000","last_undegraded":"2024-09-11T00:24:43.402533+0000","last_fullsized":"2024-09-11T00:24:43.402533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:29.814276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.402440+0000","last_change":"2024-09-11T00:24:42.381262+0000","last_active":"2024-09-11T00:24:43.402440+0000","last_peered":"2024-09-11T00:24:43.402440+0000","last_clean":"2024-09-11T00:24:43.402440+0000","last_became_active":"2024-09-11T00:24:42.380984+0000","last_became_peered":"2024-09-11T00:24:42.380984+0000","last_unstale":"2024-09-11T00:24:43.402440+0000","last_undegraded":"2024-09-11T00:24:43.402440+0000","last_fullsized":"2024-09-11T00:24:43.402440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:06.007643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.406060+0000","last_change":"2024-09-11T00:24:41.381021+0000","last_active":"2024-09-11T00:24:43.406060+0000","last_peered":"2024-09-11T00:24:43.406060+0000","last_clean":"2024-09-11T00:24:43.406060+0000","last_became_active":"2024-09-11T00:24:41.380749+0000","last_became_peered":"2024-09-11T00:24:41.380749+0000","last_unstale":"2024-09-11T00:24:43.406060+0000","last_undegraded":"2024-09-11T00:24:43.406060+0000","last_fullsized":"2024-09-11T00:24:43.406060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:21:49.397863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.377103+0000","last_change":"2024-09-11T00:24:42.386921+0000","last_active":"2024-09-11T00:24:43.377103+0000","last_peered":"2024-09-11T00:24:43.377103+0000","last_clean":"2024-09-11T00:24:43.377103+0000","last_became_active":"2024-09-11T00:24:42.386618+0000","last_became_peered":"2024-09-11T00:24:42.386618+0000","last_unstale":"2024-09-11T00:24:43.377103+0000","last_undegraded":"2024-09-11T00:24:43.377103+0000","last_fullsized":"2024-09-11T00:24:43.377103+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:43.213311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.402221+0000","last_change":"2024-09-11T00:24:41.371031+0000","last_active":"2024-09-11T00:24:43.402221+0000","last_peered":"2024-09-11T00:24:43.402221+0000","last_clean":"2024-09-11T00:24:43.402221+0000","last_became_active":"2024-09-11T00:24:41.370654+0000","last_became_peered":"2024-09-11T00:24:41.370654+0000","last_unstale":"2024-09-11T00:24:43.402221+0000","last_undegraded":"2024-09-11T00:24:43.402221+0000","last_fullsized":"2024-09-11T00:24:43.402221+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:01.892760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.402175+0000","last_change":"2024-09-11T00:24:42.381473+0000","last_active":"2024-09-11T00:24:43.402175+0000","last_peered":"2024-09-11T00:24:43.402175+0000","last_clean":"2024-09-11T00:24:43.402175+0000","last_became_active":"2024-09-11T00:24:42.381062+0000","last_became_peered":"2024-09-11T00:24:42.381062+0000","last_unstale":"2024-09-11T00:24:43.402175+0000","last_undegraded":"2024-09-11T00:24:43.402175+0000","last_fullsized":"2024-09-11T00:24:43.402175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:19.032418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.405825+0000","last_change":"2024-09-11T00:24:41.373838+0000","last_active":"2024-09-11T00:24:43.405825+0000","last_peered":"2024-09-11T00:24:43.405825+0000","last_clean":"2024-09-11T00:24:43.405825+0000","last_became_active":"2024-09-11T00:24:41.373526+0000","last_became_peered":"2024-09-11T00:24:41.373526+0000","last_unstale":"2024-09-11T00:24:43.405825+0000","last_undegraded":"2024-09-11T00:24:43.405825+0000","last_fullsized":"2024-09-11T00:24:43.405825+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:01.861466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375406+0000","last_change":"2024-09-11T00:24:42.381402+0000","last_active":"2024-09-11T00:24:43.375406+0000","last_peered":"2024-09-11T00:24:43.375406+0000","last_clean":"2024-09-11T00:24:43.375406+0000","last_became_active":"2024-09-11T00:24:42.379830+0000","last_became_peered":"2024-09-11T00:24:42.379830+0000","last_unstale":"2024-09-11T00:24:43.375406+0000","last_undegraded":"2024-09-11T00:24:43.375406+0000","last_fullsized":"2024-09-11T00:24:43.375406+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:13.605779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631851+0000","last_change":"2024-09-11T00:24:41.372846+0000","last_active":"2024-09-11T00:24:43.631851+0000","last_peered":"2024-09-11T00:24:43.631851+0000","last_clean":"2024-09-11T00:24:43.631851+0000","last_became_active":"2024-09-11T00:24:41.371346+0000","last_became_peered":"2024-09-11T00:24:41.371346+0000","last_unstale":"2024-09-11T00:24:43.631851+0000","last_undegraded":"2024-09-11T00:24:43.631851+0000","last_fullsized":"2024-09-11T00:24:43.631851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:01.286926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.631722+0000","last_change":"2024-09-11T00:24:42.388130+0000","last_active":"2024-09-11T00:24:43.631722+0000","last_peered":"2024-09-11T00:24:43.631722+0000","last_clean":"2024-09-11T00:24:43.631722+0000","last_became_active":"2024-09-11T00:24:42.387801+0000","last_became_peered":"2024-09-11T00:24:42.387801+0000","last_unstale":"2024-09-11T00:24:43.631722+0000","last_undegraded":"2024-09-11T00:24:43.631722+0000","last_fullsized":"2024-09-11T00:24:43.631722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:04.833882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.375401+0000","last_change":"2024-09-11T00:24:41.373748+0000","last_active":"2024-09-11T00:24:43.375401+0000","last_peered":"2024-09-11T00:24:43.375401+0000","last_clean":"2024-09-11T00:24:43.375401+0000","last_became_active":"2024-09-11T00:24:41.373149+0000","last_became_peered":"2024-09-11T00:24:41.373149+0000","last_unstale":"2024-09-11T00:24:43.375401+0000","last_undegraded":"2024-09-11T00:24:43.375401+0000","last_fullsized":"2024-09-11T00:24:43.375401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:55.207874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376366+0000","last_change":"2024-09-11T00:24:42.398624+0000","last_active":"2024-09-11T00:24:43.376366+0000","last_peered":"2024-09-11T00:24:43.376366+0000","last_clean":"2024-09-11T00:24:43.376366+0000","last_became_active":"2024-09-11T00:24:42.398169+0000","last_became_peered":"2024-09-11T00:24:42.398169+0000","last_unstale":"2024-09-11T00:24:43.376366+0000","last_undegraded":"2024-09-11T00:24:43.376366+0000","last_fullsized":"2024-09-11T00:24:43.376366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:41.347717+0000","last_clean_scrub_stamp":"2024-09-11T00:24:41.347717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:09.671286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376390+0000","last_change":"2024-09-11T00:24:41.376801+0000","last_active":"2024-09-11T00:24:43.376390+0000","last_peered":"2024-09-11T00:24:43.376390+0000","last_clean":"2024-09-11T00:24:43.376390+0000","last_became_active":"2024-09-11T00:24:41.376493+0000","last_became_peered":"2024-09-11T00:24:41.376493+0000","last_unstale":"2024-09-11T00:24:43.376390+0000","last_undegraded":"2024-09-11T00:24:43.376390+0000","last_fullsized":"2024-09-11T00:24:43.376390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:24:40.342329+0000","last_clean_scrub_stamp":"2024-09-11T00:24:40.342329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:08:39.940691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":136,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-11T00:24:43.376393+0000","last_change":"2024-09-11T00:23:38.923873+0000","last_active":"2024-09-11T00:24:43.376393+0000","last_peered":"2024-09-11T00:24:43.376393+0000","last_clean":"2024-09-11T00:24:43.376393+0000","last_became_active":"2024-09-11T00:23:38.920629+0000","last_became_peered":"2024-09-11T00:23:38.920629+0000","last_unstale":"2024-09-11T00:24:43.376393+0000","last_undegraded":"2024-09-11T00:24:43.376393+0000","last_fullsized":"2024-09-11T00:24:43.376393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_clean_scrub_stamp":"2024-09-11T00:23:37.844553+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.533941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":987136,"data_stored":742424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":397312,"data_stored":152582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":397312,"data_stored":152638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":397312,"data_stored":152070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":405504,"data_stored":153600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":393216,"data_stored":152036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":405504,"data_stored":153600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":983040,"data_stored":742334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:24:51.763 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T00:24:51.763 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T00:24:51.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.963+0000 7fc8c7400640 1 -- 172.21.15.40:0/2189402761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8c00cb060 msgr2=0x7fc8c0073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:51.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.963+0000 7fc8c7400640 1 --2- 172.21.15.40:0/2189402761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8c00cb060 0x7fc8c0073250 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0071d50 tx=0x7fc8b802aac0 comp rx=0 tx=0).stop 2024-09-11T00:24:51.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.963+0000 7fc8c7400640 1 -- 172.21.15.40:0/2189402761 shutdown_connections 2024-09-11T00:24:51.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.963+0000 7fc8c7400640 1 --2- 172.21.15.40:0/2189402761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8c00cb060 0x7fc8c0073250 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:51.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.963+0000 7fc8c7400640 1 --2- 172.21.15.40:0/2189402761 >> v2:172.21.15.175:3300/0 conn(0x7fc8c015e100 0x7fc8c015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:51.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.963+0000 7fc8c7400640 1 -- 172.21.15.40:0/2189402761 >> 172.21.15.40:0/2189402761 conn(0x7fc8c00cfbb0 msgr2=0x7fc8c00cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:51.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.963+0000 7fc8c7400640 1 -- 172.21.15.40:0/2189402761 shutdown_connections 2024-09-11T00:24:51.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.963+0000 7fc8c7400640 1 -- 172.21.15.40:0/2189402761 wait complete. 2024-09-11T00:24:51.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.965+0000 7fc8c7400640 1 Processor -- start 2024-09-11T00:24:51.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.965+0000 7fc8c7400640 1 -- start start 2024-09-11T00:24:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.966+0000 7fc8c7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8c00cb060 0x7fc8c00b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.966+0000 7fc8c7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8c015c3b0 0x7fc8c01563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.966+0000 7fc8c7400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8c015e100 0x7fc8c01f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.966+0000 7fc8c7400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c00739a0 con 0x7fc8c015c3b0 2024-09-11T00:24:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.966+0000 7fc8c7400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c00ca450 con 0x7fc8c00cb060 2024-09-11T00:24:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.966+0000 7fc8c7400640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc8c0073b20 con 0x7fc8c015e100 2024-09-11T00:24:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.966+0000 7fc8b7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8c015c3b0 0x7fc8c01563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.966+0000 7fc8b7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8c015c3b0 0x7fc8c01563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47322/0 (socket says 172.21.15.40:47322) 2024-09-11T00:24:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.966+0000 7fc8b7e00640 1 -- 172.21.15.40:0/500091850 learned_addr learned my addr 172.21.15.40:0/500091850 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.966+0000 7fc8c4a00640 1 --2- 172.21.15.40:0/500091850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8c00cb060 0x7fc8c00b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.967+0000 7fc8c5400640 1 --2- 172.21.15.40:0/500091850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8c015e100 0x7fc8c01f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.967+0000 7fc8b7e00640 1 -- 172.21.15.40:0/500091850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8c015e100 msgr2=0x7fc8c01f2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.967+0000 7fc8b7e00640 1 --2- 172.21.15.40:0/500091850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8c015e100 0x7fc8c01f2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.967+0000 7fc8b7e00640 1 -- 172.21.15.40:0/500091850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8c00cb060 msgr2=0x7fc8c00b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.967+0000 7fc8b7e00640 1 --2- 172.21.15.40:0/500091850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8c00cb060 0x7fc8c00b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.967+0000 7fc8b7e00640 1 -- 172.21.15.40:0/500091850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c01f30e0 con 0x7fc8c015c3b0 2024-09-11T00:24:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.967+0000 7fc8c4a00640 1 --2- 172.21.15.40:0/500091850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8c00cb060 0x7fc8c00b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.967+0000 7fc8b7e00640 1 --2- 172.21.15.40:0/500091850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8c015c3b0 0x7fc8c01563d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800c450 tx=0x7fc8a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:51.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.967+0000 7fc8bd600640 1 -- 172.21.15.40:0/500091850 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a80052d0 con 0x7fc8c015c3b0 2024-09-11T00:24:51.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.967+0000 7fc8bd600640 1 -- 172.21.15.40:0/500091850 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8a8005470 con 0x7fc8c015c3b0 2024-09-11T00:24:51.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.967+0000 7fc8bd600640 1 -- 172.21.15.40:0/500091850 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8012870 con 0x7fc8c015c3b0 2024-09-11T00:24:51.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.967+0000 7fc8c7400640 1 -- 172.21.15.40:0/500091850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c01f3380 con 0x7fc8c015c3b0 2024-09-11T00:24:51.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.967+0000 7fc8c7400640 1 -- 172.21.15.40:0/500091850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c01f3940 con 0x7fc8c015c3b0 2024-09-11T00:24:51.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.968+0000 7fc8c7400640 1 -- 172.21.15.40:0/500091850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8c0073250 con 0x7fc8c015c3b0 2024-09-11T00:24:51.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.970+0000 7fc8bd600640 1 -- 172.21.15.40:0/500091850 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc8a80035f0 con 0x7fc8c015c3b0 2024-09-11T00:24:51.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.970+0000 7fc8bd600640 1 --2- 172.21.15.40:0/500091850 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc89c077fa0 0x7fc89c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:51.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.971+0000 7fc8bd600640 1 -- 172.21.15.40:0/500091850 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fc8a8099820 con 0x7fc8c015c3b0 2024-09-11T00:24:51.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.971+0000 7fc8c4a00640 1 --2- 172.21.15.40:0/500091850 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc89c077fa0 0x7fc89c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:51.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.971+0000 7fc8c4a00640 1 --2- 172.21.15.40:0/500091850 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc89c077fa0 0x7fc89c07a460 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0005fd0 tx=0x7fc8b0005850 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:51.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:51.975+0000 7fc8bd600640 1 -- 172.21.15.40:0/500091850 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc8a80623b0 con 0x7fc8c015c3b0 2024-09-11T00:24:52.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.240+0000 7fc8c7400640 1 -- 172.21.15.40:0/500091850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc8c00b29e0 con 0x7fc8c015c3b0 2024-09-11T00:24:52.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.243+0000 7fc8bd600640 1 -- 172.21.15.40:0/500091850 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7fc8a8061cb0 con 0x7fc8c015c3b0 2024-09-11T00:24:52.245 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2024-09-11T00:24:52.245 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDW4uBmjUo6FRAAR+2yK++OAaoLfSv+n2079Q== 2024-09-11T00:24:52.245 INFO:teuthology.orchestra.run.smithi040.stdout: caps mds = "allow" 2024-09-11T00:24:52.245 INFO:teuthology.orchestra.run.smithi040.stdout: caps mon = "allow r" 2024-09-11T00:24:52.245 INFO:teuthology.orchestra.run.smithi040.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T00:24:52.246 INFO:teuthology.orchestra.run.smithi040.stderr:updated caps for client.0 2024-09-11T00:24:52.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.245+0000 7fc8c7400640 1 -- 172.21.15.40:0/500091850 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc89c077fa0 msgr2=0x7fc89c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:52.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.245+0000 7fc8c7400640 1 --2- 172.21.15.40:0/500091850 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc89c077fa0 0x7fc89c07a460 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0005fd0 tx=0x7fc8b0005850 comp rx=0 tx=0).stop 2024-09-11T00:24:52.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.245+0000 7fc8c7400640 1 -- 172.21.15.40:0/500091850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8c015c3b0 msgr2=0x7fc8c01563d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:52.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.245+0000 7fc8c7400640 1 --2- 172.21.15.40:0/500091850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8c015c3b0 0x7fc8c01563d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800c450 tx=0x7fc8a800c910 comp rx=0 tx=0).stop 2024-09-11T00:24:52.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.245+0000 7fc8c7400640 1 -- 172.21.15.40:0/500091850 shutdown_connections 2024-09-11T00:24:52.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.245+0000 7fc8c7400640 1 --2- 172.21.15.40:0/500091850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8c015e100 0x7fc8c01f2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:52.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.245+0000 7fc8c7400640 1 --2- 172.21.15.40:0/500091850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8c015c3b0 0x7fc8c01563d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:52.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.245+0000 7fc8c7400640 1 --2- 172.21.15.40:0/500091850 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc89c077fa0 0x7fc89c07a460 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:52.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.245+0000 7fc8c7400640 1 --2- 172.21.15.40:0/500091850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8c00cb060 0x7fc8c00b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:52.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.245+0000 7fc8c7400640 1 -- 172.21.15.40:0/500091850 >> 172.21.15.40:0/500091850 conn(0x7fc8c00cfbb0 msgr2=0x7fc8c0075840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:52.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.245+0000 7fc8c7400640 1 -- 172.21.15.40:0/500091850 shutdown_connections 2024-09-11T00:24:52.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.245+0000 7fc8c7400640 1 -- 172.21.15.40:0/500091850 wait complete. 2024-09-11T00:24:52.264 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:24:52.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.422+0000 7f77ae800640 1 -- 172.21.15.40:0/1469159271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77a806e550 msgr2=0x7f77a806ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:52.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.422+0000 7f77ae800640 1 --2- 172.21.15.40:0/1469159271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77a806e550 0x7f77a806ea00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f77a0005fd0 tx=0x7f77a002aa00 comp rx=0 tx=0).stop 2024-09-11T00:24:52.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.422+0000 7f77ae800640 1 -- 172.21.15.40:0/1469159271 shutdown_connections 2024-09-11T00:24:52.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.422+0000 7f77ae800640 1 --2- 172.21.15.40:0/1469159271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77a806e550 0x7f77a806ea00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:52.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.422+0000 7f77ae800640 1 --2- 172.21.15.40:0/1469159271 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77a80ca200 0x7f77a80ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:52.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.422+0000 7f77ae800640 1 -- 172.21.15.40:0/1469159271 >> 172.21.15.40:0/1469159271 conn(0x7f77a80cfbb0 msgr2=0x7f77a80cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:52.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.422+0000 7f77ae800640 1 -- 172.21.15.40:0/1469159271 shutdown_connections 2024-09-11T00:24:52.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.422+0000 7f77ae800640 1 -- 172.21.15.40:0/1469159271 wait complete. 2024-09-11T00:24:52.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.424+0000 7f77ae800640 1 Processor -- start 2024-09-11T00:24:52.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.424+0000 7f77ae800640 1 -- start start 2024-09-11T00:24:52.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.425+0000 7f77ae800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77a806e550 0x7f77a814c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:52.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.425+0000 7f77ae800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77a80ca200 0x7f77a8158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:52.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.425+0000 7f77ae800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77a815ad80 0x7f77a8158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:52.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.425+0000 7f77ae800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f77a80cf320 con 0x7f77a815ad80 2024-09-11T00:24:52.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.425+0000 7f77ae800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f77a80d08d0 con 0x7f77a806e550 2024-09-11T00:24:52.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.425+0000 7f77ae800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f77a815b1e0 con 0x7f77a80ca200 2024-09-11T00:24:52.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.425+0000 7f77a7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77a815ad80 0x7f77a8158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:52.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.425+0000 7f77a7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77a815ad80 0x7f77a8158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47336/0 (socket says 172.21.15.40:47336) 2024-09-11T00:24:52.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.425+0000 7f77a7e00640 1 -- 172.21.15.40:0/1688229679 learned_addr learned my addr 172.21.15.40:0/1688229679 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:52.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.425+0000 7f779fe00640 1 --2- 172.21.15.40:0/1688229679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77a80ca200 0x7f77a8158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:52.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.425+0000 7f77a7400640 1 --2- 172.21.15.40:0/1688229679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77a806e550 0x7f77a814c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:52.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.426+0000 7f77a7e00640 1 -- 172.21.15.40:0/1688229679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77a80ca200 msgr2=0x7f77a8158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:52.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.426+0000 7f77a7e00640 1 --2- 172.21.15.40:0/1688229679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77a80ca200 0x7f77a8158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:52.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.426+0000 7f77a7e00640 1 -- 172.21.15.40:0/1688229679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77a806e550 msgr2=0x7f77a814c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:52.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.426+0000 7f77a7e00640 1 --2- 172.21.15.40:0/1688229679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77a806e550 0x7f77a814c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:52.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.426+0000 7f77a7e00640 1 -- 172.21.15.40:0/1688229679 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a8149a50 con 0x7f77a815ad80 2024-09-11T00:24:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.426+0000 7f77a7e00640 1 --2- 172.21.15.40:0/1688229679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77a815ad80 0x7f77a8158ff0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f77a0006010 tx=0x7f77a0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.426+0000 7f779f400640 1 -- 172.21.15.40:0/1688229679 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a0047070 con 0x7f77a815ad80 2024-09-11T00:24:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.426+0000 7f779f400640 1 -- 172.21.15.40:0/1688229679 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77a0004250 con 0x7f77a815ad80 2024-09-11T00:24:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.426+0000 7f779f400640 1 -- 172.21.15.40:0/1688229679 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a0033050 con 0x7f77a815ad80 2024-09-11T00:24:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.426+0000 7f77ae800640 1 -- 172.21.15.40:0/1688229679 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a80af270 con 0x7f77a815ad80 2024-09-11T00:24:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.427+0000 7f77ae800640 1 -- 172.21.15.40:0/1688229679 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a80ae220 con 0x7f77a815ad80 2024-09-11T00:24:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.428+0000 7f77ae800640 1 -- 172.21.15.40:0/1688229679 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77a80b58a0 con 0x7f77a815ad80 2024-09-11T00:24:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.429+0000 7f779f400640 1 -- 172.21.15.40:0/1688229679 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f77a0004660 con 0x7f77a815ad80 2024-09-11T00:24:52.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.430+0000 7f779f400640 1 --2- 172.21.15.40:0/1688229679 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7784077f70 0x7f778407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:52.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.430+0000 7f779f400640 1 -- 172.21.15.40:0/1688229679 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f77a00bb1d0 con 0x7f77a815ad80 2024-09-11T00:24:52.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.430+0000 7f77a7400640 1 --2- 172.21.15.40:0/1688229679 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7784077f70 0x7f778407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:52.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.431+0000 7f77a7400640 1 --2- 172.21.15.40:0/1688229679 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7784077f70 0x7f778407a430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f779800bbe0 tx=0x7f779800b390 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:52.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.434+0000 7f779f400640 1 -- 172.21.15.40:0/1688229679 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f77a80b58a0 con 0x7f77a815ad80 2024-09-11T00:24:52.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.664+0000 7f77ae800640 1 -- 172.21.15.40:0/1688229679 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77a80b5b30 con 0x7f77a815ad80 2024-09-11T00:24:52.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.665+0000 7f779f400640 1 -- 172.21.15.40:0/1688229679 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7f77a00835e0 con 0x7f77a815ad80 2024-09-11T00:24:52.668 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:52.668 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"btime":"2024-09-11T00:24:45:383933+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2499570202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2499570202},{"type":"v1","addr":"172.21.15.40:6835","nonce":2499570202}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4885,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2232689934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2232689934},{"type":"v1","addr":"172.21.15.175:6836","nonce":2232689934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/4012257321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":4012257321},{"type":"v1","addr":"172.21.15.175:6837","nonce":4012257321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:24:41.799375+0000","modified":"2024-09-11T00:24:44.819725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/2666966234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2666966234},{"type":"v1","addr":"172.21.15.40:6834","nonce":2666966234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4944,"qdb_cluster":[4944]},"id":2}]} 2024-09-11T00:24:52.668 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 16 2024-09-11T00:24:52.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.667+0000 7f77ae800640 1 -- 172.21.15.40:0/1688229679 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7784077f70 msgr2=0x7f778407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:52.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.667+0000 7f77ae800640 1 --2- 172.21.15.40:0/1688229679 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7784077f70 0x7f778407a430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f779800bbe0 tx=0x7f779800b390 comp rx=0 tx=0).stop 2024-09-11T00:24:52.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.667+0000 7f77ae800640 1 -- 172.21.15.40:0/1688229679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77a815ad80 msgr2=0x7f77a8158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:52.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.667+0000 7f77ae800640 1 --2- 172.21.15.40:0/1688229679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77a815ad80 0x7f77a8158ff0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f77a0006010 tx=0x7f77a0003f10 comp rx=0 tx=0).stop 2024-09-11T00:24:52.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.667+0000 7f77ae800640 1 -- 172.21.15.40:0/1688229679 shutdown_connections 2024-09-11T00:24:52.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.667+0000 7f77ae800640 1 --2- 172.21.15.40:0/1688229679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77a815ad80 0x7f77a8158ff0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:52.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.667+0000 7f77ae800640 1 --2- 172.21.15.40:0/1688229679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77a80ca200 0x7f77a8158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:52.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.667+0000 7f77ae800640 1 --2- 172.21.15.40:0/1688229679 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f7784077f70 0x7f778407a430 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:52.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.667+0000 7f77ae800640 1 --2- 172.21.15.40:0/1688229679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77a806e550 0x7f77a814c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:52.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.667+0000 7f77ae800640 1 -- 172.21.15.40:0/1688229679 >> 172.21.15.40:0/1688229679 conn(0x7f77a80cfbb0 msgr2=0x7f77a815b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:52.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.667+0000 7f77ae800640 1 -- 172.21.15.40:0/1688229679 shutdown_connections 2024-09-11T00:24:52.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:52.668+0000 7f77ae800640 1 -- 172.21.15.40:0/1688229679 wait complete. 2024-09-11T00:24:53.089 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T00:24:41.799375+0000', 'modified': '2024-09-11T00:24:44.819725+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4944}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4944': {'gid': 4944, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6834/2666966234', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6832', 'nonce': 2666966234}, {'type': 'v1', 'addr': '172.21.15.40:6834', 'nonce': 2666966234}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4944, 'qdb_cluster': [4944]} 2024-09-11T00:24:53.089 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T00:24:53.089 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T00:24:53.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.250+0000 7faa41800640 1 -- 172.21.15.40:0/2730429620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa20003fd0 msgr2=0x7faa20004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:53.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.250+0000 7faa41800640 1 --2- 172.21.15.40:0/2730429620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa20003fd0 0x7faa20004800 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7faa24009b80 tx=0x7faa20005830 comp rx=0 tx=0).stop 2024-09-11T00:24:53.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.250+0000 7faa3b400640 1 -- 172.21.15.40:0/2730429620 reap_dead start 2024-09-11T00:24:53.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.250+0000 7faa41800640 1 -- 172.21.15.40:0/2730429620 shutdown_connections 2024-09-11T00:24:53.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.250+0000 7faa41800640 1 -- 172.21.15.40:0/2730429620 >> 172.21.15.40:0/2730429620 conn(0x7faa3c0cfbb0 msgr2=0x7faa3c0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:53.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.251+0000 7faa41800640 1 -- 172.21.15.40:0/2730429620 shutdown_connections 2024-09-11T00:24:53.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.251+0000 7faa41800640 1 -- 172.21.15.40:0/2730429620 wait complete. 2024-09-11T00:24:53.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.252+0000 7faa41800640 1 Processor -- start 2024-09-11T00:24:53.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.252+0000 7faa41800640 1 -- start start 2024-09-11T00:24:53.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.253+0000 7faa41800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa20003fd0 0x7faa3c072a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.253+0000 7faa41800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa3c0b3430 0x7faa3c073380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.253+0000 7faa41800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa3c06f3e0 0x7faa3c06f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.253+0000 7faa41800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c0cdf40 con 0x7faa3c0b3430 2024-09-11T00:24:53.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.253+0000 7faa41800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c0cddc0 con 0x7faa20003fd0 2024-09-11T00:24:53.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.253+0000 7faa41800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faa3c165d20 con 0x7faa3c06f3e0 2024-09-11T00:24:53.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.253+0000 7faa32000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa3c0b3430 0x7faa3c073380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.253+0000 7faa32000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa3c0b3430 0x7faa3c073380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47350/0 (socket says 172.21.15.40:47350) 2024-09-11T00:24:53.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.253+0000 7faa32000640 1 -- 172.21.15.40:0/1964819910 learned_addr learned my addr 172.21.15.40:0/1964819910 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:53.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.254+0000 7faa3b400640 1 --2- 172.21.15.40:0/1964819910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa3c06f3e0 0x7faa3c06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.254+0000 7faa3aa00640 1 --2- 172.21.15.40:0/1964819910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa20003fd0 0x7faa3c072a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.254+0000 7faa32000640 1 -- 172.21.15.40:0/1964819910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa3c06f3e0 msgr2=0x7faa3c06f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:53.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.254+0000 7faa32000640 1 --2- 172.21.15.40:0/1964819910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa3c06f3e0 0x7faa3c06f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.254+0000 7faa32000640 1 -- 172.21.15.40:0/1964819910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa20003fd0 msgr2=0x7faa3c072a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:53.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.254+0000 7faa32000640 1 --2- 172.21.15.40:0/1964819910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa20003fd0 0x7faa3c072a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.254+0000 7faa32000640 1 -- 172.21.15.40:0/1964819910 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3c0b38b0 con 0x7faa3c0b3430 2024-09-11T00:24:53.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.254+0000 7faa3aa00640 1 --2- 172.21.15.40:0/1964819910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa20003fd0 0x7faa3c072a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:53.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.254+0000 7faa32000640 1 --2- 172.21.15.40:0/1964819910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa3c0b3430 0x7faa3c073380 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7faa24036040 tx=0x7faa24033c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:53.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.254+0000 7faa33400640 1 -- 172.21.15.40:0/1964819910 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa24038040 con 0x7faa3c0b3430 2024-09-11T00:24:53.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.254+0000 7faa33400640 1 -- 172.21.15.40:0/1964819910 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa24041070 con 0x7faa3c0b3430 2024-09-11T00:24:53.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.254+0000 7faa33400640 1 -- 172.21.15.40:0/1964819910 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2403c7c0 con 0x7faa3c0b3430 2024-09-11T00:24:53.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.254+0000 7faa41800640 1 -- 172.21.15.40:0/1964819910 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa3c073ad0 con 0x7faa3c0b3430 2024-09-11T00:24:53.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.255+0000 7faa41800640 1 -- 172.21.15.40:0/1964819910 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa3c0b2c30 con 0x7faa3c0b3430 2024-09-11T00:24:53.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.257+0000 7faa33400640 1 -- 172.21.15.40:0/1964819910 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7faa2403b070 con 0x7faa3c0b3430 2024-09-11T00:24:53.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.258+0000 7faa33400640 1 --2- 172.21.15.40:0/1964819910 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7faa18077fa0 0x7faa1807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.258+0000 7faa33400640 1 -- 172.21.15.40:0/1964819910 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7faa240ba900 con 0x7faa3c0b3430 2024-09-11T00:24:53.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.258+0000 7faa445e9740 1 Processor -- start 2024-09-11T00:24:53.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.258+0000 7faa445e9740 1 -- start start 2024-09-11T00:24:53.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.258+0000 7faa3aa00640 1 --2- 172.21.15.40:0/1964819910 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7faa18077fa0 0x7faa1807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.259+0000 7faa445e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685af8b0 0x5609685afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.259+0000 7faa445e9740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56096856aa20 0x5609685ae390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.259+0000 7faa445e9740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 0x5609685ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.259+0000 7faa445e9740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5609684ed430 con 0x56096856afa0 2024-09-11T00:24:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.259+0000 7faa445e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5609684dd5d0 con 0x5609685af8b0 2024-09-11T00:24:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.259+0000 7faa445e9740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x5609684cca00 con 0x56096856aa20 2024-09-11T00:24:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.259+0000 7faa3aa00640 1 --2- 172.21.15.40:0/1964819910 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7faa18077fa0 0x7faa1807a460 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faa2c001880 tx=0x7faa2c000f50 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.259+0000 7faa3b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 0x5609685ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.259+0000 7faa3aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685af8b0 0x5609685afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.259+0000 7faa3b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 0x5609685ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47352/0 (socket says 172.21.15.40:47352) 2024-09-11T00:24:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.259+0000 7faa3b400640 1 -- 172.21.15.40:0/709691183 learned_addr learned my addr 172.21.15.40:0/709691183 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.259+0000 7faa32000640 1 --2- 172.21.15.40:0/709691183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56096856aa20 0x5609685ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.260+0000 7faa3b400640 1 -- 172.21.15.40:0/709691183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56096856aa20 msgr2=0x5609685ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.260+0000 7faa3b400640 1 --2- 172.21.15.40:0/709691183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56096856aa20 0x5609685ae390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.260+0000 7faa3b400640 1 -- 172.21.15.40:0/709691183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685af8b0 msgr2=0x5609685afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.260+0000 7faa3b400640 1 --2- 172.21.15.40:0/709691183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685af8b0 0x5609685afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.260+0000 7faa3b400640 1 -- 172.21.15.40:0/709691183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560968495520 con 0x56096856afa0 2024-09-11T00:24:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.260+0000 7faa3b400640 1 --2- 172.21.15.40:0/709691183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 0x5609685ae8d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0d0cb0 tx=0x7faa34003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e02c5ff18206163 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.260+0000 7faa2b400640 1 -- 172.21.15.40:0/709691183 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa34004710 con 0x56096856afa0 2024-09-11T00:24:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.260+0000 7faa2b400640 1 -- 172.21.15.40:0/709691183 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa3401b440 con 0x56096856afa0 2024-09-11T00:24:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.260+0000 7faa2b400640 1 -- 172.21.15.40:0/709691183 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3401b890 con 0x56096856afa0 2024-09-11T00:24:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.261+0000 7faa445e9740 1 -- 172.21.15.40:0/709691183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 msgr2=0x5609685ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.261+0000 7faa445e9740 1 --2- 172.21.15.40:0/709691183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 0x5609685ae8d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0d0cb0 tx=0x7faa34003d40 comp rx=0 tx=0).stop 2024-09-11T00:24:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.261+0000 7faa445e9740 1 -- 172.21.15.40:0/709691183 shutdown_connections 2024-09-11T00:24:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.261+0000 7faa445e9740 1 --2- 172.21.15.40:0/709691183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 0x5609685ae8d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.261+0000 7faa445e9740 1 --2- 172.21.15.40:0/709691183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56096856aa20 0x5609685ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.261+0000 7faa445e9740 1 --2- 172.21.15.40:0/709691183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685af8b0 0x5609685afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.261+0000 7faa445e9740 1 -- 172.21.15.40:0/709691183 >> 172.21.15.40:0/709691183 conn(0x560968565ff0 msgr2=0x560968569a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.261+0000 7faa445e9740 1 -- 172.21.15.40:0/709691183 shutdown_connections 2024-09-11T00:24:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.261+0000 7faa445e9740 1 -- 172.21.15.40:0/709691183 wait complete. 2024-09-11T00:24:53.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.262+0000 7faa445e9740 1 -- start start 2024-09-11T00:24:53.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.262+0000 7faa445e9740 1 Processor -- start 2024-09-11T00:24:53.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.263+0000 7faa445e9740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56096856afa0 0x5609685bf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.263+0000 7faa445e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685af8b0 0x56096858df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.263+0000 7faa445e9740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5609685a66f0 0x5609685a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.263+0000 7faa445e9740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x560968473330 con 0x5609685a66f0 2024-09-11T00:24:53.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.263+0000 7faa445e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5609684d0810 con 0x5609685af8b0 2024-09-11T00:24:53.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.263+0000 7faa445e9740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x56096823d620 con 0x56096856afa0 2024-09-11T00:24:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.263+0000 7faa445e9740 10 client.0 _ll_register_callbacks cb 0x560968478420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:24:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.263+0000 7faa3b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5609685a66f0 0x5609685a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.263+0000 7faa3b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5609685a66f0 0x5609685a6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47364/0 (socket says 172.21.15.40:47364) 2024-09-11T00:24:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.263+0000 7faa3b400640 1 -- 172.21.15.40:0/979375716 learned_addr learned my addr 172.21.15.40:0/979375716 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.263+0000 7faa3aa00640 1 --2- 172.21.15.40:0/979375716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56096856afa0 0x5609685bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.263+0000 7faa32000640 1 --2- 172.21.15.40:0/979375716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685af8b0 0x56096858df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.264+0000 7faa3b400640 1 -- 172.21.15.40:0/979375716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56096856afa0 msgr2=0x5609685bf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.264+0000 7faa3b400640 1 --2- 172.21.15.40:0/979375716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56096856afa0 0x5609685bf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.264+0000 7faa3b400640 1 -- 172.21.15.40:0/979375716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685af8b0 msgr2=0x56096858df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.264+0000 7faa3b400640 1 --2- 172.21.15.40:0/979375716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685af8b0 0x56096858df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.264+0000 7faa3b400640 1 -- 172.21.15.40:0/979375716 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56096822e850 con 0x5609685a66f0 2024-09-11T00:24:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.264+0000 7faa32000640 1 --2- 172.21.15.40:0/979375716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685af8b0 0x56096858df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.264+0000 7faa3b400640 1 --2- 172.21.15.40:0/979375716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5609685a66f0 0x5609685a6b70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x5609685b0f30 tx=0x7faa3401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe01851a339c286 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.264+0000 7faa1fe00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-09-11T00:24:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.264+0000 7faa1fe00640 1 -- 172.21.15.40:0/979375716 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3402a060 con 0x5609685a66f0 2024-09-11T00:24:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.264+0000 7faa1fe00640 1 -- 172.21.15.40:0/979375716 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7faa3401cbb0 con 0x5609685a66f0 2024-09-11T00:24:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.264+0000 7faa445e9740 1 -- 172.21.15.40:0/979375716 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa3401b440 con 0x5609685a66f0 2024-09-11T00:24:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.265+0000 7faa1fe00640 1 -- 172.21.15.40:0/979375716 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7faa34030050 con 0x5609685a66f0 2024-09-11T00:24:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.265+0000 7faa445e9740 10 client.5133 fetch_fsmap learned FSMap version 16 2024-09-11T00:24:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.265+0000 7faa445e9740 1 -- 172.21.15.40:0/979375716 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5609682a56b0 con 0x5609685a66f0 2024-09-11T00:24:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.265+0000 7faa1fe00640 1 -- 172.21.15.40:0/979375716 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa3401b440 con 0x5609685a66f0 2024-09-11T00:24:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.265+0000 7faa1fe00640 1 -- 172.21.15.40:0/979375716 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7faa34033020 con 0x5609685a66f0 2024-09-11T00:24:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.265+0000 7faa445e9740 10 client.5133 fetch_fsmap finished waiting for FSMap version 16 2024-09-11T00:24:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.265+0000 7faa445e9740 10 client.5133 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T00:24:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.265+0000 7faa445e9740 20 client.5133 populate_metadata read hostname 'smithi040' 2024-09-11T00:24:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.265+0000 7faa445e9740 1 --2- 172.21.15.40:0/979375716 >> [v2:172.21.15.40:6832/2666966234,v1:172.21.15.40:6834/2666966234] conn(0x5609685bed20 0x5609685bf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.265+0000 7faa445e9740 4 client.5133 mds_command: new command op to 4944 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:24:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.265+0000 7faa445e9740 1 -- 172.21.15.40:0/979375716 --> [v2:172.21.15.40:6832/2666966234,v1:172.21.15.40:6834/2666966234] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609684df520 con 0x5609685bed20 2024-09-11T00:24:53.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.265+0000 7faa3aa00640 1 --2- 172.21.15.40:0/979375716 >> [v2:172.21.15.40:6832/2666966234,v1:172.21.15.40:6834/2666966234] conn(0x5609685bed20 0x5609685bf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.266+0000 7faa3aa00640 1 --2- 172.21.15.40:0/979375716 >> [v2:172.21.15.40:6832/2666966234,v1:172.21.15.40:6834/2666966234] conn(0x5609685bed20 0x5609685bf100 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f119397c99b91cee server_cookie=529b5841df12a469 in_seq=0 out_seq=0 2024-09-11T00:24:53.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.266+0000 7faa1fe00640 10 client.5133 ms_handle_connect on v2:172.21.15.40:6832/2666966234 2024-09-11T00:24:53.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.267+0000 7faa1fe00640 1 -- 172.21.15.40:0/979375716 <== mds.0 v2:172.21.15.40:6832/2666966234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5609684df520 con 0x5609685bed20 2024-09-11T00:24:53.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.267+0000 7faa1fe00640 10 client.5133 handle_command_reply: tid=0 2024-09-11T00:24:53.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.267+0000 7faa445e9740 1 client.5133 shutdown 2024-09-11T00:24:53.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.267+0000 7faa445e9740 1 -- 172.21.15.40:0/979375716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5609685a66f0 msgr2=0x5609685a6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:53.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.267+0000 7faa445e9740 1 --2- 172.21.15.40:0/979375716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5609685a66f0 0x5609685a6b70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x5609685b0f30 tx=0x7faa3401c830 comp rx=0 tx=0).stop 2024-09-11T00:24:53.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.267+0000 7faa445e9740 1 -- 172.21.15.40:0/979375716 shutdown_connections 2024-09-11T00:24:53.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.267+0000 7faa445e9740 1 --2- 172.21.15.40:0/979375716 >> [v2:172.21.15.40:6832/2666966234,v1:172.21.15.40:6834/2666966234] conn(0x5609685bed20 0x5609685bf100 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.267+0000 7faa445e9740 1 --2- 172.21.15.40:0/979375716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5609685a66f0 0x5609685a6b70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.267+0000 7faa445e9740 1 --2- 172.21.15.40:0/979375716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685af8b0 0x56096858df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.267+0000 7faa445e9740 1 --2- 172.21.15.40:0/979375716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56096856afa0 0x5609685bf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.267+0000 7faa1fe00640 0 client.5133 ms_handle_reset on v2:172.21.15.40:6832/2666966234 2024-09-11T00:24:53.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.267+0000 7faa445e9740 1 -- 172.21.15.40:0/979375716 >> 172.21.15.40:0/979375716 conn(0x56096856aa20 msgr2=0x560968590180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:53.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.267+0000 7faa445e9740 1 -- 172.21.15.40:0/979375716 shutdown_connections 2024-09-11T00:24:53.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.267+0000 7faa445e9740 1 -- 172.21.15.40:0/979375716 wait complete. 2024-09-11T00:24:53.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.267+0000 7faa445e9740 20 client.5133 trim_cache size 0 max 16384 2024-09-11T00:24:53.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.287+0000 7faa445e9740 1 Processor -- start 2024-09-11T00:24:53.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.287+0000 7faa445e9740 1 -- start start 2024-09-11T00:24:53.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.287+0000 7faa445e9740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 0x56096855f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.287+0000 7faa445e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685a66f0 0x560968593920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.287+0000 7faa445e9740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609685af8b0 0x5609685a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.287+0000 7faa445e9740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c201850 con 0x56096856afa0 2024-09-11T00:24:53.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.287+0000 7faa445e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c200850 con 0x5609685a66f0 2024-09-11T00:24:53.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.287+0000 7faa445e9740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faa3c1ffd10 con 0x5609685af8b0 2024-09-11T00:24:53.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.288+0000 7faa3aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 0x56096855f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.288+0000 7faa3aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 0x56096855f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47370/0 (socket says 172.21.15.40:47370) 2024-09-11T00:24:53.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.288+0000 7faa3aa00640 1 -- 172.21.15.40:0/3565133709 learned_addr learned my addr 172.21.15.40:0/3565133709 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:53.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.288+0000 7faa32000640 1 --2- 172.21.15.40:0/3565133709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685a66f0 0x560968593920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.288+0000 7faa3b400640 1 --2- 172.21.15.40:0/3565133709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609685af8b0 0x5609685a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.288+0000 7faa3aa00640 1 -- 172.21.15.40:0/3565133709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609685af8b0 msgr2=0x5609685a6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:53.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.288+0000 7faa3aa00640 1 --2- 172.21.15.40:0/3565133709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609685af8b0 0x5609685a6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.288+0000 7faa3aa00640 1 -- 172.21.15.40:0/3565133709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685a66f0 msgr2=0x560968593920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:53.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.288+0000 7faa3aa00640 1 --2- 172.21.15.40:0/3565133709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685a66f0 0x560968593920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.288+0000 7faa3aa00640 1 -- 172.21.15.40:0/3565133709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560968569560 con 0x56096856afa0 2024-09-11T00:24:53.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.288+0000 7faa32000640 1 --2- 172.21.15.40:0/3565133709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685a66f0 0x560968593920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:53.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.288+0000 7faa3aa00640 1 --2- 172.21.15.40:0/3565133709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 0x56096855f690 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x5609685beca0 tx=0x7faa2c00d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c840f6a52105330 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:53.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.289+0000 7faa2aa00640 1 -- 172.21.15.40:0/3565133709 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c0035f0 con 0x56096856afa0 2024-09-11T00:24:53.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.289+0000 7faa2aa00640 1 -- 172.21.15.40:0/3565133709 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa2c003790 con 0x56096856afa0 2024-09-11T00:24:53.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.289+0000 7faa2aa00640 1 -- 172.21.15.40:0/3565133709 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c003980 con 0x56096856afa0 2024-09-11T00:24:53.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.289+0000 7faa445e9740 1 -- 172.21.15.40:0/3565133709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 msgr2=0x56096855f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:53.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.289+0000 7faa445e9740 1 --2- 172.21.15.40:0/3565133709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 0x56096855f690 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x5609685beca0 tx=0x7faa2c00d000 comp rx=0 tx=0).stop 2024-09-11T00:24:53.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.289+0000 7faa445e9740 1 -- 172.21.15.40:0/3565133709 shutdown_connections 2024-09-11T00:24:53.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.289+0000 7faa445e9740 1 --2- 172.21.15.40:0/3565133709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609685af8b0 0x5609685a6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.289+0000 7faa445e9740 1 --2- 172.21.15.40:0/3565133709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685a66f0 0x560968593920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.289+0000 7faa445e9740 1 --2- 172.21.15.40:0/3565133709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 0x56096855f690 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.289+0000 7faa445e9740 1 -- 172.21.15.40:0/3565133709 >> 172.21.15.40:0/3565133709 conn(0x56096856aa20 msgr2=0x5609685c1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:53.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.289+0000 7faa445e9740 1 -- 172.21.15.40:0/3565133709 shutdown_connections 2024-09-11T00:24:53.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.289+0000 7faa445e9740 1 -- 172.21.15.40:0/3565133709 wait complete. 2024-09-11T00:24:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.290+0000 7faa445e9740 1 -- start start 2024-09-11T00:24:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.290+0000 7faa445e9740 1 Processor -- start 2024-09-11T00:24:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.291+0000 7faa445e9740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 0x5609685a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.291+0000 7faa445e9740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609685a66f0 0x5609685a7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.291+0000 7faa445e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685af8b0 0x56096862f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.291+0000 7faa445e9740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5609685a61d0 con 0x56096856afa0 2024-09-11T00:24:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.291+0000 7faa445e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c200200 con 0x5609685af8b0 2024-09-11T00:24:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.291+0000 7faa445e9740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x5609685c0030 con 0x5609685a66f0 2024-09-11T00:24:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.291+0000 7faa445e9740 10 client.0 _ll_register_callbacks cb 0x7faa34009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:24:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.291+0000 7faa3aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 0x5609685a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.291+0000 7faa3aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 0x5609685a6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47384/0 (socket says 172.21.15.40:47384) 2024-09-11T00:24:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.291+0000 7faa3aa00640 1 -- 172.21.15.40:0/1696630122 learned_addr learned my addr 172.21.15.40:0/1696630122 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.291+0000 7faa32000640 1 --2- 172.21.15.40:0/1696630122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609685a66f0 0x5609685a7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.291+0000 7faa3b400640 1 --2- 172.21.15.40:0/1696630122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685af8b0 0x56096862f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.292+0000 7faa3aa00640 1 -- 172.21.15.40:0/1696630122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609685a66f0 msgr2=0x5609685a7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:53.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.292+0000 7faa3aa00640 1 --2- 172.21.15.40:0/1696630122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609685a66f0 0x5609685a7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.292+0000 7faa3aa00640 1 -- 172.21.15.40:0/1696630122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685af8b0 msgr2=0x56096862f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:53.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.292+0000 7faa3aa00640 1 --2- 172.21.15.40:0/1696630122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685af8b0 0x56096862f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.292+0000 7faa3aa00640 1 -- 172.21.15.40:0/1696630122 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609685903b0 con 0x56096856afa0 2024-09-11T00:24:53.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.292+0000 7faa3b400640 1 --2- 172.21.15.40:0/1696630122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685af8b0 0x56096862f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:53.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.292+0000 7faa32000640 1 --2- 172.21.15.40:0/1696630122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609685a66f0 0x5609685a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:53.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.292+0000 7faa3aa00640 1 --2- 172.21.15.40:0/1696630122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 0x5609685a6ad0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7faa2c004520 tx=0x7faa2c004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530d93e2f49b4468 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:53.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.292+0000 7faa1fe00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-09-11T00:24:53.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.292+0000 7faa1fe00640 1 -- 172.21.15.40:0/1696630122 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c003c10 con 0x56096856afa0 2024-09-11T00:24:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.292+0000 7faa1fe00640 1 -- 172.21.15.40:0/1696630122 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7faa2c003db0 con 0x56096856afa0 2024-09-11T00:24:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.292+0000 7faa445e9740 1 -- 172.21.15.40:0/1696630122 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa2c003790 con 0x56096856afa0 2024-09-11T00:24:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.293+0000 7faa1fe00640 1 -- 172.21.15.40:0/1696630122 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7faa2c012470 con 0x56096856afa0 2024-09-11T00:24:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.293+0000 7faa445e9740 10 client.5139 fetch_fsmap learned FSMap version 16 2024-09-11T00:24:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.293+0000 7faa445e9740 1 -- 172.21.15.40:0/1696630122 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5609685d2d10 con 0x56096856afa0 2024-09-11T00:24:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.293+0000 7faa1fe00640 1 -- 172.21.15.40:0/1696630122 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa2c003790 con 0x56096856afa0 2024-09-11T00:24:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.293+0000 7faa1fe00640 1 -- 172.21.15.40:0/1696630122 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7faa2c010040 con 0x56096856afa0 2024-09-11T00:24:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.293+0000 7faa445e9740 10 client.5139 fetch_fsmap finished waiting for FSMap version 16 2024-09-11T00:24:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.293+0000 7faa445e9740 10 client.5139 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T00:24:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.293+0000 7faa445e9740 20 client.5139 populate_metadata read hostname 'smithi040' 2024-09-11T00:24:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.293+0000 7faa445e9740 1 --2- 172.21.15.40:0/1696630122 >> [v2:172.21.15.40:6832/2666966234,v1:172.21.15.40:6834/2666966234] conn(0x5609686325d0 0x5609686329b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.293+0000 7faa445e9740 4 client.5139 mds_command: new command op to 4944 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T00:24:53.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.293+0000 7faa445e9740 1 -- 172.21.15.40:0/1696630122 --> [v2:172.21.15.40:6832/2666966234,v1:172.21.15.40:6834/2666966234] -- command(tid 0: {"prefix": "status"}) -- 0x5609684dafd0 con 0x5609686325d0 2024-09-11T00:24:53.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.293+0000 7faa32000640 1 --2- 172.21.15.40:0/1696630122 >> [v2:172.21.15.40:6832/2666966234,v1:172.21.15.40:6834/2666966234] conn(0x5609686325d0 0x5609686329b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.294+0000 7faa32000640 1 --2- 172.21.15.40:0/1696630122 >> [v2:172.21.15.40:6832/2666966234,v1:172.21.15.40:6834/2666966234] conn(0x5609686325d0 0x5609686329b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e96c2d53d47a9634 server_cookie=3c028d7aa7239769 in_seq=0 out_seq=0 2024-09-11T00:24:53.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.294+0000 7faa1fe00640 10 client.5139 ms_handle_connect on v2:172.21.15.40:6832/2666966234 2024-09-11T00:24:53.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.294+0000 7faa1fe00640 1 -- 172.21.15.40:0/1696630122 <== mds.0 v2:172.21.15.40:6832/2666966234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5609684dafd0 con 0x5609686325d0 2024-09-11T00:24:53.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.294+0000 7faa1fe00640 10 client.5139 handle_command_reply: tid=0 2024-09-11T00:24:53.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.294+0000 7faa445e9740 1 client.5139 shutdown 2024-09-11T00:24:53.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.294+0000 7faa445e9740 1 -- 172.21.15.40:0/1696630122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 msgr2=0x5609685a6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:53.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.294+0000 7faa445e9740 1 --2- 172.21.15.40:0/1696630122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 0x5609685a6ad0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7faa2c004520 tx=0x7faa2c004690 comp rx=0 tx=0).stop 2024-09-11T00:24:53.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.294+0000 7faa445e9740 1 -- 172.21.15.40:0/1696630122 shutdown_connections 2024-09-11T00:24:53.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.294+0000 7faa445e9740 1 --2- 172.21.15.40:0/1696630122 >> [v2:172.21.15.40:6832/2666966234,v1:172.21.15.40:6834/2666966234] conn(0x5609686325d0 0x5609686329b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.294+0000 7faa445e9740 1 --2- 172.21.15.40:0/1696630122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609685af8b0 0x56096862f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.294+0000 7faa445e9740 1 --2- 172.21.15.40:0/1696630122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5609685a66f0 0x5609685a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.294+0000 7faa445e9740 1 --2- 172.21.15.40:0/1696630122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56096856afa0 0x5609685a6ad0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.294+0000 7faa445e9740 1 -- 172.21.15.40:0/1696630122 >> 172.21.15.40:0/1696630122 conn(0x56096856aa20 msgr2=0x5609685c1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:53.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.294+0000 7faa1fe00640 0 client.5139 ms_handle_reset on v2:172.21.15.40:6832/2666966234 2024-09-11T00:24:53.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.294+0000 7faa445e9740 1 -- 172.21.15.40:0/1696630122 shutdown_connections 2024-09-11T00:24:53.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.295+0000 7faa445e9740 1 -- 172.21.15.40:0/1696630122 wait complete. 2024-09-11T00:24:53.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.295+0000 7faa445e9740 20 client.5139 trim_cache size 0 max 16384 2024-09-11T00:24:53.302 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T00:24:53.302 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "f5cb250f-2a64-4822-87ba-c63d5f030b36", 2024-09-11T00:24:53.302 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2024-09-11T00:24:53.302 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4944, 2024-09-11T00:24:53.302 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-09-11T00:24:53.303 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-09-11T00:24:53.303 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-09-11T00:24:53.303 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 10.921486918999999, 2024-09-11T00:24:53.303 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 16, 2024-09-11T00:24:53.303 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 35, 2024-09-11T00:24:53.303 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 35, 2024-09-11T00:24:53.303 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 18.756842831 2024-09-11T00:24:53.303 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T00:24:53.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.295+0000 7faa41800640 1 -- 172.21.15.40:0/1964819910 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7faa18077fa0 msgr2=0x7faa1807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:53.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.295+0000 7faa41800640 1 --2- 172.21.15.40:0/1964819910 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7faa18077fa0 0x7faa1807a460 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faa2c001880 tx=0x7faa2c000f50 comp rx=0 tx=0).stop 2024-09-11T00:24:53.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.295+0000 7faa41800640 1 -- 172.21.15.40:0/1964819910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa3c0b3430 msgr2=0x7faa3c073380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:53.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.295+0000 7faa41800640 1 --2- 172.21.15.40:0/1964819910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa3c0b3430 0x7faa3c073380 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7faa24036040 tx=0x7faa24033c30 comp rx=0 tx=0).stop 2024-09-11T00:24:53.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.295+0000 7faa41800640 1 -- 172.21.15.40:0/1964819910 shutdown_connections 2024-09-11T00:24:53.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.295+0000 7faa41800640 1 --2- 172.21.15.40:0/1964819910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa3c06f3e0 0x7faa3c06f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.295+0000 7faa41800640 1 --2- 172.21.15.40:0/1964819910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa3c0b3430 0x7faa3c073380 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.295+0000 7faa41800640 1 --2- 172.21.15.40:0/1964819910 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7faa18077fa0 0x7faa1807a460 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.295+0000 7faa41800640 1 --2- 172.21.15.40:0/1964819910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa20003fd0 0x7faa3c072a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.295+0000 7faa41800640 1 -- 172.21.15.40:0/1964819910 >> 172.21.15.40:0/1964819910 conn(0x7faa3c0cfbb0 msgr2=0x7faa3c0ad870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:53.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.295+0000 7faa41800640 1 -- 172.21.15.40:0/1964819910 shutdown_connections 2024-09-11T00:24:53.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.295+0000 7faa41800640 1 -- 172.21.15.40:0/1964819910 wait complete. 2024-09-11T00:24:53.313 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T00:24:53.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.473+0000 7f9eea200640 1 -- 172.21.15.40:0/1613239677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ee415f050 msgr2=0x7f9ee415e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:53.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.473+0000 7f9eea200640 1 --2- 172.21.15.40:0/1613239677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ee415f050 0x7f9ee415e3b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc005fd0 tx=0x7f9ecc02a670 comp rx=0 tx=0).stop 2024-09-11T00:24:53.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.473+0000 7f9eea200640 1 -- 172.21.15.40:0/1613239677 shutdown_connections 2024-09-11T00:24:53.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.473+0000 7f9eea200640 1 --2- 172.21.15.40:0/1613239677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ee415f050 0x7f9ee415e3b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.473+0000 7f9eea200640 1 -- 172.21.15.40:0/1613239677 >> 172.21.15.40:0/1613239677 conn(0x7f9ee40cfbb0 msgr2=0x7f9ee40cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:53.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.473+0000 7f9eea200640 1 -- 172.21.15.40:0/1613239677 shutdown_connections 2024-09-11T00:24:53.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.473+0000 7f9eea200640 1 -- 172.21.15.40:0/1613239677 wait complete. 2024-09-11T00:24:53.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.475+0000 7f9eea200640 1 Processor -- start 2024-09-11T00:24:53.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.475+0000 7f9eea200640 1 -- start start 2024-09-11T00:24:53.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.476+0000 7f9eea200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ee40cd780 0x7f9ee414d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.476+0000 7f9eea200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee415ec70 0x7f9ee40b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.476+0000 7f9eea200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee415f050 0x7f9ee40b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.476+0000 7f9eea200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee4169450 con 0x7f9ee40cd780 2024-09-11T00:24:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.476+0000 7f9eea200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee40ce070 con 0x7f9ee415ec70 2024-09-11T00:24:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.476+0000 7f9eea200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9ee41695d0 con 0x7f9ee415f050 2024-09-11T00:24:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.476+0000 7f9ee3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ee40cd780 0x7f9ee414d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.476+0000 7f9ee3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ee40cd780 0x7f9ee414d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47408/0 (socket says 172.21.15.40:47408) 2024-09-11T00:24:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.476+0000 7f9ee3400640 1 -- 172.21.15.40:0/3927677711 learned_addr learned my addr 172.21.15.40:0/3927677711 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:24:53.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.476+0000 7f9edaa00640 1 --2- 172.21.15.40:0/3927677711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee415ec70 0x7f9ee40b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.476+0000 7f9ee3e00640 1 --2- 172.21.15.40:0/3927677711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee415f050 0x7f9ee40b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.477+0000 7f9ee3400640 1 -- 172.21.15.40:0/3927677711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee415f050 msgr2=0x7f9ee40b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:53.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.477+0000 7f9ee3400640 1 --2- 172.21.15.40:0/3927677711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee415f050 0x7f9ee40b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.477+0000 7f9ee3400640 1 -- 172.21.15.40:0/3927677711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee415ec70 msgr2=0x7f9ee40b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:53.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.477+0000 7f9ee3400640 1 --2- 172.21.15.40:0/3927677711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee415ec70 0x7f9ee40b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.477+0000 7f9ee3400640 1 -- 172.21.15.40:0/3927677711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee40b3d60 con 0x7f9ee40cd780 2024-09-11T00:24:53.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.477+0000 7f9edaa00640 1 --2- 172.21.15.40:0/3927677711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee415ec70 0x7f9ee40b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:53.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.477+0000 7f9ee3e00640 1 --2- 172.21.15.40:0/3927677711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee415f050 0x7f9ee40b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:53.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.477+0000 7f9ee3400640 1 --2- 172.21.15.40:0/3927677711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ee40cd780 0x7f9ee414d1b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400c450 tx=0x7f9ed400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:53.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.477+0000 7f9edbe00640 1 -- 172.21.15.40:0/3927677711 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed40052d0 con 0x7f9ee40cd780 2024-09-11T00:24:53.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.477+0000 7f9edbe00640 1 -- 172.21.15.40:0/3927677711 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ed4005470 con 0x7f9ee40cd780 2024-09-11T00:24:53.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.477+0000 7f9edbe00640 1 -- 172.21.15.40:0/3927677711 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4012870 con 0x7f9ee40cd780 2024-09-11T00:24:53.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.477+0000 7f9eea200640 1 -- 172.21.15.40:0/3927677711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ee40c7a10 con 0x7f9ee40cd780 2024-09-11T00:24:53.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.477+0000 7f9eea200640 1 -- 172.21.15.40:0/3927677711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ee40c7fd0 con 0x7f9ee40cd780 2024-09-11T00:24:53.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.479+0000 7f9eea200640 1 -- 172.21.15.40:0/3927677711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ee415e3b0 con 0x7f9ee40cd780 2024-09-11T00:24:53.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.480+0000 7f9edbe00640 1 -- 172.21.15.40:0/3927677711 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9ed40035f0 con 0x7f9ee40cd780 2024-09-11T00:24:53.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.480+0000 7f9edbe00640 1 --2- 172.21.15.40:0/3927677711 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9ec0077f70 0x7f9ec007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:53.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.481+0000 7f9edbe00640 1 -- 172.21.15.40:0/3927677711 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f9ed40998b0 con 0x7f9ee40cd780 2024-09-11T00:24:53.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.481+0000 7f9edaa00640 1 --2- 172.21.15.40:0/3927677711 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9ec0077f70 0x7f9ec007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:53.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.482+0000 7f9edaa00640 1 --2- 172.21.15.40:0/3927677711 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9ec0077f70 0x7f9ec007a430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc033000 tx=0x7f9ecc004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:53.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.485+0000 7f9edbe00640 1 -- 172.21.15.40:0/3927677711 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9ee40b3d60 con 0x7f9ee40cd780 2024-09-11T00:24:53.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.717+0000 7f9eea200640 1 -- 172.21.15.40:0/3927677711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9ee40c6950 con 0x7f9ee40cd780 2024-09-11T00:24:53.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.718+0000 7f9edbe00640 1 -- 172.21.15.40:0/3927677711 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f9ed40623b0 con 0x7f9ee40cd780 2024-09-11T00:24:53.720 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T00:24:53.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.720+0000 7f9eea200640 1 -- 172.21.15.40:0/3927677711 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9ec0077f70 msgr2=0x7f9ec007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:53.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.720+0000 7f9eea200640 1 --2- 172.21.15.40:0/3927677711 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9ec0077f70 0x7f9ec007a430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc033000 tx=0x7f9ecc004730 comp rx=0 tx=0).stop 2024-09-11T00:24:53.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.720+0000 7f9eea200640 1 -- 172.21.15.40:0/3927677711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ee40cd780 msgr2=0x7f9ee414d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:53.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.720+0000 7f9eea200640 1 --2- 172.21.15.40:0/3927677711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ee40cd780 0x7f9ee414d1b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400c450 tx=0x7f9ed400c910 comp rx=0 tx=0).stop 2024-09-11T00:24:53.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.720+0000 7f9eea200640 1 -- 172.21.15.40:0/3927677711 shutdown_connections 2024-09-11T00:24:53.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.721+0000 7f9eea200640 1 --2- 172.21.15.40:0/3927677711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ee415f050 0x7f9ee40b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.721+0000 7f9eea200640 1 --2- 172.21.15.40:0/3927677711 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9ec0077f70 0x7f9ec007a430 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.721+0000 7f9eea200640 1 --2- 172.21.15.40:0/3927677711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee415ec70 0x7f9ee40b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.721+0000 7f9eea200640 1 --2- 172.21.15.40:0/3927677711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ee40cd780 0x7f9ee414d1b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:53.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.721+0000 7f9eea200640 1 -- 172.21.15.40:0/3927677711 >> 172.21.15.40:0/3927677711 conn(0x7f9ee40cfbb0 msgr2=0x7f9ee406f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:53.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.721+0000 7f9eea200640 1 -- 172.21.15.40:0/3927677711 shutdown_connections 2024-09-11T00:24:53.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:53.721+0000 7f9eea200640 1 -- 172.21.15.40:0/3927677711 wait complete. 2024-09-11T00:24:53.738 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T00:24:53.738 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T00:24:53.738 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2024-09-11T00:24:53.738 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T00:24:53.738 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T00:24:53.738 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T00:24:53.739 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T00:24:53.739 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T00:24:53.739 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T00:24:53.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:53.739 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2024-09-11T00:24:53.775 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:24:53.776 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:24:53.776 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:24:53.776 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:53.777 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-09-11T00:24:53.777 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:53.777 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:24:53.777 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:53.777 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2024-09-11T00:24:53.777 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:24:53.777 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:53.777 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2024-09-11T00:24:53.777 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T00:24:53.777 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:53.777 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2024-09-11T00:24:53.777 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T00:24:53.777 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42625sec preferred_lft 42625sec 2024-09-11T00:24:53.778 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2024-09-11T00:24:53.778 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:53.778 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:24:53.778 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:53.778 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2024-09-11T00:24:53.778 INFO:teuthology.orchestra.run.smithi040.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T00:24:53.778 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 22:6f:9d:79:5f:1f brd ff:ff:ff:ff:ff:ff 2024-09-11T00:24:53.778 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T00:24:53.778 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:53.778 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::9470:ccff:fe73:e014/64 scope link 2024-09-11T00:24:53.778 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:53.778 INFO:teuthology.orchestra.run.smithi040.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T00:24:53.778 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 22:6f:9d:79:5f:1f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:24:53.779 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::206f:9dff:fe79:5f1f/64 scope link 2024-09-11T00:24:53.779 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:53.779 INFO:teuthology.orchestra.run.smithi040.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T00:24:53.779 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 5e:62:d7:2a:41:86 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T00:24:53.779 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::5c62:d7ff:fe2a:4186/64 scope link 2024-09-11T00:24:53.779 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:24:53.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:53.780 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T00:24:53.870 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-09-11T00:24:53.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:53.873 DEBUG:teuthology.orchestra.run.smithi040:> route 2024-09-11T00:24:53.909 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2024-09-11T00:24:53.909 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T00:24:53.909 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T00:24:53.909 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T00:24:53.909 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T00:24:53.909 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:24:53.909 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T00:24:53.910 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T00:24:53.910 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T00:24:53.910 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T00:24:53.910 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T00:24:54.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:24:54.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:54.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:54.109 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-09-11T00:24:54.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T00:24:54.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T00:24:54.156 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T00:24:54.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:54.157 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2024-09-11T00:24:54.258 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-11T00:24:54.258 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:24:54.258 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T00:24:54.294 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T00:24:54.294 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:24:54.294 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T00:24:54.369 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-09-11T00:24:54.467 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:24:54.503 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-09-11T00:24:54.503 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-09-11T00:24:54.503 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-09-11T00:24:54.503 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-09-11T00:24:54.503 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-09-11T00:24:54.503 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-09-11T00:24:54.504 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-09-11T00:24:54.504 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-09-11T00:24:54.504 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-09-11T00:24:54.504 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-09-11T00:24:54.504 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-09-11T00:24:54.504 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2024-09-11T00:24:54.504 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:24:54.504 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-09-11T00:24:54.504 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-09-11T00:24:54.504 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-09-11T00:24:54.504 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-09-11T00:24:54.504 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-09-11T00:24:54.504 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-09-11T00:24:54.505 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:24:54.505 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:24:54.505 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:24:54.505 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:24:54.505 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-09-11T00:24:54.505 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-09-11T00:24:54.505 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T00:24:54.505 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T00:24:54.505 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T00:24:54.505 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T00:24:54.505 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-09-11T00:24:54.505 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:24:54.505 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:24:54.506 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T00:24:54.506 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T00:24:54.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:54.507 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-09-11T00:24:54.585 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T00:24:54.586 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-11T00:24:54.635 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-09-11T00:24:54.692 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:24:54.728 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-09-11T00:24:54.728 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-09-11T00:24:54.728 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-09-11T00:24:54.728 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-09-11T00:24:54.728 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-09-11T00:24:54.729 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-09-11T00:24:54.729 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-09-11T00:24:54.729 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-09-11T00:24:54.729 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-09-11T00:24:54.729 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-09-11T00:24:54.729 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-09-11T00:24:54.729 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2024-09-11T00:24:54.729 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:24:54.729 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-09-11T00:24:54.729 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-09-11T00:24:54.729 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-09-11T00:24:54.729 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-09-11T00:24:54.729 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-09-11T00:24:54.729 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-09-11T00:24:54.730 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:24:54.730 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:24:54.730 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:24:54.730 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:24:54.730 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-09-11T00:24:54.730 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-09-11T00:24:54.730 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T00:24:54.730 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T00:24:54.730 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T00:24:54.730 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T00:24:54.730 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-09-11T00:24:54.730 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:24:54.730 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:24:54.730 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T00:24:54.731 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T00:24:54.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:54.732 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-09-11T00:24:54.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2024-09-11T00:24:54.779+0000 7fd1a1bef480 -1 init, newargv = 0x564da3454570 newargc=15 2024-09-11T00:24:54.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[47969]: starting ceph client 2024-09-11T00:24:54.790 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[47969]: starting fuse 2024-09-11T00:24:54.816 INFO:teuthology.orchestra.run.smithi040.stdout:43 2024-09-11T00:24:54.816 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-11T00:24:54.816 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2024-09-11T00:24:54.816 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2024-09-11T00:24:54.816 DEBUG:teuthology.orchestra.run.smithi040:> import re 2024-09-11T00:24:54.817 DEBUG:teuthology.orchestra.run.smithi040:> import os 2024-09-11T00:24:54.817 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2024-09-11T00:24:54.817 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-11T00:24:54.817 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2024-09-11T00:24:54.817 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T00:24:54.817 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2024-09-11T00:24:54.817 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T00:24:54.817 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-11T00:24:54.817 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2024-09-11T00:24:54.817 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2024-09-11T00:24:54.817 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2024-09-11T00:24:54.817 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2024-09-11T00:24:54.817 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-11T00:24:54.817 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2024-09-11T00:24:54.818 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T00:24:54.818 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T00:24:54.818 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T00:24:54.818 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2024-09-11T00:24:54.818 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2024-09-11T00:24:54.818 DEBUG:teuthology.orchestra.run.smithi040:> return f 2024-09-11T00:24:54.818 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T00:24:54.818 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-11T00:24:54.818 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.0")) 2024-09-11T00:24:54.818 DEBUG:teuthology.orchestra.run.smithi040:> ' 2024-09-11T00:24:54.993 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.0.47969.asok 2024-09-11T00:24:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:24:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:24:55.001 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47969.asok 2024-09-11T00:24:55.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:55.001 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47969.asok status 2024-09-11T00:24:55.186 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T00:24:55.186 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2024-09-11T00:24:55.186 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-11T00:24:55.186 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-11T00:24:55.187 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "0", 2024-09-11T00:24:55.187 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2024-09-11T00:24:55.187 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T00:24:55.187 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "47969", 2024-09-11T00:24:55.187 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2024-09-11T00:24:55.187 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:55.187 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2024-09-11T00:24:55.187 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2024-09-11T00:24:55.187 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 5154, 2024-09-11T00:24:55.187 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2024-09-11T00:24:55.187 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2024-09-11T00:24:55.187 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2024-09-11T00:24:55.187 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 5154 2024-09-11T00:24:55.187 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:55.188 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-09-11T00:24:55.188 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-09-11T00:24:55.188 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:0", 2024-09-11T00:24:55.188 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2914243849 2024-09-11T00:24:55.188 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T00:24:55.188 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:55.188 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-09-11T00:24:55.188 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-09-11T00:24:55.188 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:0", 2024-09-11T00:24:55.188 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2914243849 2024-09-11T00:24:55.188 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T00:24:55.188 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.5154 172.21.15.40:0/2914243849", 2024-09-11T00:24:55.188 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "172.21.15.40:0/2914243849", 2024-09-11T00:24:55.188 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2024-09-11T00:24:55.189 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 16, 2024-09-11T00:24:55.189 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 35, 2024-09-11T00:24:55.189 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2024-09-11T00:24:55.189 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2024-09-11T00:24:55.189 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2024-09-11T00:24:55.189 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T00:24:55.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:55.198 DEBUG:teuthology.orchestra.run.smithi040:> stat --file-system '--printf=%T 2024-09-11T00:24:55.198 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T00:24:55.238 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2024-09-11T00:24:55.238 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T00:24:55.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:55.238 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T00:24:55.337 DEBUG:teuthology.orchestra.run.smithi040:> mktemp -d --suffix=xfstests-dev 2024-09-11T00:24:55.372 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.URgBntWUNGxfstests-dev 2024-09-11T00:24:55.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:55.373 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.URgBntWUNGxfstests-dev) 2024-09-11T00:24:55.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:55.472 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.URgBntWUNGxfstests-dev) 2024-09-11T00:24:55.514 INFO:teuthology.orchestra.run.smithi040.stderr:Cloning into '/tmp/tmp.URgBntWUNGxfstests-dev'... 2024-09-11T00:24:56.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:56.324 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-09-11T00:24:56.407 DEBUG:teuthology.orchestra.run.smithi040:> mktemp -d --suffix=test 2024-09-11T00:24:56.482 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.qLSQMrTbCPtest 2024-09-11T00:24:56.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:24:56.483 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-09-11T00:24:56.562 DEBUG:teuthology.orchestra.run.smithi040:> mktemp -d --suffix=scratch 2024-09-11T00:24:56.638 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.WF8EAsNJIvscratch 2024-09-11T00:24:56.640 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9.stream". 2024-09-11T00:24:56.640 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-09-11T00:24:57.472 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:04:06 ago on Wed 11 Sep 2024 12:20:51 AM UTC. 2024-09-11T00:24:57.573 INFO:teuthology.orchestra.run.smithi040.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T00:24:57.574 INFO:teuthology.orchestra.run.smithi040.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T00:24:57.575 INFO:teuthology.orchestra.run.smithi040.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-09-11T00:24:57.576 INFO:teuthology.orchestra.run.smithi040.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-09-11T00:24:57.577 INFO:teuthology.orchestra.run.smithi040.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-09-11T00:24:57.578 INFO:teuthology.orchestra.run.smithi040.stdout:Package e2fsprogs-1.46.5-5.el9.x86_64 is already installed. 2024-09-11T00:24:57.580 INFO:teuthology.orchestra.run.smithi040.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-09-11T00:24:57.581 INFO:teuthology.orchestra.run.smithi040.stdout:Package gcc-11.5.0-2.el9.x86_64 is already installed. 2024-09-11T00:24:57.583 INFO:teuthology.orchestra.run.smithi040.stdout:Package git-2.43.5-1.el9.x86_64 is already installed. 2024-09-11T00:24:57.585 INFO:teuthology.orchestra.run.smithi040.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T00:24:57.586 INFO:teuthology.orchestra.run.smithi040.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-09-11T00:24:57.588 INFO:teuthology.orchestra.run.smithi040.stdout:Package libtool-2.4.6-46.el9.x86_64 is already installed. 2024-09-11T00:24:57.589 INFO:teuthology.orchestra.run.smithi040.stdout:Package libuuid-devel-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T00:24:57.589 INFO:teuthology.orchestra.run.smithi040.stdout:Package lvm2-9:2.03.24-2.el9.x86_64 is already installed. 2024-09-11T00:24:57.590 INFO:teuthology.orchestra.run.smithi040.stdout:Package make-1:4.3-8.el9.x86_64 is already installed. 2024-09-11T00:24:57.591 INFO:teuthology.orchestra.run.smithi040.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-09-11T00:24:57.592 INFO:teuthology.orchestra.run.smithi040.stdout:Package python3-3.9.19-8.el9.x86_64 is already installed. 2024-09-11T00:24:57.593 INFO:teuthology.orchestra.run.smithi040.stdout:Package quota-1:4.09-2.el9.x86_64 is already installed. 2024-09-11T00:24:57.594 INFO:teuthology.orchestra.run.smithi040.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-09-11T00:24:57.596 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T00:24:57.645 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-09-11T00:24:57.647 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-09-11T00:24:57.647 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-09-11T00:24:57.647 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-09-11T00:24:57.647 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-09-11T00:24:57.647 INFO:teuthology.orchestra.run.smithi040.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-09-11T00:24:57.647 INFO:teuthology.orchestra.run.smithi040.stdout: fio x86_64 3.35-1.el9 appstream 6.2 M 2024-09-11T00:24:57.647 INFO:teuthology.orchestra.run.smithi040.stdout: gdbm-devel x86_64 1:1.23-1.el9 crb 81 k 2024-09-11T00:24:57.648 INFO:teuthology.orchestra.run.smithi040.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-09-11T00:24:57.648 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-devel x86_64 5.14.0-505.el9 appstream 20 M 2024-09-11T00:24:57.648 INFO:teuthology.orchestra.run.smithi040.stdout: libcap-devel x86_64 2.48-9.el9 appstream 41 k 2024-09-11T00:24:57.648 INFO:teuthology.orchestra.run.smithi040.stdout: sqlite x86_64 3.34.1-7.el9 appstream 748 k 2024-09-11T00:24:57.648 INFO:teuthology.orchestra.run.smithi040.stdout: udftools x86_64 2.2-5.el9 appstream 149 k 2024-09-11T00:24:57.648 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-09-11T00:24:57.648 INFO:teuthology.orchestra.run.smithi040.stdout: gdbm x86_64 1:1.23-1.el9 crb 153 k 2024-09-11T00:24:57.648 INFO:teuthology.orchestra.run.smithi040.stdout: rmt x86_64 2:1.6-6.el9 baseos 46 k 2024-09-11T00:24:57.648 INFO:teuthology.orchestra.run.smithi040.stdout:Installing weak dependencies: 2024-09-11T00:24:57.648 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-http x86_64 3.35-1.el9 appstream 18 k 2024-09-11T00:24:57.648 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-libaio x86_64 3.35-1.el9 appstream 16 k 2024-09-11T00:24:57.648 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-nbd x86_64 3.35-1.el9 appstream 15 k 2024-09-11T00:24:57.648 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-rados x86_64 3.35-1.el9 appstream 16 k 2024-09-11T00:24:57.649 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-rbd x86_64 3.35-1.el9 appstream 16 k 2024-09-11T00:24:57.649 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-rdma x86_64 3.35-1.el9 appstream 21 k 2024-09-11T00:24:57.649 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:57.649 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-09-11T00:24:57.649 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-09-11T00:24:57.649 INFO:teuthology.orchestra.run.smithi040.stdout:Install 16 Packages 2024-09-11T00:24:57.649 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:24:57.650 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 28 M 2024-09-11T00:24:57.650 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 80 M 2024-09-11T00:24:57.650 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-09-11T00:24:58.348 INFO:teuthology.orchestra.run.smithi040.stdout:(1/16): fio-engine-http-3.35-1.el9.x86_64.rpm 173 kB/s | 18 kB 00:00 2024-09-11T00:24:58.373 INFO:teuthology.orchestra.run.smithi040.stdout:(2/16): rmt-1.6-6.el9.x86_64.rpm 355 kB/s | 46 kB 00:00 2024-09-11T00:24:58.398 INFO:teuthology.orchestra.run.smithi040.stdout:(3/16): fio-engine-libaio-3.35-1.el9.x86_64.rpm 314 kB/s | 16 kB 00:00 2024-09-11T00:24:58.448 INFO:teuthology.orchestra.run.smithi040.stdout:(4/16): fio-engine-rados-3.35-1.el9.x86_64.rpm 314 kB/s | 16 kB 00:00 2024-09-11T00:24:58.465 INFO:teuthology.orchestra.run.smithi040.stdout:(5/16): fio-engine-nbd-3.35-1.el9.x86_64.rpm 159 kB/s | 15 kB 00:00 2024-09-11T00:24:58.499 INFO:teuthology.orchestra.run.smithi040.stdout:(6/16): fio-engine-rbd-3.35-1.el9.x86_64.rpm 320 kB/s | 16 kB 00:00 2024-09-11T00:24:58.516 INFO:teuthology.orchestra.run.smithi040.stdout:(7/16): fio-engine-rdma-3.35-1.el9.x86_64.rpm 407 kB/s | 21 kB 00:00 2024-09-11T00:24:58.566 INFO:teuthology.orchestra.run.smithi040.stdout:(8/16): libcap-devel-2.48-9.el9.x86_64.rpm 812 kB/s | 41 kB 00:00 2024-09-11T00:24:58.842 INFO:teuthology.orchestra.run.smithi040.stdout:(9/16): sqlite-3.34.1-7.el9.x86_64.rpm 2.7 MB/s | 748 kB 00:00 2024-09-11T00:24:58.925 INFO:teuthology.orchestra.run.smithi040.stdout:(10/16): udftools-2.2-5.el9.x86_64.rpm 1.8 MB/s | 149 kB 00:00 2024-09-11T00:24:59.076 INFO:teuthology.orchestra.run.smithi040.stdout:(11/16): gdbm-1.23-1.el9.x86_64.rpm 1.0 MB/s | 153 kB 00:00 2024-09-11T00:24:59.126 INFO:teuthology.orchestra.run.smithi040.stdout:(12/16): gdbm-devel-1.23-1.el9.x86_64.rpm 1.6 MB/s | 81 kB 00:00 2024-09-11T00:24:59.176 INFO:teuthology.orchestra.run.smithi040.stdout:(13/16): dump-0.4-0.51.b47.el9.x86_64.rpm 1.7 MB/s | 88 kB 00:00 2024-09-11T00:24:59.202 INFO:teuthology.orchestra.run.smithi040.stdout:(14/16): indent-2.2.13-5.el9.x86_64.rpm 7.1 MB/s | 179 kB 00:00 2024-09-11T00:25:00.035 INFO:teuthology.orchestra.run.smithi040.stdout:(15/16): fio-3.35-1.el9.x86_64.rpm 3.5 MB/s | 6.2 MB 00:01 2024-09-11T00:25:01.860 INFO:teuthology.orchestra.run.smithi040.stdout:(16/16): kernel-devel-5.14.0-505.el9.x86_64.rpm 6.0 MB/s | 20 MB 00:03 2024-09-11T00:25:01.862 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-09-11T00:25:01.862 INFO:teuthology.orchestra.run.smithi040.stdout:Total 6.6 MB/s | 28 MB 00:04 2024-09-11T00:25:02.359 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-09-11T00:25:02.440 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-09-11T00:25:02.440 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-09-11T00:25:03.157 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-09-11T00:25:03.157 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-09-11T00:25:04.200 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-09-11T00:25:04.271 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 1/16 2024-09-11T00:25:04.296 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 2/16 2024-09-11T00:25:04.322 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 3/16 2024-09-11T00:25:04.355 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 4/16 2024-09-11T00:25:04.380 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 5/16 2024-09-11T00:25:04.582 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 6/16 2024-09-11T00:25:04.632 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-3.35-1.el9.x86_64 7/16 2024-09-11T00:25:04.672 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gdbm-1:1.23-1.el9.x86_64 8/16 2024-09-11T00:25:04.708 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rmt-2:1.6-6.el9.x86_64 9/16 2024-09-11T00:25:04.747 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 10/16 2024-09-11T00:25:04.813 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gdbm-devel-1:1.23-1.el9.x86_64 11/16 2024-09-11T00:25:04.869 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : indent-2.2.13-5.el9.x86_64 12/16 2024-09-11T00:25:04.916 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : udftools-2.2-5.el9.x86_64 13/16 2024-09-11T00:25:04.973 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 14/16 2024-09-11T00:25:12.799 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:25:12.803 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:25:17.306 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 15/16 2024-09-11T00:25:17.674 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-devel-5.14.0-505.el9.x86_64 16/16 2024-09-11T00:25:42.923 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:25:42.928 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:25:48.025 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-devel-5.14.0-505.el9.x86_64 16/16 2024-09-11T00:25:48.025 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 1/16 2024-09-11T00:25:48.025 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-3.35-1.el9.x86_64 2/16 2024-09-11T00:25:48.025 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 3/16 2024-09-11T00:25:48.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 4/16 2024-09-11T00:25:48.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 5/16 2024-09-11T00:25:48.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 6/16 2024-09-11T00:25:48.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 7/16 2024-09-11T00:25:48.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 8/16 2024-09-11T00:25:48.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-devel-5.14.0-505.el9.x86_64 9/16 2024-09-11T00:25:48.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 10/16 2024-09-11T00:25:48.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 11/16 2024-09-11T00:25:48.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : udftools-2.2-5.el9.x86_64 12/16 2024-09-11T00:25:48.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gdbm-1:1.23-1.el9.x86_64 13/16 2024-09-11T00:25:48.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gdbm-devel-1:1.23-1.el9.x86_64 14/16 2024-09-11T00:25:48.026 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 15/16 2024-09-11T00:25:48.513 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : indent-2.2.13-5.el9.x86_64 16/16 2024-09-11T00:25:48.513 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:25:48.514 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-09-11T00:25:48.514 INFO:teuthology.orchestra.run.smithi040.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-09-11T00:25:48.514 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-09-11T00:25:48.514 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-09-11T00:25:48.514 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-09-11T00:25:48.514 INFO:teuthology.orchestra.run.smithi040.stdout: gdbm-1:1.23-1.el9.x86_64 gdbm-devel-1:1.23-1.el9.x86_64 2024-09-11T00:25:48.514 INFO:teuthology.orchestra.run.smithi040.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-505.el9.x86_64 2024-09-11T00:25:48.514 INFO:teuthology.orchestra.run.smithi040.stdout: libcap-devel-2.48-9.el9.x86_64 rmt-2:1.6-6.el9.x86_64 2024-09-11T00:25:48.514 INFO:teuthology.orchestra.run.smithi040.stdout: sqlite-3.34.1-7.el9.x86_64 udftools-2.2-5.el9.x86_64 2024-09-11T00:25:48.514 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:25:48.514 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-09-11T00:25:49.113 DEBUG:teuthology.orchestra.run.smithi040:> sudo useradd -m fsgqa 2024-09-11T00:25:49.176 INFO:teuthology.orchestra.run.smithi040.stderr:useradd: user 'fsgqa' already exists 2024-09-11T00:25:49.178 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-09-11T00:25:49.179 DEBUG:teuthology.orchestra.run.smithi040:> sudo groupadd fsgqa 2024-09-11T00:25:49.235 INFO:teuthology.orchestra.run.smithi040.stderr:groupadd: group 'fsgqa' already exists 2024-09-11T00:25:49.238 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-09-11T00:25:49.238 DEBUG:teuthology.orchestra.run.smithi040:> sudo useradd fsgqa2 2024-09-11T00:25:49.881 DEBUG:teuthology.orchestra.run.smithi040:> sudo useradd 123456-fsgqa 2024-09-11T00:25:50.519 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-09-11T00:25:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.679+0000 7fbbf5e00640 1 -- 172.21.15.40:0/3951566087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbf00705e0 msgr2=0x7fbbf015ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.679+0000 7fbbf5e00640 1 --2- 172.21.15.40:0/3951566087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbf00705e0 0x7fbbf015ad80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0005fd0 tx=0x7fbbe002a670 comp rx=0 tx=0).stop 2024-09-11T00:25:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.680+0000 7fbbf5e00640 1 -- 172.21.15.40:0/3951566087 shutdown_connections 2024-09-11T00:25:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.680+0000 7fbbf5e00640 1 --2- 172.21.15.40:0/3951566087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbf00705e0 0x7fbbf015ad80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.680+0000 7fbbf5e00640 1 -- 172.21.15.40:0/3951566087 >> 172.21.15.40:0/3951566087 conn(0x7fbbf00cfbb0 msgr2=0x7fbbf00cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.680+0000 7fbbf5e00640 1 -- 172.21.15.40:0/3951566087 shutdown_connections 2024-09-11T00:25:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.680+0000 7fbbf5e00640 1 -- 172.21.15.40:0/3951566087 wait complete. 2024-09-11T00:25:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.681+0000 7fbbf5e00640 1 Processor -- start 2024-09-11T00:25:50.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.681+0000 7fbbf5e00640 1 -- start start 2024-09-11T00:25:50.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.682+0000 7fbbf5e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbf006ec60 0x7fbbf0152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.682+0000 7fbbf5e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbf00705e0 0x7fbbf00b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.682+0000 7fbbf5e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbf00ca200 0x7fbbf01f3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.682+0000 7fbbf5e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf0154650 con 0x7fbbf006ec60 2024-09-11T00:25:50.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.682+0000 7fbbf5e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf00cf320 con 0x7fbbf00ca200 2024-09-11T00:25:50.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.682+0000 7fbbf5e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf01547d0 con 0x7fbbf00705e0 2024-09-11T00:25:50.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.683+0000 7fbbeea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbf006ec60 0x7fbbf0152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.683+0000 7fbbeea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbf006ec60 0x7fbbf0152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35740/0 (socket says 172.21.15.40:35740) 2024-09-11T00:25:50.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.683+0000 7fbbeea00640 1 -- 172.21.15.40:0/2738767145 learned_addr learned my addr 172.21.15.40:0/2738767145 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:25:50.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.683+0000 7fbbee000640 1 --2- 172.21.15.40:0/2738767145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbf00705e0 0x7fbbf00b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.683+0000 7fbbef400640 1 --2- 172.21.15.40:0/2738767145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbf00ca200 0x7fbbf01f3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.683+0000 7fbbeea00640 1 -- 172.21.15.40:0/2738767145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbf00705e0 msgr2=0x7fbbf00b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:50.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.683+0000 7fbbeea00640 1 --2- 172.21.15.40:0/2738767145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbf00705e0 0x7fbbf00b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.683+0000 7fbbeea00640 1 -- 172.21.15.40:0/2738767145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbf00ca200 msgr2=0x7fbbf01f3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:50.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.683+0000 7fbbeea00640 1 --2- 172.21.15.40:0/2738767145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbf00ca200 0x7fbbf01f3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.683+0000 7fbbeea00640 1 -- 172.21.15.40:0/2738767145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf01f8c50 con 0x7fbbf006ec60 2024-09-11T00:25:50.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.683+0000 7fbbee000640 1 --2- 172.21.15.40:0/2738767145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbf00705e0 0x7fbbf00b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:25:50.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.683+0000 7fbbef400640 1 --2- 172.21.15.40:0/2738767145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbf00ca200 0x7fbbf01f3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:25:50.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.684+0000 7fbbeea00640 1 --2- 172.21.15.40:0/2738767145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbf006ec60 0x7fbbf0152280 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0009850 tx=0x7fbbe00039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:50.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.684+0000 7fbbe7400640 1 -- 172.21.15.40:0/2738767145 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe003f070 con 0x7fbbf006ec60 2024-09-11T00:25:50.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.684+0000 7fbbe7400640 1 -- 172.21.15.40:0/2738767145 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbe0004890 con 0x7fbbf006ec60 2024-09-11T00:25:50.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.684+0000 7fbbe7400640 1 -- 172.21.15.40:0/2738767145 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0035030 con 0x7fbbf006ec60 2024-09-11T00:25:50.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.684+0000 7fbbf5e00640 1 -- 172.21.15.40:0/2738767145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf01f4ac0 con 0x7fbbf006ec60 2024-09-11T00:25:50.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.684+0000 7fbbf5e00640 1 -- 172.21.15.40:0/2738767145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf01f5080 con 0x7fbbf006ec60 2024-09-11T00:25:50.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.685+0000 7fbbf5e00640 1 -- 172.21.15.40:0/2738767145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbf00ca930 con 0x7fbbf006ec60 2024-09-11T00:25:50.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.686+0000 7fbbe7400640 1 -- 172.21.15.40:0/2738767145 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbbe0004c60 con 0x7fbbf006ec60 2024-09-11T00:25:50.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.688+0000 7fbbe7400640 1 --2- 172.21.15.40:0/2738767145 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbbd0077f70 0x7fbbd007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.688+0000 7fbbe7400640 1 -- 172.21.15.40:0/2738767145 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fbbe00baff0 con 0x7fbbf006ec60 2024-09-11T00:25:50.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.688+0000 7fbbee000640 1 --2- 172.21.15.40:0/2738767145 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbbd0077f70 0x7fbbd007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.689+0000 7fbbee000640 1 --2- 172.21.15.40:0/2738767145 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbbd0077f70 0x7fbbd007a430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc007fd0 tx=0x7fbbdc009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:50.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.692+0000 7fbbe7400640 1 -- 172.21.15.40:0/2738767145 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbbe0083ae0 con 0x7fbbf006ec60 2024-09-11T00:25:50.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.965+0000 7fbbf5e00640 1 -- 172.21.15.40:0/2738767145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fbbf00b5b30 con 0x7fbbf006ec60 2024-09-11T00:25:50.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.965+0000 7fbbe7400640 1 -- 172.21.15.40:0/2738767145 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1285 (secure 0 0 0) 0x7fbbe008c030 con 0x7fbbf006ec60 2024-09-11T00:25:50.968 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:25:50.968 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":1,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","modified":"2024-09-11T00:22:44.620288Z","created":"2024-09-11T00:22:44.620288Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-11T00:25:50.968 INFO:teuthology.orchestra.run.smithi040.stderr:dumped monmap epoch 1 2024-09-11T00:25:50.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.968+0000 7fbbf5e00640 1 -- 172.21.15.40:0/2738767145 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbbd0077f70 msgr2=0x7fbbd007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:50.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.968+0000 7fbbf5e00640 1 --2- 172.21.15.40:0/2738767145 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbbd0077f70 0x7fbbd007a430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc007fd0 tx=0x7fbbdc009040 comp rx=0 tx=0).stop 2024-09-11T00:25:50.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.968+0000 7fbbf5e00640 1 -- 172.21.15.40:0/2738767145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbf006ec60 msgr2=0x7fbbf0152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:50.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.968+0000 7fbbf5e00640 1 --2- 172.21.15.40:0/2738767145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbf006ec60 0x7fbbf0152280 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0009850 tx=0x7fbbe00039e0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.968+0000 7fbbf5e00640 1 -- 172.21.15.40:0/2738767145 shutdown_connections 2024-09-11T00:25:50.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.968+0000 7fbbf5e00640 1 --2- 172.21.15.40:0/2738767145 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbbd0077f70 0x7fbbd007a430 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.968+0000 7fbbf5e00640 1 --2- 172.21.15.40:0/2738767145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbf00ca200 0x7fbbf01f3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.968+0000 7fbbf5e00640 1 --2- 172.21.15.40:0/2738767145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbf00705e0 0x7fbbf00b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.968+0000 7fbbf5e00640 1 --2- 172.21.15.40:0/2738767145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbf006ec60 0x7fbbf0152280 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.968+0000 7fbbf5e00640 1 -- 172.21.15.40:0/2738767145 >> 172.21.15.40:0/2738767145 conn(0x7fbbf00cfbb0 msgr2=0x7fbbf014e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:50.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.968+0000 7fbbf5e00640 1 -- 172.21.15.40:0/2738767145 shutdown_connections 2024-09-11T00:25:50.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:50.968+0000 7fbbf5e00640 1 -- 172.21.15.40:0/2738767145 wait complete. 2024-09-11T00:25:50.988 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2024-09-11T00:25:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.150+0000 7f2977200640 1 -- 172.21.15.40:0/2161286985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f295c0052d0 msgr2=0x7f295c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.150+0000 7f2977200640 1 --2- 172.21.15.40:0/2161286985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f295c0052d0 0x7f295c00b9c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2970001830 tx=0x7f295c005830 comp rx=0 tx=0).stop 2024-09-11T00:25:51.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.150+0000 7f2977200640 1 -- 172.21.15.40:0/2161286985 shutdown_connections 2024-09-11T00:25:51.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.150+0000 7f2977200640 1 --2- 172.21.15.40:0/2161286985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f295c0052d0 0x7f295c00b9c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:51.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.150+0000 7f2977200640 1 -- 172.21.15.40:0/2161286985 >> 172.21.15.40:0/2161286985 conn(0x7f29780d3c20 msgr2=0x7f29780d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:51.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.150+0000 7f2977200640 1 -- 172.21.15.40:0/2161286985 shutdown_connections 2024-09-11T00:25:51.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.150+0000 7f2977200640 1 -- 172.21.15.40:0/2161286985 wait complete. 2024-09-11T00:25:51.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.152+0000 7f2977200640 1 Processor -- start 2024-09-11T00:25:51.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.152+0000 7f2977200640 1 -- start start 2024-09-11T00:25:51.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.153+0000 7f2977200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f295c0052d0 0x7f2978158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:51.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.153+0000 7f2977200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2978160300 0x7f29780c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.153+0000 7f2977200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2978160780 0x7f29780c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.153+0000 7f2977200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f29780d02d0 con 0x7f295c0052d0 2024-09-11T00:25:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.153+0000 7f2977200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f29780d4a60 con 0x7f2978160300 2024-09-11T00:25:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.153+0000 7f2977200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f29780d0450 con 0x7f2978160780 2024-09-11T00:25:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.153+0000 7f2975e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f295c0052d0 0x7f2978158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.153+0000 7f2975e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f295c0052d0 0x7f2978158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35758/0 (socket says 172.21.15.40:35758) 2024-09-11T00:25:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.153+0000 7f2975e00640 1 -- 172.21.15.40:0/2363958002 learned_addr learned my addr 172.21.15.40:0/2363958002 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:25:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.154+0000 7f2976800640 1 --2- 172.21.15.40:0/2363958002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2978160780 0x7f29780c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.154+0000 7f2975400640 1 --2- 172.21.15.40:0/2363958002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2978160300 0x7f29780c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.154+0000 7f2975e00640 1 -- 172.21.15.40:0/2363958002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2978160780 msgr2=0x7f29780c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.154+0000 7f2975e00640 1 --2- 172.21.15.40:0/2363958002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2978160780 0x7f29780c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.154+0000 7f2975e00640 1 -- 172.21.15.40:0/2363958002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2978160300 msgr2=0x7f29780c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.154+0000 7f2975e00640 1 --2- 172.21.15.40:0/2363958002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2978160300 0x7f29780c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.154+0000 7f2975e00640 1 -- 172.21.15.40:0/2363958002 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2978158640 con 0x7f295c0052d0 2024-09-11T00:25:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.154+0000 7f2976800640 1 --2- 172.21.15.40:0/2363958002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2978160780 0x7f29780c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:25:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.154+0000 7f2975e00640 1 --2- 172.21.15.40:0/2363958002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f295c0052d0 0x7f2978158100 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2968006290 tx=0x7f2968006750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.154+0000 7f296e000640 1 -- 172.21.15.40:0/2363958002 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2968015070 con 0x7f295c0052d0 2024-09-11T00:25:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.154+0000 7f296e000640 1 -- 172.21.15.40:0/2363958002 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f296800fb30 con 0x7f295c0052d0 2024-09-11T00:25:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.154+0000 7f296e000640 1 -- 172.21.15.40:0/2363958002 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2968011430 con 0x7f295c0052d0 2024-09-11T00:25:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.154+0000 7f2977200640 1 -- 172.21.15.40:0/2363958002 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f297815f020 con 0x7f295c0052d0 2024-09-11T00:25:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.155+0000 7f2977200640 1 -- 172.21.15.40:0/2363958002 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f297815f820 con 0x7f295c0052d0 2024-09-11T00:25:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.156+0000 7f2977200640 1 -- 172.21.15.40:0/2363958002 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29780ce730 con 0x7f295c0052d0 2024-09-11T00:25:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.157+0000 7f296e000640 1 -- 172.21.15.40:0/2363958002 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f29680115d0 con 0x7f295c0052d0 2024-09-11T00:25:51.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.158+0000 7f296e000640 1 --2- 172.21.15.40:0/2363958002 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2958077f70 0x7f295807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:51.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.158+0000 7f296e000640 1 -- 172.21.15.40:0/2363958002 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f296809ace0 con 0x7f295c0052d0 2024-09-11T00:25:51.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.159+0000 7f2975400640 1 --2- 172.21.15.40:0/2363958002 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2958077f70 0x7f295807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:51.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.160+0000 7f2975400640 1 --2- 172.21.15.40:0/2363958002 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2958077f70 0x7f295807a430 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f29781f54f0 tx=0x7f2964005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:51.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.162+0000 7f296e000640 1 -- 172.21.15.40:0/2363958002 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f29680630f0 con 0x7f295c0052d0 2024-09-11T00:25:51.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.428+0000 7f2977200640 1 -- 172.21.15.40:0/2363958002 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) -- 0x7f29780b6af0 con 0x7f295c0052d0 2024-09-11T00:25:51.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.429+0000 7f296e000640 1 -- 172.21.15.40:0/2363958002 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v9) ==== 82+0+151 (secure 0 0 0) 0x7f2968067b20 con 0x7f295c0052d0 2024-09-11T00:25:51.431 INFO:teuthology.orchestra.run.smithi040.stdout:[client.admin] 2024-09-11T00:25:51.432 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDU4uBmfu7SNhAAv0WuGj2MGv89ma/A4LvtaQ== 2024-09-11T00:25:51.432 INFO:teuthology.orchestra.run.smithi040.stdout: caps mds = "allow *" 2024-09-11T00:25:51.432 INFO:teuthology.orchestra.run.smithi040.stdout: caps mgr = "allow *" 2024-09-11T00:25:51.432 INFO:teuthology.orchestra.run.smithi040.stdout: caps mon = "allow *" 2024-09-11T00:25:51.432 INFO:teuthology.orchestra.run.smithi040.stdout: caps osd = "allow *" 2024-09-11T00:25:51.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.433+0000 7f2977200640 1 -- 172.21.15.40:0/2363958002 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2958077f70 msgr2=0x7f295807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:51.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.433+0000 7f2977200640 1 --2- 172.21.15.40:0/2363958002 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2958077f70 0x7f295807a430 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f29781f54f0 tx=0x7f2964005f90 comp rx=0 tx=0).stop 2024-09-11T00:25:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.433+0000 7f2977200640 1 -- 172.21.15.40:0/2363958002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f295c0052d0 msgr2=0x7f2978158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.433+0000 7f2977200640 1 --2- 172.21.15.40:0/2363958002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f295c0052d0 0x7f2978158100 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2968006290 tx=0x7f2968006750 comp rx=0 tx=0).stop 2024-09-11T00:25:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.433+0000 7f2977200640 1 -- 172.21.15.40:0/2363958002 shutdown_connections 2024-09-11T00:25:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.433+0000 7f2977200640 1 --2- 172.21.15.40:0/2363958002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2978160780 0x7f29780c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.433+0000 7f2977200640 1 --2- 172.21.15.40:0/2363958002 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2958077f70 0x7f295807a430 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.433+0000 7f2977200640 1 --2- 172.21.15.40:0/2363958002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2978160300 0x7f29780c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.433+0000 7f2977200640 1 --2- 172.21.15.40:0/2363958002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f295c0052d0 0x7f2978158100 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.433+0000 7f2977200640 1 -- 172.21.15.40:0/2363958002 >> 172.21.15.40:0/2363958002 conn(0x7f29780d3c20 msgr2=0x7f29780d4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.433+0000 7f2977200640 1 -- 172.21.15.40:0/2363958002 shutdown_connections 2024-09-11T00:25:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:25:51.433+0000 7f2977200640 1 -- 172.21.15.40:0/2363958002 wait complete. 2024-09-11T00:25:51.454 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2024-09-11T00:25:51.490 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.F3eRJJKM8C 2024-09-11T00:25:51.490 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:25:51.490 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/tmp/tmp.F3eRJJKM8C 2024-09-11T00:25:51.566 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:25:51.566 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/tmp/tmp.URgBntWUNGxfstests-dev/local.config 2024-09-11T00:25:51.662 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.qLSQMrTbCPtest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.WF8EAsNJIvscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.40:6789 -k /tmp/tmp.F3eRJJKM8C --client_mountpoint /test" 2024-09-11T00:25:51.662 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:25:51.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/tmp/tmp.URgBntWUNGxfstests-dev/ceph.exclude 2024-09-11T00:25:51.758 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.URgBntWUNGxfstests-dev && exec sudo make) 2024-09-11T00:25:51.901 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize -cfi 2024-09-11T00:25:53.108 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: putting auxiliary files in '.'. 2024-09-11T00:25:53.109 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './config.guess' 2024-09-11T00:25:53.117 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './config.sub' 2024-09-11T00:25:53.127 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './install-sh' 2024-09-11T00:25:53.137 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './ltmain.sh' 2024-09-11T00:25:53.194 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-09-11T00:25:53.195 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-09-11T00:25:53.206 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-09-11T00:25:53.218 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-09-11T00:25:53.229 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-09-11T00:25:53.241 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-09-11T00:25:53.257 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-09-11T00:25:53.260 INFO:teuthology.orchestra.run.smithi040.stdout:cp include/install-sh . 2024-09-11T00:25:53.262 INFO:teuthology.orchestra.run.smithi040.stdout:aclocal -I m4 2024-09-11T00:25:54.397 INFO:teuthology.orchestra.run.smithi040.stdout:autoheader 2024-09-11T00:25:54.757 INFO:teuthology.orchestra.run.smithi040.stdout:autoconf 2024-09-11T00:25:54.979 INFO:teuthology.orchestra.run.smithi040.stdout:./configure \ 2024-09-11T00:25:54.979 INFO:teuthology.orchestra.run.smithi040.stdout: --libexecdir=/usr/lib \ 2024-09-11T00:25:54.979 INFO:teuthology.orchestra.run.smithi040.stdout: --exec_prefix=/var/lib 2024-09-11T00:25:55.460 INFO:teuthology.orchestra.run.smithi040.stdout:checking build system type... x86_64-pc-linux-gnu 2024-09-11T00:25:55.460 INFO:teuthology.orchestra.run.smithi040.stdout:checking host system type... x86_64-pc-linux-gnu 2024-09-11T00:25:55.463 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to print strings... printf 2024-09-11T00:25:55.463 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc... gcc 2024-09-11T00:25:55.632 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether the C compiler works... yes 2024-09-11T00:25:55.632 INFO:teuthology.orchestra.run.smithi040.stdout:checking for C compiler default output file name... a.out 2024-09-11T00:25:55.683 INFO:teuthology.orchestra.run.smithi040.stdout:checking for suffix of executables... 2024-09-11T00:25:55.787 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether we are cross compiling... no 2024-09-11T00:25:55.823 INFO:teuthology.orchestra.run.smithi040.stdout:checking for suffix of object files... o 2024-09-11T00:25:55.855 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether we are using the GNU C compiler... yes 2024-09-11T00:25:55.888 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether gcc accepts -g... yes 2024-09-11T00:25:55.972 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-11T00:25:55.979 INFO:teuthology.orchestra.run.smithi040.stdout:checking for a sed that does not truncate output... /bin/sed 2024-09-11T00:25:55.983 INFO:teuthology.orchestra.run.smithi040.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-09-11T00:25:55.986 INFO:teuthology.orchestra.run.smithi040.stdout:checking for egrep... /bin/grep -E 2024-09-11T00:25:55.988 INFO:teuthology.orchestra.run.smithi040.stdout:checking for fgrep... /bin/grep -F 2024-09-11T00:25:55.996 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ld used by gcc... /bin/ld 2024-09-11T00:25:56.001 INFO:teuthology.orchestra.run.smithi040.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-09-11T00:25:56.011 INFO:teuthology.orchestra.run.smithi040.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-09-11T00:25:57.002 INFO:teuthology.orchestra.run.smithi040.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-09-11T00:25:57.002 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether ln -s works... yes 2024-09-11T00:25:57.017 INFO:teuthology.orchestra.run.smithi040.stdout:checking the maximum length of command line arguments... 1572864 2024-09-11T00:25:57.023 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-09-11T00:25:57.023 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-09-11T00:25:57.023 INFO:teuthology.orchestra.run.smithi040.stdout:checking for /bin/ld option to reload object files... -r 2024-09-11T00:25:57.024 INFO:teuthology.orchestra.run.smithi040.stdout:checking for objdump... objdump 2024-09-11T00:25:57.025 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to recognize dependent libraries... pass_all 2024-09-11T00:25:57.025 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dlltool... no 2024-09-11T00:25:57.025 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-09-11T00:25:57.025 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ar... ar 2024-09-11T00:25:57.109 INFO:teuthology.orchestra.run.smithi040.stdout:checking for archiver @FILE support... @ 2024-09-11T00:25:57.109 INFO:teuthology.orchestra.run.smithi040.stdout:checking for strip... strip 2024-09-11T00:25:57.110 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ranlib... ranlib 2024-09-11T00:25:57.110 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gawk... gawk 2024-09-11T00:25:57.234 INFO:teuthology.orchestra.run.smithi040.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-09-11T00:25:57.237 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sysroot... no 2024-09-11T00:25:57.244 INFO:teuthology.orchestra.run.smithi040.stdout:checking for a working dd... /bin/dd 2024-09-11T00:25:57.251 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-09-11T00:25:57.279 INFO:teuthology.orchestra.run.smithi040.stdout:checking for mt... no 2024-09-11T00:25:57.284 INFO:teuthology.orchestra.run.smithi040.stdout:checking if : is a manifest tool... no 2024-09-11T00:25:57.368 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to run the C preprocessor... gcc -E 2024-09-11T00:25:57.665 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ANSI C header files... yes 2024-09-11T00:25:57.708 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/types.h... yes 2024-09-11T00:25:57.765 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/stat.h... yes 2024-09-11T00:25:57.815 INFO:teuthology.orchestra.run.smithi040.stdout:checking for stdlib.h... yes 2024-09-11T00:25:57.866 INFO:teuthology.orchestra.run.smithi040.stdout:checking for string.h... yes 2024-09-11T00:25:57.918 INFO:teuthology.orchestra.run.smithi040.stdout:checking for memory.h... yes 2024-09-11T00:25:57.970 INFO:teuthology.orchestra.run.smithi040.stdout:checking for strings.h... yes 2024-09-11T00:25:58.024 INFO:teuthology.orchestra.run.smithi040.stdout:checking for inttypes.h... yes 2024-09-11T00:25:58.076 INFO:teuthology.orchestra.run.smithi040.stdout:checking for stdint.h... yes 2024-09-11T00:25:58.136 INFO:teuthology.orchestra.run.smithi040.stdout:checking for unistd.h... yes 2024-09-11T00:25:58.200 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dlfcn.h... yes 2024-09-11T00:25:58.208 INFO:teuthology.orchestra.run.smithi040.stdout:checking for objdir... .libs 2024-09-11T00:25:58.335 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-09-11T00:25:58.335 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-09-11T00:25:58.371 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-09-11T00:25:58.426 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc static flag -static works... no 2024-09-11T00:25:58.476 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc supports -c -o file.o... yes 2024-09-11T00:25:58.476 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-09-11T00:25:58.490 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-09-11T00:25:58.544 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether -lc should be explicitly linked in... no 2024-09-11T00:25:58.639 INFO:teuthology.orchestra.run.smithi040.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-09-11T00:25:58.639 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to hardcode library paths into programs... immediate 2024-09-11T00:25:58.642 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether stripping libraries is possible... yes 2024-09-11T00:25:58.642 INFO:teuthology.orchestra.run.smithi040.stdout:checking if libtool supports shared libraries... yes 2024-09-11T00:25:58.642 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether to build shared libraries... yes 2024-09-11T00:25:58.642 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether to build static libraries... yes 2024-09-11T00:25:58.656 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc... (cached) gcc 2024-09-11T00:25:58.691 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-11T00:25:58.692 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-11T00:25:58.692 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-11T00:25:58.692 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gmake... /usr/bin/gmake 2024-09-11T00:25:58.692 INFO:teuthology.orchestra.run.smithi040.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-09-11T00:25:58.693 INFO:teuthology.orchestra.run.smithi040.stdout:checking for tar... /bin/tar 2024-09-11T00:25:58.693 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gzip... /bin/gzip 2024-09-11T00:25:58.721 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether gcc -MM is supported... yes 2024-09-11T00:25:58.721 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sort... /bin/sort 2024-09-11T00:25:58.721 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether ln -s works... yes 2024-09-11T00:25:58.722 INFO:teuthology.orchestra.run.smithi040.stdout:checking for rpm... /bin/rpm 2024-09-11T00:25:58.729 INFO:teuthology.orchestra.run.smithi040.stdout:checking for rpmbuild... no 2024-09-11T00:25:58.778 INFO:teuthology.orchestra.run.smithi040.stdout:checking assert.h usability... yes 2024-09-11T00:25:58.796 INFO:teuthology.orchestra.run.smithi040.stdout:checking assert.h presence... yes 2024-09-11T00:25:58.796 INFO:teuthology.orchestra.run.smithi040.stdout:checking for assert.h... yes 2024-09-11T00:25:58.851 INFO:teuthology.orchestra.run.smithi040.stdout:checking bstring.h usability... no 2024-09-11T00:25:58.876 INFO:teuthology.orchestra.run.smithi040.stdout:checking bstring.h presence... no 2024-09-11T00:25:58.876 INFO:teuthology.orchestra.run.smithi040.stdout:checking for bstring.h... no 2024-09-11T00:25:58.925 INFO:teuthology.orchestra.run.smithi040.stdout:checking libgen.h usability... yes 2024-09-11T00:25:58.943 INFO:teuthology.orchestra.run.smithi040.stdout:checking libgen.h presence... yes 2024-09-11T00:25:58.943 INFO:teuthology.orchestra.run.smithi040.stdout:checking for libgen.h... yes 2024-09-11T00:25:59.000 INFO:teuthology.orchestra.run.smithi040.stdout:checking dirent.h usability... yes 2024-09-11T00:25:59.019 INFO:teuthology.orchestra.run.smithi040.stdout:checking dirent.h presence... yes 2024-09-11T00:25:59.019 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dirent.h... yes 2024-09-11T00:25:59.112 INFO:teuthology.orchestra.run.smithi040.stdout:checking errno.h usability... yes 2024-09-11T00:25:59.131 INFO:teuthology.orchestra.run.smithi040.stdout:checking errno.h presence... yes 2024-09-11T00:25:59.131 INFO:teuthology.orchestra.run.smithi040.stdout:checking for errno.h... yes 2024-09-11T00:25:59.187 INFO:teuthology.orchestra.run.smithi040.stdout:checking malloc.h usability... yes 2024-09-11T00:25:59.207 INFO:teuthology.orchestra.run.smithi040.stdout:checking malloc.h presence... yes 2024-09-11T00:25:59.208 INFO:teuthology.orchestra.run.smithi040.stdout:checking for malloc.h... yes 2024-09-11T00:25:59.263 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid.h usability... no 2024-09-11T00:25:59.288 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid.h presence... no 2024-09-11T00:25:59.288 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid.h... no 2024-09-11T00:25:59.350 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid/uuid.h usability... yes 2024-09-11T00:25:59.371 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid/uuid.h presence... yes 2024-09-11T00:25:59.371 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid/uuid.h... yes 2024-09-11T00:25:59.426 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/uuid.h usability... no 2024-09-11T00:25:59.452 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/uuid.h presence... no 2024-09-11T00:25:59.452 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/uuid.h... no 2024-09-11T00:25:59.518 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/file.h usability... yes 2024-09-11T00:25:59.538 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/file.h presence... yes 2024-09-11T00:25:59.539 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/file.h... yes 2024-09-11T00:25:59.600 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fcntl.h usability... yes 2024-09-11T00:25:59.620 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fcntl.h presence... yes 2024-09-11T00:25:59.620 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/fcntl.h... yes 2024-09-11T00:25:59.676 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/syssgi.h usability... no 2024-09-11T00:25:59.701 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/syssgi.h presence... no 2024-09-11T00:25:59.701 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/syssgi.h... no 2024-09-11T00:25:59.781 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/param.h usability... yes 2024-09-11T00:25:59.805 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/param.h presence... yes 2024-09-11T00:25:59.805 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/param.h... yes 2024-09-11T00:25:59.818 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/stat.h... (cached) yes 2024-09-11T00:25:59.881 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/statvfs.h usability... yes 2024-09-11T00:25:59.900 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/statvfs.h presence... yes 2024-09-11T00:25:59.900 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/statvfs.h... yes 2024-09-11T00:25:59.956 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/time.h usability... yes 2024-09-11T00:25:59.975 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/time.h presence... yes 2024-09-11T00:25:59.975 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/time.h... yes 2024-09-11T00:26:00.051 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/ioctl.h usability... yes 2024-09-11T00:26:00.070 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/ioctl.h presence... yes 2024-09-11T00:26:00.070 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/ioctl.h... yes 2024-09-11T00:26:00.135 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/wait.h usability... yes 2024-09-11T00:26:00.157 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/wait.h presence... yes 2024-09-11T00:26:00.157 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/wait.h... yes 2024-09-11T00:26:00.169 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/types.h... (cached) yes 2024-09-11T00:26:00.181 INFO:teuthology.orchestra.run.smithi040.stdout:checking for strings.h... (cached) yes 2024-09-11T00:26:00.237 INFO:teuthology.orchestra.run.smithi040.stdout:checking err.h usability... yes 2024-09-11T00:26:00.255 INFO:teuthology.orchestra.run.smithi040.stdout:checking err.h presence... yes 2024-09-11T00:26:00.255 INFO:teuthology.orchestra.run.smithi040.stdout:checking for err.h... yes 2024-09-11T00:26:00.311 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/falloc.h usability... yes 2024-09-11T00:26:00.328 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/falloc.h presence... yes 2024-09-11T00:26:00.328 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/falloc.h... yes 2024-09-11T00:26:00.383 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-09-11T00:26:00.409 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-09-11T00:26:00.409 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/fs/xfs_fsops.h... no 2024-09-11T00:26:00.457 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_itable.h usability... no 2024-09-11T00:26:00.483 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_itable.h presence... no 2024-09-11T00:26:00.483 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/fs/xfs_itable.h... no 2024-09-11T00:26:00.531 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/platform_defs.h usability... no 2024-09-11T00:26:00.558 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/platform_defs.h presence... no 2024-09-11T00:26:00.558 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/platform_defs.h... no 2024-09-11T00:26:00.606 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfs/ioctl.h usability... no 2024-09-11T00:26:00.632 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfs/ioctl.h presence... no 2024-09-11T00:26:00.633 INFO:teuthology.orchestra.run.smithi040.stdout:checking for btrfs/ioctl.h... no 2024-09-11T00:26:00.681 INFO:teuthology.orchestra.run.smithi040.stdout:checking cifs/ioctl.h usability... no 2024-09-11T00:26:00.706 INFO:teuthology.orchestra.run.smithi040.stdout:checking cifs/ioctl.h presence... no 2024-09-11T00:26:00.707 INFO:teuthology.orchestra.run.smithi040.stdout:checking for cifs/ioctl.h... no 2024-09-11T00:26:00.764 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/mman.h usability... yes 2024-09-11T00:26:00.782 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/mman.h presence... yes 2024-09-11T00:26:00.783 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/mman.h... yes 2024-09-11T00:26:00.838 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/ext4.h usability... no 2024-09-11T00:26:00.863 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/ext4.h presence... no 2024-09-11T00:26:00.864 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/ext4.h... no 2024-09-11T00:26:00.892 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/xfs_log_format.h... no 2024-09-11T00:26:00.970 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid_compare... no 2024-09-11T00:26:01.027 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid_compare in -luuid... yes 2024-09-11T00:26:01.140 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/xfs.h... yes 2024-09-11T00:26:01.170 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/libxfs.h... no 2024-09-11T00:26:01.206 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether xlog_assign_lsn is declared... no 2024-09-11T00:26:01.262 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/xqm.h... yes 2024-09-11T00:26:01.347 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfsctl from xfs/xfs.h... ok 2024-09-11T00:26:01.394 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/handle.h usability... yes 2024-09-11T00:26:01.411 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/handle.h presence... yes 2024-09-11T00:26:01.411 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/handle.h... yes 2024-09-11T00:26:01.478 INFO:teuthology.orchestra.run.smithi040.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-09-11T00:26:01.532 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/acl.h usability... yes 2024-09-11T00:26:01.553 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/acl.h presence... yes 2024-09-11T00:26:01.554 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/acl.h... yes 2024-09-11T00:26:01.604 INFO:teuthology.orchestra.run.smithi040.stdout:checking acl/libacl.h usability... yes 2024-09-11T00:26:01.624 INFO:teuthology.orchestra.run.smithi040.stdout:checking acl/libacl.h presence... yes 2024-09-11T00:26:01.624 INFO:teuthology.orchestra.run.smithi040.stdout:checking for acl/libacl.h... yes 2024-09-11T00:26:01.684 INFO:teuthology.orchestra.run.smithi040.stdout:checking for acl_init in -lacl... yes 2024-09-11T00:26:01.730 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm-ndbm.h usability... no 2024-09-11T00:26:01.755 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm-ndbm.h presence... no 2024-09-11T00:26:01.755 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gdbm-ndbm.h... no 2024-09-11T00:26:01.800 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm/ndbm.h usability... yes 2024-09-11T00:26:01.823 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm/ndbm.h presence... yes 2024-09-11T00:26:01.823 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gdbm/ndbm.h... yes 2024-09-11T00:26:01.890 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_open in -lgdbm... no 2024-09-11T00:26:01.956 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_fetch in -lgdbm... no 2024-09-11T00:26:02.022 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_store in -lgdbm... no 2024-09-11T00:26:02.088 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_close in -lgdbm... no 2024-09-11T00:26:02.157 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-09-11T00:26:02.215 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-09-11T00:26:02.275 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-09-11T00:26:02.336 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-09-11T00:26:02.383 INFO:teuthology.orchestra.run.smithi040.stdout:checking libaio.h usability... yes 2024-09-11T00:26:02.407 INFO:teuthology.orchestra.run.smithi040.stdout:checking libaio.h presence... yes 2024-09-11T00:26:02.407 INFO:teuthology.orchestra.run.smithi040.stdout:checking for libaio.h... yes 2024-09-11T00:26:02.453 INFO:teuthology.orchestra.run.smithi040.stdout:checking liburing.h usability... no 2024-09-11T00:26:02.478 INFO:teuthology.orchestra.run.smithi040.stdout:checking liburing.h presence... no 2024-09-11T00:26:02.478 INFO:teuthology.orchestra.run.smithi040.stdout:checking for liburing.h... no 2024-09-11T00:26:02.524 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/capability.h usability... yes 2024-09-11T00:26:02.546 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/capability.h presence... yes 2024-09-11T00:26:02.546 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/capability.h... yes 2024-09-11T00:26:02.593 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fiemap.h usability... yes 2024-09-11T00:26:02.611 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fiemap.h presence... yes 2024-09-11T00:26:02.611 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/fiemap.h... yes 2024-09-11T00:26:02.674 INFO:teuthology.orchestra.run.smithi040.stdout:checking for fallocate... yes 2024-09-11T00:26:02.737 INFO:teuthology.orchestra.run.smithi040.stdout:checking for open_by_handle_at... yes 2024-09-11T00:26:02.784 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fs.h usability... yes 2024-09-11T00:26:02.803 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fs.h presence... yes 2024-09-11T00:26:02.803 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/fs.h... yes 2024-09-11T00:26:02.846 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfsutil.h usability... no 2024-09-11T00:26:02.872 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfsutil.h presence... no 2024-09-11T00:26:02.872 INFO:teuthology.orchestra.run.smithi040.stdout:checking for btrfsutil.h... no 2024-09-11T00:26:02.958 INFO:teuthology.orchestra.run.smithi040.stdout:checking for copy_file_range... yes 2024-09-11T00:26:03.024 INFO:teuthology.orchestra.run.smithi040.stdout:checking for SEEK_DATA... yes 2024-09-11T00:26:03.110 INFO:teuthology.orchestra.run.smithi040.stdout:checking for BMV_OF_SHARED... yes 2024-09-11T00:26:03.176 INFO:teuthology.orchestra.run.smithi040.stdout:checking for nftw... yes 2024-09-11T00:26:03.247 INFO:teuthology.orchestra.run.smithi040.stdout:checking for RLIMIT_NOFILE... yes 2024-09-11T00:26:03.307 INFO:teuthology.orchestra.run.smithi040.stdout:checking for new enough XFS_IOC_EXCHANGE_RANGE... no 2024-09-11T00:26:03.369 INFO:teuthology.orchestra.run.smithi040.stdout:checking for FICLONE... yes 2024-09-11T00:26:03.431 INFO:teuthology.orchestra.run.smithi040.stdout:checking for renameat2... yes 2024-09-11T00:26:03.494 INFO:teuthology.orchestra.run.smithi040.stdout:checking for reallocarray... yes 2024-09-11T00:26:03.561 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct mount_attr... yes 2024-09-11T00:26:03.639 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_qgroup_limit... yes 2024-09-11T00:26:03.709 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-09-11T00:26:03.779 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-09-11T00:26:03.850 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-09-11T00:26:03.921 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-09-11T00:26:03.991 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-09-11T00:26:04.061 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-09-11T00:26:04.113 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs.h usability... yes 2024-09-11T00:26:04.132 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs.h presence... yes 2024-09-11T00:26:04.132 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/btrfs.h... yes 2024-09-11T00:26:04.192 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs_tree.h usability... yes 2024-09-11T00:26:04.212 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs_tree.h presence... yes 2024-09-11T00:26:04.212 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/btrfs_tree.h... yes 2024-09-11T00:26:04.265 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-09-11T00:26:04.312 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-09-11T00:26:04.340 INFO:teuthology.orchestra.run.smithi040.stdout:configure: creating ./config.status 2024-09-11T00:26:05.138 INFO:teuthology.orchestra.run.smithi040.stdout:config.status: creating include/builddefs 2024-09-11T00:26:05.165 INFO:teuthology.orchestra.run.smithi040.stdout:config.status: creating include/config.h 2024-09-11T00:26:05.186 INFO:teuthology.orchestra.run.smithi040.stdout:config.status: executing libtool commands 2024-09-11T00:26:05.262 INFO:teuthology.orchestra.run.smithi040.stdout:Building include 2024-09-11T00:26:05.269 INFO:teuthology.orchestra.run.smithi040.stdout:Building lib 2024-09-11T00:26:05.276 INFO:teuthology.orchestra.run.smithi040.stdout: [LTDEP] 2024-09-11T00:26:05.528 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dataascii.lo 2024-09-11T00:26:05.735 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] databin.lo 2024-09-11T00:26:05.963 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] datapid.lo 2024-09-11T00:26:06.154 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] file_lock.lo 2024-09-11T00:26:06.384 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] forker.lo 2024-09-11T00:26:06.595 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] pattern.lo 2024-09-11T00:26:06.786 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] open_flags.lo 2024-09-11T00:26:07.005 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] random_range.lo 2024-09-11T00:26:07.312 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] string_to_tokens.lo 2024-09-11T00:26:07.485 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] str_to_bytes.lo 2024-09-11T00:26:07.709 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] tlibio.lo 2024-09-11T00:26:08.038 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] write_log.lo 2024-09-11T00:26:08.361 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] random.lo 2024-09-11T00:26:08.539 INFO:teuthology.orchestra.run.smithi040.stdout: [LD] 2024-09-11T00:26:08.693 INFO:teuthology.orchestra.run.smithi040.stdout:Building ltp 2024-09-11T00:26:08.699 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2024-09-11T00:26:08.930 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] doio 2024-09-11T00:26:09.702 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsstress 2024-09-11T00:26:11.267 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsx 2024-09-11T00:26:12.110 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] growfiles 2024-09-11T00:26:12.728 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] iogen 2024-09-11T00:26:13.023 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:26:13.028 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:26:13.203 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-stress 2024-09-11T00:26:13.731 INFO:teuthology.orchestra.run.smithi040.stdout:Building src 2024-09-11T00:26:13.741 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2024-09-11T00:26:16.900 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2024-09-11T00:26:16.957 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2024-09-11T00:26:16.973 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2024-09-11T00:26:17.356 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2024-09-11T00:26:17.397 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dirstress 2024-09-11T00:26:17.726 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fill 2024-09-11T00:26:17.959 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fill2 2024-09-11T00:26:18.278 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] getpagesize 2024-09-11T00:26:18.494 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] holes 2024-09-11T00:26:18.778 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] lstat64 2024-09-11T00:26:19.045 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] nametest 2024-09-11T00:26:19.377 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] permname 2024-09-11T00:26:19.664 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] randholes 2024-09-11T00:26:20.004 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] runas 2024-09-11T00:26:20.264 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] truncfile 2024-09-11T00:26:20.529 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] usemem 2024-09-11T00:26:20.761 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mmapcat 2024-09-11T00:26:20.989 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] append_reader 2024-09-11T00:26:21.227 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] append_writer 2024-09-11T00:26:21.460 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dirperf 2024-09-11T00:26:21.775 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] metaperf 2024-09-11T00:26:22.153 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] devzero 2024-09-11T00:26:22.415 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] feature 2024-09-11T00:26:22.720 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] alloc 2024-09-11T00:26:23.018 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fault 2024-09-11T00:26:23.266 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fstest 2024-09-11T00:26:23.592 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_access_root 2024-09-11T00:26:23.827 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] godown 2024-09-11T00:26:24.085 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] resvtest 2024-09-11T00:26:24.357 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] writemod 2024-09-11T00:26:24.583 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] writev_on_pagefault 2024-09-11T00:26:24.826 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] makeextents 2024-09-11T00:26:25.090 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] itrash 2024-09-11T00:26:25.322 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] rename 2024-09-11T00:26:25.542 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] multi_open_unlink 2024-09-11T00:26:25.789 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] unwritten_sync 2024-09-11T00:26:26.056 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] genhashnames 2024-09-11T00:26:26.331 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_holes 2024-09-11T00:26:26.561 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_writev 2024-09-11T00:26:26.790 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_truncate_cmtime 2024-09-11T00:26:27.029 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dirhash_collide 2024-09-11T00:26:27.300 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_rename_overwrite 2024-09-11T00:26:27.520 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] holetest 2024-09-11T00:26:27.835 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_truncate_self 2024-09-11T00:26:28.056 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] af_unix 2024-09-11T00:26:28.295 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_stale_pmd 2024-09-11T00:26:28.530 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_cow_race 2024-09-11T00:26:28.779 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_fallocate 2024-09-11T00:26:29.009 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsync-err 2024-09-11T00:26:29.278 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_write_ro 2024-09-11T00:26:29.512 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_ext4_dax_journal_corruption 2024-09-11T00:26:29.754 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_ext4_dax_inline_corruption 2024-09-11T00:26:29.991 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_ofd_locks 2024-09-11T00:26:30.272 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_collision 2024-09-11T00:26:30.557 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mmap-write-concurrent 2024-09-11T00:26:30.809 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_get_file_time 2024-09-11T00:26:31.036 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_create_short_dirs 2024-09-11T00:26:31.287 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_create_long_dirs 2024-09-11T00:26:31.536 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_enospc 2024-09-11T00:26:31.809 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_writev_overlap 2024-09-11T00:26:32.061 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] checkpoint_journal 2024-09-11T00:26:32.298 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mmap-rw-fault 2024-09-11T00:26:32.566 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] allocstale 2024-09-11T00:26:32.823 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_cow_memory_failure 2024-09-11T00:26:33.076 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fake-dump-rootino 2024-09-11T00:26:33.308 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dio-buf-fault 2024-09-11T00:26:33.549 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] rewinddir-test 2024-09-11T00:26:33.802 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] readdir-while-renames 2024-09-11T00:26:34.048 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dio-append-buf-fault 2024-09-11T00:26:34.291 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] xfsctl 2024-09-11T00:26:34.571 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bstat 2024-09-11T00:26:34.868 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mtab 2024-09-11T00:26:35.139 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] getdevicesize 2024-09-11T00:26:35.362 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] preallo_rw_pattern_reader 2024-09-11T00:26:35.608 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] preallo_rw_pattern_writer 2024-09-11T00:26:35.850 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] ftrunc 2024-09-11T00:26:36.079 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] trunc 2024-09-11T00:26:36.325 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fs_perms 2024-09-11T00:26:36.572 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] testx 2024-09-11T00:26:36.781 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] looptest 2024-09-11T00:26:37.059 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] locktest 2024-09-11T00:26:37.458 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] unwritten_mmap 2024-09-11T00:26:37.707 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bulkstat_unlink_test 2024-09-11T00:26:37.996 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] deduperace 2024-09-11T00:26:38.283 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bulkstat_unlink_test_modified 2024-09-11T00:26:38.567 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_dir_offset 2024-09-11T00:26:38.798 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_futimens 2024-09-11T00:26:39.018 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_immutable 2024-09-11T00:26:39.744 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] stale_handle 2024-09-11T00:26:39.999 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] pwrite_mmap_blocked 2024-09-11T00:26:40.235 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_dir_offset2 2024-09-11T00:26:40.512 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] seek_sanity_test 2024-09-11T00:26:41.061 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] seek_copy_test 2024-09-11T00:26:41.321 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_readdir_1 2024-09-11T00:26:41.552 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_readdir_2 2024-09-11T00:26:41.787 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsync-tester 2024-09-11T00:26:42.127 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] nsexec 2024-09-11T00:26:42.390 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] cloner 2024-09-11T00:26:42.656 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] renameat2 2024-09-11T00:26:42.910 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_getcwd 2024-09-11T00:26:43.119 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:26:43.125 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:26:43.152 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] e4compact 2024-09-11T00:26:43.449 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] test-nextquota 2024-09-11T00:26:43.708 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] punch-alternating 2024-09-11T00:26:43.966 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] attr-list-by-handle-cursor-test 2024-09-11T00:26:44.219 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] listxattr 2024-09-11T00:26:44.447 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dio-interleaved 2024-09-11T00:26:44.690 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_dir_type 2024-09-11T00:26:44.931 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dio-invalidate-cache 2024-09-11T00:26:45.219 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] stat_test 2024-09-11T00:26:45.602 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_encrypted_d_revalidate 2024-09-11T00:26:45.852 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] attr_replace_test 2024-09-11T00:26:46.098 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] swapon 2024-09-11T00:26:46.346 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mkswap 2024-09-11T00:26:46.581 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_attr_corruption 2024-09-11T00:26:46.813 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_open_tmpfiles 2024-09-11T00:26:47.080 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fscrypt-crypt-util 2024-09-11T00:26:47.847 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bulkstat_null_ocount 2024-09-11T00:26:48.091 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] splice-test 2024-09-11T00:26:48.357 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] chprojid_fail 2024-09-11T00:26:48.605 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] detached_mounts_propagation 2024-09-11T00:26:48.880 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] ext4_resize 2024-09-11T00:26:49.112 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_readdir_3 2024-09-11T00:26:49.393 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] splice2pipe 2024-09-11T00:26:49.640 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] uuid_ioctl 2024-09-11T00:26:49.880 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_snapshot_deleted_subvolume 2024-09-11T00:26:50.130 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fiemap-fault 2024-09-11T00:26:50.369 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] min_dio_alignment 2024-09-11T00:26:50.608 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fiemap-tester 2024-09-11T00:26:50.961 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_stripealign 2024-09-11T00:26:51.198 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] open_by_handle 2024-09-11T00:26:51.537 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dbtest 2024-09-11T00:26:51.877 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_dio 2024-09-11T00:26:52.120 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] xfsfind 2024-09-11T00:26:52.405 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_reflink_read_race 2024-09-11T00:26:52.684 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fssum 2024-09-11T00:26:53.227 INFO:teuthology.orchestra.run.smithi040.stdout:Building log-writes 2024-09-11T00:26:53.237 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] replay-log 2024-09-11T00:26:53.662 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2024-09-11T00:26:53.669 INFO:teuthology.orchestra.run.smithi040.stdout:Building aio-dio-regress 2024-09-11T00:26:53.680 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aiocp 2024-09-11T00:26:53.994 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-append-write-fallocate-race 2024-09-11T00:26:54.246 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-append-write-read-race 2024-09-11T00:26:54.504 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-cow-race 2024-09-11T00:26:54.737 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-cycle-write 2024-09-11T00:26:55.004 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-eof-race 2024-09-11T00:26:55.268 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-extend-stat 2024-09-11T00:26:55.513 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-fcntl-race 2024-09-11T00:26:55.760 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-hole-filling-race 2024-09-11T00:26:55.989 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-invalidate-failure 2024-09-11T00:26:56.231 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-invalidate-readahead 2024-09-11T00:26:56.479 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aiodio_sparse2 2024-09-11T00:26:56.783 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-subblock-eof-read 2024-09-11T00:26:57.007 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-write-verify 2024-09-11T00:26:57.286 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-09-11T00:26:57.500 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-09-11T00:26:57.713 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-last-ref-held-by-io 2024-09-11T00:26:57.966 INFO:teuthology.orchestra.run.smithi040.stdout:Building vfs 2024-09-11T00:26:57.976 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] vfstest 2024-09-11T00:27:01.864 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mount-idmapped 2024-09-11T00:27:02.358 INFO:teuthology.orchestra.run.smithi040.stdout:Building m4 2024-09-11T00:27:02.365 INFO:teuthology.orchestra.run.smithi040.stdout:Building common 2024-09-11T00:27:02.372 INFO:teuthology.orchestra.run.smithi040.stdout:Building tests 2024-09-11T00:27:02.382 INFO:teuthology.orchestra.run.smithi040.stdout:Building btrfs 2024-09-11T00:27:02.394 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/btrfs/group.list 2024-09-11T00:27:02.552 INFO:teuthology.orchestra.run.smithi040.stdout:Building ceph 2024-09-11T00:27:02.562 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/ceph/group.list 2024-09-11T00:27:02.598 INFO:teuthology.orchestra.run.smithi040.stdout:Building cifs 2024-09-11T00:27:02.608 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/cifs/group.list 2024-09-11T00:27:02.639 INFO:teuthology.orchestra.run.smithi040.stdout:Building ext4 2024-09-11T00:27:02.649 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/ext4/group.list 2024-09-11T00:27:02.747 INFO:teuthology.orchestra.run.smithi040.stdout:Building f2fs 2024-09-11T00:27:02.757 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/f2fs/group.list 2024-09-11T00:27:02.803 INFO:teuthology.orchestra.run.smithi040.stdout:Building generic 2024-09-11T00:27:02.815 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/generic/group.list 2024-09-11T00:27:03.064 INFO:teuthology.orchestra.run.smithi040.stdout:Building nfs 2024-09-11T00:27:03.074 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/nfs/group.list 2024-09-11T00:27:03.110 INFO:teuthology.orchestra.run.smithi040.stdout:Building ocfs2 2024-09-11T00:27:03.120 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/ocfs2/group.list 2024-09-11T00:27:03.154 INFO:teuthology.orchestra.run.smithi040.stdout:Building overlay 2024-09-11T00:27:03.164 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/overlay/group.list 2024-09-11T00:27:03.267 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2024-09-11T00:27:03.277 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/perf/group.list 2024-09-11T00:27:03.306 INFO:teuthology.orchestra.run.smithi040.stdout:Building selftest 2024-09-11T00:27:03.315 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/selftest/group.list 2024-09-11T00:27:03.346 INFO:teuthology.orchestra.run.smithi040.stdout:Building tmpfs 2024-09-11T00:27:03.356 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/tmpfs/group.list 2024-09-11T00:27:03.390 INFO:teuthology.orchestra.run.smithi040.stdout:Building udf 2024-09-11T00:27:03.400 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/udf/group.list 2024-09-11T00:27:03.429 INFO:teuthology.orchestra.run.smithi040.stdout:Building xfs 2024-09-11T00:27:03.441 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/xfs/group.list 2024-09-11T00:27:03.697 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.URgBntWUNGxfstests-dev && exec sudo make install) 2024-09-11T00:27:03.778 INFO:teuthology.orchestra.run.smithi040.stdout:Building include 2024-09-11T00:27:03.784 INFO:teuthology.orchestra.run.smithi040.stdout:Building lib 2024-09-11T00:27:03.792 INFO:teuthology.orchestra.run.smithi040.stdout:Building ltp 2024-09-11T00:27:03.800 INFO:teuthology.orchestra.run.smithi040.stdout:Building src 2024-09-11T00:27:03.862 INFO:teuthology.orchestra.run.smithi040.stdout:Building log-writes 2024-09-11T00:27:03.870 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2024-09-11T00:27:03.877 INFO:teuthology.orchestra.run.smithi040.stdout:Building aio-dio-regress 2024-09-11T00:27:03.885 INFO:teuthology.orchestra.run.smithi040.stdout:Building vfs 2024-09-11T00:27:03.892 INFO:teuthology.orchestra.run.smithi040.stdout:Building m4 2024-09-11T00:27:03.900 INFO:teuthology.orchestra.run.smithi040.stdout:Building common 2024-09-11T00:27:03.907 INFO:teuthology.orchestra.run.smithi040.stdout:Building tests 2024-09-11T00:27:03.917 INFO:teuthology.orchestra.run.smithi040.stdout:Building btrfs 2024-09-11T00:27:03.928 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/btrfs/group.list 2024-09-11T00:27:04.084 INFO:teuthology.orchestra.run.smithi040.stdout:Building ceph 2024-09-11T00:27:04.093 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/ceph/group.list 2024-09-11T00:27:04.130 INFO:teuthology.orchestra.run.smithi040.stdout:Building cifs 2024-09-11T00:27:04.140 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/cifs/group.list 2024-09-11T00:27:04.171 INFO:teuthology.orchestra.run.smithi040.stdout:Building ext4 2024-09-11T00:27:04.181 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/ext4/group.list 2024-09-11T00:27:04.277 INFO:teuthology.orchestra.run.smithi040.stdout:Building f2fs 2024-09-11T00:27:04.287 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/f2fs/group.list 2024-09-11T00:27:04.333 INFO:teuthology.orchestra.run.smithi040.stdout:Building generic 2024-09-11T00:27:04.346 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/generic/group.list 2024-09-11T00:27:04.588 INFO:teuthology.orchestra.run.smithi040.stdout:Building nfs 2024-09-11T00:27:04.598 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/nfs/group.list 2024-09-11T00:27:04.635 INFO:teuthology.orchestra.run.smithi040.stdout:Building ocfs2 2024-09-11T00:27:04.645 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/ocfs2/group.list 2024-09-11T00:27:04.678 INFO:teuthology.orchestra.run.smithi040.stdout:Building overlay 2024-09-11T00:27:04.688 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/overlay/group.list 2024-09-11T00:27:04.791 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2024-09-11T00:27:04.801 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/perf/group.list 2024-09-11T00:27:04.830 INFO:teuthology.orchestra.run.smithi040.stdout:Building selftest 2024-09-11T00:27:04.839 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/selftest/group.list 2024-09-11T00:27:04.871 INFO:teuthology.orchestra.run.smithi040.stdout:Building tmpfs 2024-09-11T00:27:04.880 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/tmpfs/group.list 2024-09-11T00:27:04.914 INFO:teuthology.orchestra.run.smithi040.stdout:Building udf 2024-09-11T00:27:04.924 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/udf/group.list 2024-09-11T00:27:04.952 INFO:teuthology.orchestra.run.smithi040.stdout:Building xfs 2024-09-11T00:27:04.964 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/xfs/group.list 2024-09-11T00:27:05.209 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-09-11T00:27:05.211 INFO:teuthology.orchestra.run.smithi040.stdout:gmake[1]: Nothing to be done for 'install'. 2024-09-11T00:27:05.211 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-09-11T00:27:05.214 INFO:teuthology.orchestra.run.smithi040.stdout:gmake[1]: Nothing to be done for 'install'. 2024-09-11T00:27:05.215 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-09-11T00:27:05.218 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-09-11T00:27:05.240 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-09-11T00:27:05.400 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-09-11T00:27:05.422 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-09-11T00:27:05.453 INFO:teuthology.orchestra.run.smithi040.stdout:Building log-writes 2024-09-11T00:27:05.460 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2024-09-11T00:27:05.467 INFO:teuthology.orchestra.run.smithi040.stdout:Building aio-dio-regress 2024-09-11T00:27:05.476 INFO:teuthology.orchestra.run.smithi040.stdout:Building vfs 2024-09-11T00:27:05.481 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C log-writes install 2024-09-11T00:27:05.483 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-09-11T00:27:05.506 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-09-11T00:27:05.527 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C perf install 2024-09-11T00:27:05.530 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-09-11T00:27:05.552 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-09-11T00:27:05.608 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-09-11T00:27:05.612 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-09-11T00:27:05.639 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-09-11T00:27:05.762 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C vfs install 2024-09-11T00:27:05.765 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-09-11T00:27:05.786 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-09-11T00:27:05.817 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-09-11T00:27:05.838 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames dio-append-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-fault min_dio_alignment fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-09-11T00:27:08.766 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-09-11T00:27:08.988 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-09-11T00:27:09.035 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-09-11T00:27:09.038 INFO:teuthology.orchestra.run.smithi040.stdout:gmake[1]: Nothing to be done for 'install'. 2024-09-11T00:27:09.038 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-09-11T00:27:09.041 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-09-11T00:27:09.062 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-09-11T00:27:09.413 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-09-11T00:27:09.415 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.URgBntWUNGxfstests-dev/tests/btrfs/ install 2024-09-11T00:27:09.421 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/btrfs/group.list 2024-09-11T00:27:09.575 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-09-11T00:27:09.597 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 330 331 332 /var/lib/xfstests/tests/btrfs 2024-09-11T00:27:11.780 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-09-11T00:27:11.801 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 330.out 331.out 332.out /var/lib/xfstests/tests/btrfs 2024-09-11T00:27:13.242 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:27:13.246 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:27:13.998 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.URgBntWUNGxfstests-dev/tests/ceph/ install 2024-09-11T00:27:14.002 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/ceph/group.list 2024-09-11T00:27:14.036 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-09-11T00:27:14.058 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-09-11T00:27:14.107 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-09-11T00:27:14.128 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-09-11T00:27:14.177 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.URgBntWUNGxfstests-dev/tests/cifs/ install 2024-09-11T00:27:14.182 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/cifs/group.list 2024-09-11T00:27:14.210 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-09-11T00:27:14.232 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-09-11T00:27:14.254 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-09-11T00:27:14.276 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-09-11T00:27:14.298 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.URgBntWUNGxfstests-dev/tests/ext4/ install 2024-09-11T00:27:14.302 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/ext4/group.list 2024-09-11T00:27:14.399 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-09-11T00:27:14.421 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-09-11T00:27:14.890 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-09-11T00:27:14.912 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-09-11T00:27:15.404 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.URgBntWUNGxfstests-dev/tests/f2fs/ install 2024-09-11T00:27:15.408 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/f2fs/group.list 2024-09-11T00:27:15.453 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-09-11T00:27:15.474 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 /var/lib/xfstests/tests/f2fs 2024-09-11T00:27:15.517 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-09-11T00:27:15.538 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out /var/lib/xfstests/tests/f2fs 2024-09-11T00:27:15.580 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.URgBntWUNGxfstests-dev/tests/generic/ install 2024-09-11T00:27:15.586 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/generic/group.list 2024-09-11T00:27:15.831 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-09-11T00:27:15.852 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 /var/lib/xfstests/tests/generic 2024-09-11T00:27:20.886 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-09-11T00:27:20.907 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out /var/lib/xfstests/tests/generic 2024-09-11T00:27:25.972 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.URgBntWUNGxfstests-dev/tests/nfs/ install 2024-09-11T00:27:25.976 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/nfs/group.list 2024-09-11T00:27:26.011 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-09-11T00:27:26.033 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-09-11T00:27:26.054 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-09-11T00:27:26.076 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-09-11T00:27:26.098 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.URgBntWUNGxfstests-dev/tests/ocfs2/ install 2024-09-11T00:27:26.103 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/ocfs2/group.list 2024-09-11T00:27:26.135 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-09-11T00:27:26.156 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-09-11T00:27:26.178 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-09-11T00:27:26.200 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-09-11T00:27:26.222 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.URgBntWUNGxfstests-dev/tests/overlay/ install 2024-09-11T00:27:26.227 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/overlay/group.list 2024-09-11T00:27:26.329 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-09-11T00:27:26.351 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-09-11T00:27:27.064 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-09-11T00:27:27.085 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-09-11T00:27:27.803 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.URgBntWUNGxfstests-dev/tests/perf/ install 2024-09-11T00:27:27.807 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/perf/group.list 2024-09-11T00:27:27.834 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-09-11T00:27:27.856 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-09-11T00:27:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-09-11T00:27:27.900 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-09-11T00:27:27.922 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.URgBntWUNGxfstests-dev/tests/selftest/ install 2024-09-11T00:27:27.927 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/selftest/group.list 2024-09-11T00:27:27.956 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-09-11T00:27:27.978 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-09-11T00:27:28.033 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-09-11T00:27:28.054 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-09-11T00:27:28.110 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.URgBntWUNGxfstests-dev/tests/tmpfs/ install 2024-09-11T00:27:28.114 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/tmpfs/group.list 2024-09-11T00:27:28.146 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-09-11T00:27:28.168 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-09-11T00:27:28.190 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-09-11T00:27:28.212 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-09-11T00:27:28.234 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.URgBntWUNGxfstests-dev/tests/udf/ install 2024-09-11T00:27:28.238 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/udf/group.list 2024-09-11T00:27:28.265 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-09-11T00:27:28.286 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-09-11T00:27:28.308 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-09-11T00:27:28.330 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-09-11T00:27:28.352 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.URgBntWUNGxfstests-dev/tests/xfs/ install 2024-09-11T00:27:28.358 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.URgBntWUNGxfstests-dev/tests/xfs/group.list 2024-09-11T00:27:28.605 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-09-11T00:27:28.627 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 801 /var/lib/xfstests/tests/xfs 2024-09-11T00:27:33.469 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-09-11T00:27:33.491 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 021.out.default 021.out.parent 033.out.crc 033.out.default 071.out.32 071.out.64 216.out.64mblog 216.out.classic 614.out.lba1024 614.out.lba2048 614.out.lba4096 614.out.lba512 021.cfg 033.cfg 216.cfg 614.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 612.out 613.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out 801.out /var/lib/xfstests/tests/xfs 2024-09-11T00:27:38.448 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-09-11T00:27:38.468 INFO:teuthology.orchestra.run.smithi040.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-09-11T00:27:38.490 INFO:teuthology.orchestra.run.smithi040.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-09-11T00:27:38.512 INFO:teuthology.orchestra.run.smithi040.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-09-11T00:27:38.538 INFO:tasks.cephfs.test_acls:client is fuse mounted 2024-09-11T00:27:38.538 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-11T00:27:38.538 DEBUG:teuthology.orchestra.run.smithi040:running tests for ACLs from xfstests-dev> (cd /tmp/tmp.URgBntWUNGxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-09-11T00:27:38.893 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2024-09-11T00:27:38.903 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.11.0-rc5-g2ca44a2f35ca #1 SMP PREEMPT_DYNAMIC Fri Sep 6 13:00:42 UTC 2024 2024-09-11T00:27:38.904 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:27:39.718 INFO:teuthology.orchestra.run.smithi040.stdout:generic/099 1s 2024-09-11T00:27:39.732 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/099 2024-09-11T00:27:39.732 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-11T00:27:39.738 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:27:39.741 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[47969]: fuse finished with error 0 and tester_r 0 2024-09-11T00:27:39.761 INFO:tasks.cephfs.test_acls:Command return value: 0 2024-09-11T00:27:39.761 INFO:tasks.cephfs.test_acls:Command stdout - FSTYP -- ceph-fuse PLATFORM -- Linux/x86_64 smithi040 6.11.0-rc5-g2ca44a2f35ca #1 SMP PREEMPT_DYNAMIC Fri Sep 6 13:00:42 UTC 2024 generic/099 1s Ran: generic/099 Passed all 1 tests 2024-09-11T00:27:39.761 INFO:tasks.cephfs.test_acls:Command stderr - 2024-09-11T00:27:39.761 DEBUG:teuthology.orchestra.run.smithi040:> sudo userdel --force --remove fsgqa 2024-09-11T00:27:40.528 DEBUG:teuthology.orchestra.run.smithi040:> sudo userdel --force --remove 123456-fsgqa 2024-09-11T00:27:41.172 DEBUG:teuthology.orchestra.run.smithi040:> sudo groupdel fsgqa 2024-09-11T00:27:41.230 INFO:teuthology.orchestra.run.smithi040.stderr:groupdel: group 'fsgqa' does not exist 2024-09-11T00:27:41.233 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T00:27:41.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:27:41.233 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.URgBntWUNGxfstests-dev/results) 2024-09-11T00:27:41.267 INFO:teuthology.orchestra.run.smithi040.stderr:bash: line 1: cd: /home/ubuntu/cephtest/mnt.0: Permission denied 2024-09-11T00:27:41.268 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:27:41.268 INFO:tasks.cephfs.xfstests_dev:xfstests-dev repo contains not directory named "results". repo location: /tmp/tmp.URgBntWUNGxfstests-dev 2024-09-11T00:27:41.268 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf /tmp/tmp.URgBntWUNGxfstests-dev 2024-09-11T00:27:41.596 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T00:27:41.597 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T00:27:41.686 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T00:27:41.783 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T00:27:41.784 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T00:27:41.784 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:27:41.784 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:27:41.819 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T00:27:41.820 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T00:27:41.820 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:27:41.820 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:27:41.857 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T00:27:41.858 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T00:27:41.858 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:27:41.858 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:27:41.895 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T00:27:41.895 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T00:27:41.895 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:27:41.895 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:27:41.934 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T00:27:41.934 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:27:42.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.095+0000 7fd529000640 1 -- 172.21.15.40:0/3425775258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5240cba70 msgr2=0x7fd5240cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:42.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.095+0000 7fd529000640 1 --2- 172.21.15.40:0/3425775258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5240cba70 0x7fd5240cbe90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd50c005fd0 tx=0x7fd50c02a5d0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.095+0000 7fd529000640 1 -- 172.21.15.40:0/3425775258 shutdown_connections 2024-09-11T00:27:42.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.095+0000 7fd529000640 1 --2- 172.21.15.40:0/3425775258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5240cba70 0x7fd5240cbe90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.095+0000 7fd529000640 1 --2- 172.21.15.40:0/3425775258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd52415bcc0 0x7fd5240cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.095+0000 7fd529000640 1 -- 172.21.15.40:0/3425775258 >> 172.21.15.40:0/3425775258 conn(0x7fd5240cfbb0 msgr2=0x7fd5240cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:42.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.095+0000 7fd529000640 1 -- 172.21.15.40:0/3425775258 shutdown_connections 2024-09-11T00:27:42.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.095+0000 7fd529000640 1 -- 172.21.15.40:0/3425775258 wait complete. 2024-09-11T00:27:42.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.097+0000 7fd529000640 1 Processor -- start 2024-09-11T00:27:42.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.097+0000 7fd529000640 1 -- start start 2024-09-11T00:27:42.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.098+0000 7fd529000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5240ca200 0x7fd52415eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:42.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.098+0000 7fd529000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5240cba70 0x7fd5240aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:42.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.098+0000 7fd529000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd52415bcc0 0x7fd5240c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:42.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.098+0000 7fd529000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd52415f940 con 0x7fd5240cba70 2024-09-11T00:27:42.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.098+0000 7fd529000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd52415f7c0 con 0x7fd52415bcc0 2024-09-11T00:27:42.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.098+0000 7fd529000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd5240cadc0 con 0x7fd5240ca200 2024-09-11T00:27:42.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.098+0000 7fd519400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5240cba70 0x7fd5240aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:42.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.098+0000 7fd519400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5240cba70 0x7fd5240aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49766/0 (socket says 172.21.15.40:49766) 2024-09-11T00:27:42.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.098+0000 7fd519400640 1 -- 172.21.15.40:0/3219460093 learned_addr learned my addr 172.21.15.40:0/3219460093 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:42.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.098+0000 7fd522800640 1 --2- 172.21.15.40:0/3219460093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd52415bcc0 0x7fd5240c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:42.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.098+0000 7fd521e00640 1 --2- 172.21.15.40:0/3219460093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5240ca200 0x7fd52415eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:42.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.098+0000 7fd519400640 1 -- 172.21.15.40:0/3219460093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5240ca200 msgr2=0x7fd52415eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:42.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.098+0000 7fd519400640 1 --2- 172.21.15.40:0/3219460093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5240ca200 0x7fd52415eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.098+0000 7fd519400640 1 -- 172.21.15.40:0/3219460093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd52415bcc0 msgr2=0x7fd5240c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:42.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.098+0000 7fd519400640 1 --2- 172.21.15.40:0/3219460093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd52415bcc0 0x7fd5240c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.098+0000 7fd519400640 1 -- 172.21.15.40:0/3219460093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5240ad9a0 con 0x7fd5240cba70 2024-09-11T00:27:42.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.098+0000 7fd522800640 1 --2- 172.21.15.40:0/3219460093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd52415bcc0 0x7fd5240c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:27:42.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.099+0000 7fd519400640 1 --2- 172.21.15.40:0/3219460093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5240cba70 0x7fd5240aea40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009850 tx=0x7fd50c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:42.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.099+0000 7fd51aa00640 1 -- 172.21.15.40:0/3219460093 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c03f070 con 0x7fd5240cba70 2024-09-11T00:27:42.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.099+0000 7fd51aa00640 1 -- 172.21.15.40:0/3219460093 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd50c003ce0 con 0x7fd5240cba70 2024-09-11T00:27:42.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.099+0000 7fd529000640 1 -- 172.21.15.40:0/3219460093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5240adc80 con 0x7fd5240cba70 2024-09-11T00:27:42.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.099+0000 7fd51aa00640 1 -- 172.21.15.40:0/3219460093 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c035030 con 0x7fd5240cba70 2024-09-11T00:27:42.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.099+0000 7fd529000640 1 -- 172.21.15.40:0/3219460093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5240ae240 con 0x7fd5240cba70 2024-09-11T00:27:42.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.100+0000 7fd529000640 1 -- 172.21.15.40:0/3219460093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5240cbe90 con 0x7fd5240cba70 2024-09-11T00:27:42.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.101+0000 7fd51aa00640 1 -- 172.21.15.40:0/3219460093 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd50c004a00 con 0x7fd5240cba70 2024-09-11T00:27:42.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.102+0000 7fd51aa00640 1 --2- 172.21.15.40:0/3219460093 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fd500077f70 0x7fd50007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:42.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.102+0000 7fd51aa00640 1 -- 172.21.15.40:0/3219460093 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fd50c0babd0 con 0x7fd5240cba70 2024-09-11T00:27:42.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.103+0000 7fd521e00640 1 --2- 172.21.15.40:0/3219460093 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fd500077f70 0x7fd50007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:42.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.103+0000 7fd521e00640 1 --2- 172.21.15.40:0/3219460093 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fd500077f70 0x7fd50007a430 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd514009b30 tx=0x7fd514005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:42.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.106+0000 7fd51aa00640 1 -- 172.21.15.40:0/3219460093 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd50c083070 con 0x7fd5240cba70 2024-09-11T00:27:42.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.338+0000 7fd529000640 1 -- 172.21.15.40:0/3219460093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5240afab0 con 0x7fd5240cba70 2024-09-11T00:27:42.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.339+0000 7fd51aa00640 1 -- 172.21.15.40:0/3219460093 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7fd50c087aa0 con 0x7fd5240cba70 2024-09-11T00:27:42.341 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:27:42.341 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"btime":"2024-09-11T00:24:45:383933+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2499570202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2499570202},{"type":"v1","addr":"172.21.15.40:6835","nonce":2499570202}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4885,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2232689934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2232689934},{"type":"v1","addr":"172.21.15.175:6836","nonce":2232689934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/4012257321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":4012257321},{"type":"v1","addr":"172.21.15.175:6837","nonce":4012257321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:24:41.799375+0000","modified":"2024-09-11T00:24:44.819725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/2666966234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2666966234},{"type":"v1","addr":"172.21.15.40:6834","nonce":2666966234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4944,"qdb_cluster":[4944]},"id":2}]} 2024-09-11T00:27:42.341 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 16 2024-09-11T00:27:42.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.341+0000 7fd529000640 1 -- 172.21.15.40:0/3219460093 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fd500077f70 msgr2=0x7fd50007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:42.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.341+0000 7fd529000640 1 --2- 172.21.15.40:0/3219460093 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fd500077f70 0x7fd50007a430 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd514009b30 tx=0x7fd514005f90 comp rx=0 tx=0).stop 2024-09-11T00:27:42.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.341+0000 7fd529000640 1 -- 172.21.15.40:0/3219460093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5240cba70 msgr2=0x7fd5240aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:42.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.341+0000 7fd529000640 1 --2- 172.21.15.40:0/3219460093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5240cba70 0x7fd5240aea40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009850 tx=0x7fd50c0035f0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.341+0000 7fd529000640 1 -- 172.21.15.40:0/3219460093 shutdown_connections 2024-09-11T00:27:42.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.341+0000 7fd529000640 1 --2- 172.21.15.40:0/3219460093 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fd500077f70 0x7fd50007a430 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.341+0000 7fd529000640 1 --2- 172.21.15.40:0/3219460093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd52415bcc0 0x7fd5240c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.341+0000 7fd529000640 1 --2- 172.21.15.40:0/3219460093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5240cba70 0x7fd5240aea40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.341+0000 7fd529000640 1 --2- 172.21.15.40:0/3219460093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5240ca200 0x7fd52415eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.341+0000 7fd529000640 1 -- 172.21.15.40:0/3219460093 >> 172.21.15.40:0/3219460093 conn(0x7fd5240cfbb0 msgr2=0x7fd5240cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:42.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.342+0000 7fd529000640 1 -- 172.21.15.40:0/3219460093 shutdown_connections 2024-09-11T00:27:42.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.342+0000 7fd529000640 1 -- 172.21.15.40:0/3219460093 wait complete. 2024-09-11T00:27:42.359 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:27:42.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.518+0000 7fbeaf000640 1 -- 172.21.15.40:0/3315407690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbea80cd780 msgr2=0x7fbea80cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:42.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.518+0000 7fbeaf000640 1 --2- 172.21.15.40:0/3315407690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbea80cd780 0x7fbea80cdbd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbea0005fd0 tx=0x7fbea002a8a0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.518+0000 7fbeaf000640 1 -- 172.21.15.40:0/3315407690 shutdown_connections 2024-09-11T00:27:42.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.518+0000 7fbeaf000640 1 --2- 172.21.15.40:0/3315407690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbea80cd780 0x7fbea80cdbd0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.518+0000 7fbeaf000640 1 --2- 172.21.15.40:0/3315407690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbea815f050 0x7fbea815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.518+0000 7fbeaf000640 1 -- 172.21.15.40:0/3315407690 >> 172.21.15.40:0/3315407690 conn(0x7fbea80cfbb0 msgr2=0x7fbea80cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:42.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.518+0000 7fbeaf000640 1 -- 172.21.15.40:0/3315407690 shutdown_connections 2024-09-11T00:27:42.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.518+0000 7fbeaf000640 1 -- 172.21.15.40:0/3315407690 wait complete. 2024-09-11T00:27:42.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.520+0000 7fbeaf000640 1 Processor -- start 2024-09-11T00:27:42.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.520+0000 7fbeaf000640 1 -- start start 2024-09-11T00:27:42.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.521+0000 7fbeaf000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbea80cd780 0x7fbea80b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:42.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.521+0000 7fbeaf000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbea815ec70 0x7fbea814c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:42.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.521+0000 7fbeaf000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbea815f050 0x7fbea81578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:42.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.521+0000 7fbeaf000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbea81680c0 con 0x7fbea815ec70 2024-09-11T00:27:42.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.521+0000 7fbeaf000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbea8167f40 con 0x7fbea815f050 2024-09-11T00:27:42.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.521+0000 7fbeaf000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbea8168240 con 0x7fbea80cd780 2024-09-11T00:27:42.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.521+0000 7fbe9f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbea815ec70 0x7fbea814c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:42.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.521+0000 7fbe9f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbea815ec70 0x7fbea814c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49786/0 (socket says 172.21.15.40:49786) 2024-09-11T00:27:42.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.521+0000 7fbe9f400640 1 -- 172.21.15.40:0/77141754 learned_addr learned my addr 172.21.15.40:0/77141754 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:42.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.521+0000 7fbead000640 1 --2- 172.21.15.40:0/77141754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbea815f050 0x7fbea81578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:42.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.521+0000 7fbea7e00640 1 --2- 172.21.15.40:0/77141754 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbea80cd780 0x7fbea80b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:42.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.521+0000 7fbe9f400640 1 -- 172.21.15.40:0/77141754 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbea80cd780 msgr2=0x7fbea80b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:42.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.521+0000 7fbe9f400640 1 --2- 172.21.15.40:0/77141754 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbea80cd780 0x7fbea80b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.521+0000 7fbe9f400640 1 -- 172.21.15.40:0/77141754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbea815f050 msgr2=0x7fbea81578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:42.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.521+0000 7fbe9f400640 1 --2- 172.21.15.40:0/77141754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbea815f050 0x7fbea81578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.521+0000 7fbe9f400640 1 -- 172.21.15.40:0/77141754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea81554c0 con 0x7fbea815ec70 2024-09-11T00:27:42.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.522+0000 7fbe9f400640 1 --2- 172.21.15.40:0/77141754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbea815ec70 0x7fbea814c560 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000d740 tx=0x7fbe9000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:42.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.522+0000 7fbea4c00640 1 -- 172.21.15.40:0/77141754 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe90017070 con 0x7fbea815ec70 2024-09-11T00:27:42.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.522+0000 7fbea4c00640 1 -- 172.21.15.40:0/77141754 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe90009d20 con 0x7fbea815ec70 2024-09-11T00:27:42.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.522+0000 7fbeaf000640 1 -- 172.21.15.40:0/77141754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea81551e0 con 0x7fbea815ec70 2024-09-11T00:27:42.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.522+0000 7fbea4c00640 1 -- 172.21.15.40:0/77141754 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe900106c0 con 0x7fbea815ec70 2024-09-11T00:27:42.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.522+0000 7fbeaf000640 1 -- 172.21.15.40:0/77141754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea80c86d0 con 0x7fbea815ec70 2024-09-11T00:27:42.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.523+0000 7fbeaf000640 1 -- 172.21.15.40:0/77141754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbea80c8bb0 con 0x7fbea815ec70 2024-09-11T00:27:42.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.524+0000 7fbea4c00640 1 -- 172.21.15.40:0/77141754 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbe90010860 con 0x7fbea815ec70 2024-09-11T00:27:42.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.525+0000 7fbea4c00640 1 --2- 172.21.15.40:0/77141754 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbe84077f70 0x7fbe8407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:42.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.525+0000 7fbea4c00640 1 -- 172.21.15.40:0/77141754 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fbe9009a250 con 0x7fbea815ec70 2024-09-11T00:27:42.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.526+0000 7fbea7e00640 1 --2- 172.21.15.40:0/77141754 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbe84077f70 0x7fbe8407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:42.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.527+0000 7fbea7e00640 1 --2- 172.21.15.40:0/77141754 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbe84077f70 0x7fbe8407a430 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbe980016b0 tx=0x7fbe98009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:42.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.530+0000 7fbea4c00640 1 -- 172.21.15.40:0/77141754 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbea80c8bb0 con 0x7fbea815ec70 2024-09-11T00:27:42.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.764+0000 7fbeaf000640 1 -- 172.21.15.40:0/77141754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbea80cdbd0 con 0x7fbea815ec70 2024-09-11T00:27:42.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.765+0000 7fbea4c00640 1 -- 172.21.15.40:0/77141754 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7fbe90062cb0 con 0x7fbea815ec70 2024-09-11T00:27:42.767 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:27:42.767 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"btime":"2024-09-11T00:24:45:383933+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2499570202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2499570202},{"type":"v1","addr":"172.21.15.40:6835","nonce":2499570202}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4885,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2232689934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2232689934},{"type":"v1","addr":"172.21.15.175:6836","nonce":2232689934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/4012257321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":4012257321},{"type":"v1","addr":"172.21.15.175:6837","nonce":4012257321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:24:41.799375+0000","modified":"2024-09-11T00:24:44.819725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/2666966234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2666966234},{"type":"v1","addr":"172.21.15.40:6834","nonce":2666966234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4944,"qdb_cluster":[4944]},"id":2}]} 2024-09-11T00:27:42.767 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 16 2024-09-11T00:27:42.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.767+0000 7fbeaf000640 1 -- 172.21.15.40:0/77141754 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbe84077f70 msgr2=0x7fbe8407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:42.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.767+0000 7fbeaf000640 1 --2- 172.21.15.40:0/77141754 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbe84077f70 0x7fbe8407a430 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbe980016b0 tx=0x7fbe98009040 comp rx=0 tx=0).stop 2024-09-11T00:27:42.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.767+0000 7fbeaf000640 1 -- 172.21.15.40:0/77141754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbea815ec70 msgr2=0x7fbea814c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:42.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.767+0000 7fbeaf000640 1 --2- 172.21.15.40:0/77141754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbea815ec70 0x7fbea814c560 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000d740 tx=0x7fbe9000dc00 comp rx=0 tx=0).stop 2024-09-11T00:27:42.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.767+0000 7fbeaf000640 1 -- 172.21.15.40:0/77141754 shutdown_connections 2024-09-11T00:27:42.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.767+0000 7fbeaf000640 1 --2- 172.21.15.40:0/77141754 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbe84077f70 0x7fbe8407a430 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.767+0000 7fbeaf000640 1 --2- 172.21.15.40:0/77141754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbea815f050 0x7fbea81578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.767+0000 7fbeaf000640 1 --2- 172.21.15.40:0/77141754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbea815ec70 0x7fbea814c560 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.767+0000 7fbeaf000640 1 --2- 172.21.15.40:0/77141754 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbea80cd780 0x7fbea80b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.767+0000 7fbeaf000640 1 -- 172.21.15.40:0/77141754 >> 172.21.15.40:0/77141754 conn(0x7fbea80cfbb0 msgr2=0x7fbea80b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:42.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.767+0000 7fbeaf000640 1 -- 172.21.15.40:0/77141754 shutdown_connections 2024-09-11T00:27:42.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.767+0000 7fbeaf000640 1 -- 172.21.15.40:0/77141754 wait complete. 2024-09-11T00:27:42.785 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:27:42.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.944+0000 7fe5b7000640 1 -- 172.21.15.40:0/2174305679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5b015bcc0 msgr2=0x7fe5b00cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:42.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.944+0000 7fe5b7000640 1 --2- 172.21.15.40:0/2174305679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5b015bcc0 0x7fe5b00cb420 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0005fd0 tx=0x7fe5a002a580 comp rx=0 tx=0).stop 2024-09-11T00:27:42.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.944+0000 7fe5b7000640 1 -- 172.21.15.40:0/2174305679 shutdown_connections 2024-09-11T00:27:42.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.944+0000 7fe5b7000640 1 --2- 172.21.15.40:0/2174305679 >> v2:172.21.15.175:3300/0 conn(0x7fe5b00cba70 0x7fe5b00cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.944+0000 7fe5b7000640 1 --2- 172.21.15.40:0/2174305679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5b015bcc0 0x7fe5b00cb420 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.944+0000 7fe5b7000640 1 -- 172.21.15.40:0/2174305679 >> 172.21.15.40:0/2174305679 conn(0x7fe5b00cfbb0 msgr2=0x7fe5b00cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:42.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.944+0000 7fe5b7000640 1 -- 172.21.15.40:0/2174305679 shutdown_connections 2024-09-11T00:27:42.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.944+0000 7fe5b7000640 1 -- 172.21.15.40:0/2174305679 wait complete. 2024-09-11T00:27:42.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.946+0000 7fe5b7000640 1 Processor -- start 2024-09-11T00:27:42.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.946+0000 7fe5b7000640 1 -- start start 2024-09-11T00:27:42.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.947+0000 7fe5b7000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5b00ca200 0x7fe5b01f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:42.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.947+0000 7fe5b7000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5b00cba70 0x7fe5b00cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:42.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.947+0000 7fe5b7000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5b015bcc0 0x7fe5b00cd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:42.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.947+0000 7fe5b7000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b015f940 con 0x7fe5b015bcc0 2024-09-11T00:27:42.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.947+0000 7fe5b7000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b015f7c0 con 0x7fe5b00cba70 2024-09-11T00:27:42.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.947+0000 7fe5b7000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe5b00cad60 con 0x7fe5b00ca200 2024-09-11T00:27:42.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.947+0000 7fe5b5000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5b015bcc0 0x7fe5b00cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:42.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.947+0000 7fe5b5000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5b015bcc0 0x7fe5b00cd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49810/0 (socket says 172.21.15.40:49810) 2024-09-11T00:27:42.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.947+0000 7fe5b5000640 1 -- 172.21.15.40:0/3859469774 learned_addr learned my addr 172.21.15.40:0/3859469774 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:42.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.948+0000 7fe5af400640 1 --2- 172.21.15.40:0/3859469774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5b00cba70 0x7fe5b00cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:42.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.948+0000 7fe5afe00640 1 --2- 172.21.15.40:0/3859469774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5b00ca200 0x7fe5b01f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:42.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.948+0000 7fe5b5000640 1 -- 172.21.15.40:0/3859469774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5b00ca200 msgr2=0x7fe5b01f4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:42.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.948+0000 7fe5b5000640 1 --2- 172.21.15.40:0/3859469774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5b00ca200 0x7fe5b01f4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.948+0000 7fe5b5000640 1 -- 172.21.15.40:0/3859469774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5b00cba70 msgr2=0x7fe5b00cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:42.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.948+0000 7fe5b5000640 1 --2- 172.21.15.40:0/3859469774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5b00cba70 0x7fe5b00cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:42.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.948+0000 7fe5b5000640 1 -- 172.21.15.40:0/3859469774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b01f5510 con 0x7fe5b015bcc0 2024-09-11T00:27:42.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.948+0000 7fe5b5000640 1 --2- 172.21.15.40:0/3859469774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5b015bcc0 0x7fe5b00cd970 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800c7b0 tx=0x7fe5a800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:42.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.948+0000 7fe5a7e00640 1 -- 172.21.15.40:0/3859469774 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8004960 con 0x7fe5b015bcc0 2024-09-11T00:27:42.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.949+0000 7fe5a7e00640 1 -- 172.21.15.40:0/3859469774 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5a8004bf0 con 0x7fe5b015bcc0 2024-09-11T00:27:42.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.949+0000 7fe5b7000640 1 -- 172.21.15.40:0/3859469774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5b00cdfa0 con 0x7fe5b015bcc0 2024-09-11T00:27:42.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.949+0000 7fe5a7e00640 1 -- 172.21.15.40:0/3859469774 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a800a850 con 0x7fe5b015bcc0 2024-09-11T00:27:42.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.949+0000 7fe5b7000640 1 -- 172.21.15.40:0/3859469774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5b00ce560 con 0x7fe5b015bcc0 2024-09-11T00:27:42.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.950+0000 7fe5b7000640 1 -- 172.21.15.40:0/3859469774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5b00cbec0 con 0x7fe5b015bcc0 2024-09-11T00:27:42.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.951+0000 7fe5a7e00640 1 -- 172.21.15.40:0/3859469774 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe5a800a9f0 con 0x7fe5b015bcc0 2024-09-11T00:27:42.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.952+0000 7fe5a7e00640 1 --2- 172.21.15.40:0/3859469774 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe590077f70 0x7fe59007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:42.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.952+0000 7fe5a7e00640 1 -- 172.21.15.40:0/3859469774 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fe5a8099f50 con 0x7fe5b015bcc0 2024-09-11T00:27:42.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.953+0000 7fe5afe00640 1 --2- 172.21.15.40:0/3859469774 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe590077f70 0x7fe59007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:42.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.954+0000 7fe5afe00640 1 --2- 172.21.15.40:0/3859469774 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe590077f70 0x7fe59007a430 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0033000 tx=0x7fe5a0004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:42.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:42.956+0000 7fe5a7e00640 1 -- 172.21.15.40:0/3859469774 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe5a8020070 con 0x7fe5b015bcc0 2024-09-11T00:27:43.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.154+0000 7fe5b7000640 1 -- 172.21.15.40:0/3859469774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5b00b11c0 con 0x7fe5b015bcc0 2024-09-11T00:27:43.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.155+0000 7fe5a7e00640 1 -- 172.21.15.40:0/3859469774 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16705 (secure 0 0 0) 0x7fe5a80629b0 con 0x7fe5b015bcc0 2024-09-11T00:27:43.157 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:27:43.157 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","created":"2024-09-11T00:23:22.512139+0000","modified":"2024-09-11T00:24:43.371051+0000","last_up_change":"2024-09-11T00:23:36.842446+0000","last_in_change":"2024-09-11T00:23:26.734953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:23:37.800502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:24:39.827986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T00:24:40.764894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee10e123-8817-4d94-a340-73d00121af37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6801","nonce":973366008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6803","nonce":973366008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6807","nonce":973366008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6805","nonce":973366008}]},"public_addr":"172.21.15.40:6801/973366008","cluster_addr":"172.21.15.40:6803/973366008","heartbeat_back_addr":"172.21.15.40:6807/973366008","heartbeat_front_addr":"172.21.15.40:6805/973366008","state":["exists","up"]},{"osd":1,"uuid":"f90895e9-8660-42b9-8aba-3f9d4d130b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6823","nonce":2542266029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6827","nonce":2542266029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6831","nonce":2542266029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6829","nonce":2542266029}]},"public_addr":"172.21.15.40:6823/2542266029","cluster_addr":"172.21.15.40:6827/2542266029","heartbeat_back_addr":"172.21.15.40:6831/2542266029","heartbeat_front_addr":"172.21.15.40:6829/2542266029","state":["exists","up"]},{"osd":2,"uuid":"a190497a-2aba-4748-8f1d-7e372259d65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6815","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6817","nonce":559505356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6819","nonce":559505356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6826","nonce":559505356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6822","nonce":559505356}]},"public_addr":"172.21.15.40:6817/559505356","cluster_addr":"172.21.15.40:6819/559505356","heartbeat_back_addr":"172.21.15.40:6826/559505356","heartbeat_front_addr":"172.21.15.40:6822/559505356","state":["exists","up"]},{"osd":3,"uuid":"8be32ced-898a-46f2-b850-1517667766b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6809","nonce":503633839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6811","nonce":503633839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6816","nonce":503633839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6813","nonce":503633839}]},"public_addr":"172.21.15.40:6809/503633839","cluster_addr":"172.21.15.40:6811/503633839","heartbeat_back_addr":"172.21.15.40:6816/503633839","heartbeat_front_addr":"172.21.15.40:6813/503633839","state":["exists","up"]},{"osd":4,"uuid":"9867fdfc-6f93-466e-b768-b5a1da7157de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6811","nonce":2418348042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6813","nonce":2418348042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6817","nonce":2418348042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6815","nonce":2418348042}]},"public_addr":"172.21.15.175:6811/2418348042","cluster_addr":"172.21.15.175:6813/2418348042","heartbeat_back_addr":"172.21.15.175:6817/2418348042","heartbeat_front_addr":"172.21.15.175:6815/2418348042","state":["exists","up"]},{"osd":5,"uuid":"e2f6f616-b5db-466e-942f-e2762171a8ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6827","nonce":520822300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6829","nonce":520822300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6833","nonce":520822300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6831","nonce":520822300}]},"public_addr":"172.21.15.175:6827/520822300","cluster_addr":"172.21.15.175:6829/520822300","heartbeat_back_addr":"172.21.15.175:6833/520822300","heartbeat_front_addr":"172.21.15.175:6831/520822300","state":["exists","up"]},{"osd":6,"uuid":"807ac045-bf63-4ff6-9a06-7f7022f9ef32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6819","nonce":1431736593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6821","nonce":1431736593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6825","nonce":1431736593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6823","nonce":1431736593}]},"public_addr":"172.21.15.175:6819/1431736593","cluster_addr":"172.21.15.175:6821/1431736593","heartbeat_back_addr":"172.21.15.175:6825/1431736593","heartbeat_front_addr":"172.21.15.175:6823/1431736593","state":["exists","up"]},{"osd":7,"uuid":"8e0b3293-390f-4b43-b29d-babdc5e88f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6803","nonce":3300317000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6805","nonce":3300317000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6809","nonce":3300317000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6807","nonce":3300317000}]},"public_addr":"172.21.15.175:6803/3300317000","cluster_addr":"172.21.15.175:6805/3300317000","heartbeat_back_addr":"172.21.15.175:6809/3300317000","heartbeat_front_addr":"172.21.15.175:6807/3300317000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:32.967062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.266558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.063509+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.616332+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.431077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.866822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.645225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.016210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:27:43.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.157+0000 7fe5b7000640 1 -- 172.21.15.40:0/3859469774 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe590077f70 msgr2=0x7fe59007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:43.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.157+0000 7fe5b7000640 1 --2- 172.21.15.40:0/3859469774 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe590077f70 0x7fe59007a430 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0033000 tx=0x7fe5a0004730 comp rx=0 tx=0).stop 2024-09-11T00:27:43.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.157+0000 7fe5b7000640 1 -- 172.21.15.40:0/3859469774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5b015bcc0 msgr2=0x7fe5b00cd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:43.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.157+0000 7fe5b7000640 1 --2- 172.21.15.40:0/3859469774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5b015bcc0 0x7fe5b00cd970 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800c7b0 tx=0x7fe5a800cbb0 comp rx=0 tx=0).stop 2024-09-11T00:27:43.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.157+0000 7fe5b7000640 1 -- 172.21.15.40:0/3859469774 shutdown_connections 2024-09-11T00:27:43.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.157+0000 7fe5b7000640 1 --2- 172.21.15.40:0/3859469774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5b015bcc0 0x7fe5b00cd970 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:43.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.157+0000 7fe5b7000640 1 --2- 172.21.15.40:0/3859469774 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe590077f70 0x7fe59007a430 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:43.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.157+0000 7fe5b7000640 1 --2- 172.21.15.40:0/3859469774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5b00cba70 0x7fe5b00cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:43.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.157+0000 7fe5b7000640 1 --2- 172.21.15.40:0/3859469774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5b00ca200 0x7fe5b01f4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:43.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.157+0000 7fe5b7000640 1 -- 172.21.15.40:0/3859469774 >> 172.21.15.40:0/3859469774 conn(0x7fe5b00cfbb0 msgr2=0x7fe5b00b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:43.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.158+0000 7fe5b7000640 1 -- 172.21.15.40:0/3859469774 shutdown_connections 2024-09-11T00:27:43.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.158+0000 7fe5b7000640 1 -- 172.21.15.40:0/3859469774 wait complete. 2024-09-11T00:27:43.175 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T00:27:43.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:27:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.333+0000 7f17fc600640 1 -- 172.21.15.40:0/3468597260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17f415bcc0 msgr2=0x7f17f40cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.333+0000 7f17fc600640 1 --2- 172.21.15.40:0/3468597260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17f415bcc0 0x7f17f40cb420 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009860 tx=0x7f17e802a540 comp rx=0 tx=0).stop 2024-09-11T00:27:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.333+0000 7f17fc600640 1 -- 172.21.15.40:0/3468597260 shutdown_connections 2024-09-11T00:27:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.333+0000 7f17fc600640 1 --2- 172.21.15.40:0/3468597260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17f406f920 0x7f17f40cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.333+0000 7f17fc600640 1 --2- 172.21.15.40:0/3468597260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17f415bcc0 0x7f17f40cb420 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.333+0000 7f17fc600640 1 -- 172.21.15.40:0/3468597260 >> 172.21.15.40:0/3468597260 conn(0x7f17f40cfbb0 msgr2=0x7f17f40cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.333+0000 7f17fc600640 1 -- 172.21.15.40:0/3468597260 shutdown_connections 2024-09-11T00:27:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.333+0000 7f17fc600640 1 -- 172.21.15.40:0/3468597260 wait complete. 2024-09-11T00:27:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.335+0000 7f17fc600640 1 Processor -- start 2024-09-11T00:27:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.335+0000 7f17fc600640 1 -- start start 2024-09-11T00:27:43.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.336+0000 7f17fc600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17f406f920 0x7f17f4152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:43.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.336+0000 7f17fc600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17f40cba70 0x7f17f4151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:43.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.336+0000 7f17fc600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17f415bcc0 0x7f17f41513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:43.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.336+0000 7f17fc600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f17f415f940 con 0x7f17f406f920 2024-09-11T00:27:43.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.336+0000 7f17fc600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f17f415f7c0 con 0x7f17f415bcc0 2024-09-11T00:27:43.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.336+0000 7f17fc600640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f17f40ca910 con 0x7f17f40cba70 2024-09-11T00:27:43.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.336+0000 7f17f9c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17f406f920 0x7f17f4152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:43.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.336+0000 7f17f9c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17f406f920 0x7f17f4152330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49818/0 (socket says 172.21.15.40:49818) 2024-09-11T00:27:43.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.336+0000 7f17f9c00640 1 -- 172.21.15.40:0/2807443894 learned_addr learned my addr 172.21.15.40:0/2807443894 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:43.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.337+0000 7f17fa600640 1 --2- 172.21.15.40:0/2807443894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17f415bcc0 0x7f17f41513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:43.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.337+0000 7f17f9200640 1 --2- 172.21.15.40:0/2807443894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17f40cba70 0x7f17f4151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:43.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.337+0000 7f17f9c00640 1 -- 172.21.15.40:0/2807443894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17f40cba70 msgr2=0x7f17f4151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:43.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.337+0000 7f17f9c00640 1 --2- 172.21.15.40:0/2807443894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17f40cba70 0x7f17f4151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:43.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.337+0000 7f17f9c00640 1 -- 172.21.15.40:0/2807443894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17f415bcc0 msgr2=0x7f17f41513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:43.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.337+0000 7f17f9c00640 1 --2- 172.21.15.40:0/2807443894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17f415bcc0 0x7f17f41513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:43.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.337+0000 7f17f9c00640 1 -- 172.21.15.40:0/2807443894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f415a0f0 con 0x7f17f406f920 2024-09-11T00:27:43.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.337+0000 7f17f9c00640 1 --2- 172.21.15.40:0/2807443894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17f406f920 0x7f17f4152330 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f17e8000c00 tx=0x7f17e8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:43.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.338+0000 7f17f1600640 1 -- 172.21.15.40:0/2807443894 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8031d60 con 0x7f17f406f920 2024-09-11T00:27:43.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.338+0000 7f17f1600640 1 -- 172.21.15.40:0/2807443894 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17e8033e10 con 0x7f17f406f920 2024-09-11T00:27:43.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.338+0000 7f17f1600640 1 -- 172.21.15.40:0/2807443894 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8033310 con 0x7f17f406f920 2024-09-11T00:27:43.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.338+0000 7f17fc600640 1 -- 172.21.15.40:0/2807443894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f415ef20 con 0x7f17f406f920 2024-09-11T00:27:43.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.338+0000 7f17fc600640 1 -- 172.21.15.40:0/2807443894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f415eb40 con 0x7f17f406f920 2024-09-11T00:27:43.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.339+0000 7f17fc600640 1 -- 172.21.15.40:0/2807443894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f415f160 con 0x7f17f406f920 2024-09-11T00:27:43.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.340+0000 7f17f1600640 1 -- 172.21.15.40:0/2807443894 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f17e80334b0 con 0x7f17f406f920 2024-09-11T00:27:43.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.341+0000 7f17f1600640 1 --2- 172.21.15.40:0/2807443894 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f17d4077fa0 0x7f17d407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:43.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.341+0000 7f17f1600640 1 -- 172.21.15.40:0/2807443894 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f17e80baf10 con 0x7f17f406f920 2024-09-11T00:27:43.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.341+0000 7f17f9200640 1 --2- 172.21.15.40:0/2807443894 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f17d4077fa0 0x7f17d407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:43.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.342+0000 7f17f9200640 1 --2- 172.21.15.40:0/2807443894 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f17d4077fa0 0x7f17d407a460 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f17f415a730 tx=0x7f17e0007e90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:43.344 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:27:43.348 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:27:43.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.346+0000 7f17f1600640 1 -- 172.21.15.40:0/2807443894 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f17f415f160 con 0x7f17f406f920 2024-09-11T00:27:43.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.578+0000 7f17fc600640 1 -- 172.21.15.40:0/2807443894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17f40cae60 con 0x7f17f406f920 2024-09-11T00:27:43.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.579+0000 7f17f1600640 1 -- 172.21.15.40:0/2807443894 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7f17e803f030 con 0x7f17f406f920 2024-09-11T00:27:43.581 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:27:43.581 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"btime":"2024-09-11T00:24:45:383933+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2499570202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2499570202},{"type":"v1","addr":"172.21.15.40:6835","nonce":2499570202}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4885,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2232689934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2232689934},{"type":"v1","addr":"172.21.15.175:6836","nonce":2232689934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/4012257321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":4012257321},{"type":"v1","addr":"172.21.15.175:6837","nonce":4012257321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:24:41.799375+0000","modified":"2024-09-11T00:24:44.819725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/2666966234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2666966234},{"type":"v1","addr":"172.21.15.40:6834","nonce":2666966234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4944,"qdb_cluster":[4944]},"id":2}]} 2024-09-11T00:27:43.581 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 16 2024-09-11T00:27:43.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.582+0000 7f17fc600640 1 -- 172.21.15.40:0/2807443894 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f17d4077fa0 msgr2=0x7f17d407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:43.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.582+0000 7f17fc600640 1 --2- 172.21.15.40:0/2807443894 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f17d4077fa0 0x7f17d407a460 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f17f415a730 tx=0x7f17e0007e90 comp rx=0 tx=0).stop 2024-09-11T00:27:43.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.582+0000 7f17fc600640 1 -- 172.21.15.40:0/2807443894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17f406f920 msgr2=0x7f17f4152330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:43.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.582+0000 7f17fc600640 1 --2- 172.21.15.40:0/2807443894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17f406f920 0x7f17f4152330 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f17e8000c00 tx=0x7f17e8033c20 comp rx=0 tx=0).stop 2024-09-11T00:27:43.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.582+0000 7f17fc600640 1 -- 172.21.15.40:0/2807443894 shutdown_connections 2024-09-11T00:27:43.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.582+0000 7f17fc600640 1 --2- 172.21.15.40:0/2807443894 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f17d4077fa0 0x7f17d407a460 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:43.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.582+0000 7f17fc600640 1 --2- 172.21.15.40:0/2807443894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17f415bcc0 0x7f17f41513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:43.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.582+0000 7f17fc600640 1 --2- 172.21.15.40:0/2807443894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17f40cba70 0x7f17f4151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:43.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.582+0000 7f17fc600640 1 --2- 172.21.15.40:0/2807443894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17f406f920 0x7f17f4152330 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:43.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.582+0000 7f17fc600640 1 -- 172.21.15.40:0/2807443894 >> 172.21.15.40:0/2807443894 conn(0x7f17f40cfbb0 msgr2=0x7f17f40ad870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:43.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.582+0000 7f17fc600640 1 -- 172.21.15.40:0/2807443894 shutdown_connections 2024-09-11T00:27:43.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.582+0000 7f17fc600640 1 -- 172.21.15.40:0/2807443894 wait complete. 2024-09-11T00:27:43.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:27:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.758+0000 7f11b9600640 1 -- 172.21.15.40:0/643162890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b4073e60 msgr2=0x7f11b406fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.758+0000 7f11b9600640 1 --2- 172.21.15.40:0/643162890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b4073e60 0x7f11b406fe50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f11ac005fd0 tx=0x7f11ac02aa10 comp rx=0 tx=0).stop 2024-09-11T00:27:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.759+0000 7f11b9600640 1 -- 172.21.15.40:0/643162890 shutdown_connections 2024-09-11T00:27:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.759+0000 7f11b9600640 1 --2- 172.21.15.40:0/643162890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b4073e60 0x7f11b406fe50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.759+0000 7f11b9600640 1 --2- 172.21.15.40:0/643162890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11b40cf970 0x7f11b40ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.759+0000 7f11b9600640 1 -- 172.21.15.40:0/643162890 >> 172.21.15.40:0/643162890 conn(0x7f11b40d0880 msgr2=0x7f11b40d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.759+0000 7f11b9600640 1 -- 172.21.15.40:0/643162890 shutdown_connections 2024-09-11T00:27:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.759+0000 7f11b9600640 1 -- 172.21.15.40:0/643162890 wait complete. 2024-09-11T00:27:43.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.760+0000 7f11b9600640 1 Processor -- start 2024-09-11T00:27:43.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.760+0000 7f11b9600640 1 -- start start 2024-09-11T00:27:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.761+0000 7f11b9600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b40734f0 0x7f11b41f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.761+0000 7f11b9600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11b4073e60 0x7f11b41f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.761+0000 7f11b9600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11b40cf970 0x7f11b40b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.761+0000 7f11b9600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f11b4070390 con 0x7f11b40734f0 2024-09-11T00:27:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.761+0000 7f11b9600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f11b4073ae0 con 0x7f11b4073e60 2024-09-11T00:27:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.761+0000 7f11b9600640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f11b4070510 con 0x7f11b40cf970 2024-09-11T00:27:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.761+0000 7f11b3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b40734f0 0x7f11b41f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.762+0000 7f11b3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b40734f0 0x7f11b41f7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49838/0 (socket says 172.21.15.40:49838) 2024-09-11T00:27:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.762+0000 7f11b3e00640 1 -- 172.21.15.40:0/308946033 learned_addr learned my addr 172.21.15.40:0/308946033 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.762+0000 7f11b8c00640 1 --2- 172.21.15.40:0/308946033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11b40cf970 0x7f11b40b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.762+0000 7f11abe00640 1 --2- 172.21.15.40:0/308946033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11b4073e60 0x7f11b41f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.762+0000 7f11b3e00640 1 -- 172.21.15.40:0/308946033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11b40cf970 msgr2=0x7f11b40b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.762+0000 7f11b3e00640 1 --2- 172.21.15.40:0/308946033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11b40cf970 0x7f11b40b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.762+0000 7f11b3e00640 1 -- 172.21.15.40:0/308946033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11b4073e60 msgr2=0x7f11b41f4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.762+0000 7f11b3e00640 1 --2- 172.21.15.40:0/308946033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11b4073e60 0x7f11b41f4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.762+0000 7f11b3e00640 1 -- 172.21.15.40:0/308946033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b41f8410 con 0x7f11b40734f0 2024-09-11T00:27:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.762+0000 7f11b8c00640 1 --2- 172.21.15.40:0/308946033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11b40cf970 0x7f11b40b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:27:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.762+0000 7f11abe00640 1 --2- 172.21.15.40:0/308946033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11b4073e60 0x7f11b41f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:27:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.762+0000 7f11b3e00640 1 --2- 172.21.15.40:0/308946033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b40734f0 0x7f11b41f7be0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f11a400c450 tx=0x7f11a400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.762+0000 7f11b0c00640 1 -- 172.21.15.40:0/308946033 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a40052d0 con 0x7f11b40734f0 2024-09-11T00:27:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.762+0000 7f11b0c00640 1 -- 172.21.15.40:0/308946033 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11a4005470 con 0x7f11b40734f0 2024-09-11T00:27:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.762+0000 7f11b0c00640 1 -- 172.21.15.40:0/308946033 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a4012870 con 0x7f11b40734f0 2024-09-11T00:27:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.763+0000 7f11b9600640 1 -- 172.21.15.40:0/308946033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b41f86f0 con 0x7f11b40734f0 2024-09-11T00:27:43.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.763+0000 7f11b9600640 1 -- 172.21.15.40:0/308946033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b41f4940 con 0x7f11b40734f0 2024-09-11T00:27:43.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.764+0000 7f11b9600640 1 -- 172.21.15.40:0/308946033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11b406fe50 con 0x7f11b40734f0 2024-09-11T00:27:43.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.765+0000 7f11b0c00640 1 -- 172.21.15.40:0/308946033 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f11a40035f0 con 0x7f11b40734f0 2024-09-11T00:27:43.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.766+0000 7f11b0c00640 1 --2- 172.21.15.40:0/308946033 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1190077fa0 0x7f119007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:43.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.766+0000 7f11b0c00640 1 -- 172.21.15.40:0/308946033 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f11a40998c0 con 0x7f11b40734f0 2024-09-11T00:27:43.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.766+0000 7f11abe00640 1 --2- 172.21.15.40:0/308946033 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1190077fa0 0x7f119007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:43.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.767+0000 7f11abe00640 1 --2- 172.21.15.40:0/308946033 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1190077fa0 0x7f119007a460 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f119c005fd0 tx=0x7f119c005ea0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:43.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:43.770+0000 7f11b0c00640 1 -- 172.21.15.40:0/308946033 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f11a40623b0 con 0x7f11b40734f0 2024-09-11T00:27:44.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.004+0000 7f11b9600640 1 -- 172.21.15.40:0/308946033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11b415be70 con 0x7f11b40734f0 2024-09-11T00:27:44.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.005+0000 7f11b0c00640 1 -- 172.21.15.40:0/308946033 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7f11a4061cb0 con 0x7f11b40734f0 2024-09-11T00:27:44.006 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:27:44.007 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"btime":"2024-09-11T00:24:45:383933+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2499570202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2499570202},{"type":"v1","addr":"172.21.15.40:6835","nonce":2499570202}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4885,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2232689934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2232689934},{"type":"v1","addr":"172.21.15.175:6836","nonce":2232689934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/4012257321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":4012257321},{"type":"v1","addr":"172.21.15.175:6837","nonce":4012257321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:24:41.799375+0000","modified":"2024-09-11T00:24:44.819725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4944},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4944":{"gid":4944,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/2666966234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2666966234},{"type":"v1","addr":"172.21.15.40:6834","nonce":2666966234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4944,"qdb_cluster":[4944]},"id":2}]} 2024-09-11T00:27:44.007 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 16 2024-09-11T00:27:44.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.007+0000 7f11b9600640 1 -- 172.21.15.40:0/308946033 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1190077fa0 msgr2=0x7f119007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:44.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.007+0000 7f11b9600640 1 --2- 172.21.15.40:0/308946033 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1190077fa0 0x7f119007a460 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f119c005fd0 tx=0x7f119c005ea0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.007+0000 7f11b9600640 1 -- 172.21.15.40:0/308946033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b40734f0 msgr2=0x7f11b41f7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:44.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.007+0000 7f11b9600640 1 --2- 172.21.15.40:0/308946033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b40734f0 0x7f11b41f7be0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f11a400c450 tx=0x7f11a400c910 comp rx=0 tx=0).stop 2024-09-11T00:27:44.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.007+0000 7f11b9600640 1 -- 172.21.15.40:0/308946033 shutdown_connections 2024-09-11T00:27:44.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.007+0000 7f11b9600640 1 --2- 172.21.15.40:0/308946033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11b40cf970 0x7f11b40b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.007+0000 7f11b9600640 1 --2- 172.21.15.40:0/308946033 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f1190077fa0 0x7f119007a460 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.007+0000 7f11b9600640 1 --2- 172.21.15.40:0/308946033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11b4073e60 0x7f11b41f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.007+0000 7f11b9600640 1 --2- 172.21.15.40:0/308946033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b40734f0 0x7f11b41f7be0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.007+0000 7f11b9600640 1 -- 172.21.15.40:0/308946033 >> 172.21.15.40:0/308946033 conn(0x7f11b40d0880 msgr2=0x7f11b40b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:44.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.007+0000 7f11b9600640 1 -- 172.21.15.40:0/308946033 shutdown_connections 2024-09-11T00:27:44.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.007+0000 7f11b9600640 1 -- 172.21.15.40:0/308946033 wait complete. 2024-09-11T00:27:44.025 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:27:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.185+0000 7fc8a6600640 1 -- 172.21.15.40:0/3809395733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a015dd10 msgr2=0x7fc8a00d4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.185+0000 7fc8a6600640 1 --2- 172.21.15.40:0/3809395733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a015dd10 0x7fc8a00d4740 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00b6790 tx=0x7fc89402a560 comp rx=0 tx=0).stop 2024-09-11T00:27:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.185+0000 7fc8a6600640 1 -- 172.21.15.40:0/3809395733 shutdown_connections 2024-09-11T00:27:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.185+0000 7fc8a6600640 1 --2- 172.21.15.40:0/3809395733 >> v2:172.21.15.175:3300/0 conn(0x7fc8a00d09e0 0x7fc8a006cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.185+0000 7fc8a6600640 1 --2- 172.21.15.40:0/3809395733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a015dd10 0x7fc8a00d4740 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.185+0000 7fc8a6600640 1 -- 172.21.15.40:0/3809395733 >> 172.21.15.40:0/3809395733 conn(0x7fc8a00d3c20 msgr2=0x7fc8a00d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.185+0000 7fc8a6600640 1 -- 172.21.15.40:0/3809395733 shutdown_connections 2024-09-11T00:27:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.185+0000 7fc8a6600640 1 -- 172.21.15.40:0/3809395733 wait complete. 2024-09-11T00:27:44.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.187+0000 7fc8a6600640 1 Processor -- start 2024-09-11T00:27:44.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.187+0000 7fc8a6600640 1 -- start start 2024-09-11T00:27:44.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.188+0000 7fc8a6600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a00b2d20 0x7fc8a00ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:44.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.188+0000 7fc8a6600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a00d09e0 0x7fc8a0154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:44.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.188+0000 7fc8a6600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8a015dd10 0x7fc8a00b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.188+0000 7fc8a6600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a006d890 con 0x7fc8a00d09e0 2024-09-11T00:27:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.188+0000 7fc8a6600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a006d710 con 0x7fc8a00b2d20 2024-09-11T00:27:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.188+0000 7fc8a6600640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc8a006da10 con 0x7fc8a015dd10 2024-09-11T00:27:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.188+0000 7fc89fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a00d09e0 0x7fc8a0154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.188+0000 7fc89fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a00d09e0 0x7fc8a0154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49852/0 (socket says 172.21.15.40:49852) 2024-09-11T00:27:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.188+0000 7fc89fe00640 1 -- 172.21.15.40:0/289021028 learned_addr learned my addr 172.21.15.40:0/289021028 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.188+0000 7fc8a5200640 1 --2- 172.21.15.40:0/289021028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a00b2d20 0x7fc8a00ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.188+0000 7fc8a5c00640 1 --2- 172.21.15.40:0/289021028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8a015dd10 0x7fc8a00b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.188+0000 7fc89fe00640 1 -- 172.21.15.40:0/289021028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8a015dd10 msgr2=0x7fc8a00b57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.188+0000 7fc89fe00640 1 --2- 172.21.15.40:0/289021028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8a015dd10 0x7fc8a00b57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.188+0000 7fc89fe00640 1 -- 172.21.15.40:0/289021028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a00b2d20 msgr2=0x7fc8a00ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.188+0000 7fc89fe00640 1 --2- 172.21.15.40:0/289021028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a00b2d20 0x7fc8a00ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.188+0000 7fc89fe00640 1 -- 172.21.15.40:0/289021028 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a00b6030 con 0x7fc8a00d09e0 2024-09-11T00:27:44.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.188+0000 7fc8a5200640 1 --2- 172.21.15.40:0/289021028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a00b2d20 0x7fc8a00ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:27:44.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.188+0000 7fc8a5c00640 1 --2- 172.21.15.40:0/289021028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8a015dd10 0x7fc8a00b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:27:44.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.189+0000 7fc89fe00640 1 --2- 172.21.15.40:0/289021028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a00d09e0 0x7fc8a0154f10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00c450 tx=0x7fc88c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:44.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.189+0000 7fc89cc00640 1 -- 172.21.15.40:0/289021028 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88c016020 con 0x7fc8a00d09e0 2024-09-11T00:27:44.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.189+0000 7fc89cc00640 1 -- 172.21.15.40:0/289021028 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc88c005400 con 0x7fc8a00d09e0 2024-09-11T00:27:44.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.189+0000 7fc89cc00640 1 -- 172.21.15.40:0/289021028 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88c007280 con 0x7fc8a00d09e0 2024-09-11T00:27:44.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.189+0000 7fc8a6600640 1 -- 172.21.15.40:0/289021028 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a00b3380 con 0x7fc8a00d09e0 2024-09-11T00:27:44.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.189+0000 7fc8a6600640 1 -- 172.21.15.40:0/289021028 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a00b3940 con 0x7fc8a00d09e0 2024-09-11T00:27:44.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.190+0000 7fc8a6600640 1 -- 172.21.15.40:0/289021028 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a006cfc0 con 0x7fc8a00d09e0 2024-09-11T00:27:44.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.191+0000 7fc89cc00640 1 -- 172.21.15.40:0/289021028 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc88c007420 con 0x7fc8a00d09e0 2024-09-11T00:27:44.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.192+0000 7fc89cc00640 1 --2- 172.21.15.40:0/289021028 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc880077f70 0x7fc88007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:44.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.192+0000 7fc89cc00640 1 -- 172.21.15.40:0/289021028 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fc88c0997e0 con 0x7fc8a00d09e0 2024-09-11T00:27:44.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.193+0000 7fc8a5200640 1 --2- 172.21.15.40:0/289021028 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc880077f70 0x7fc88007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:44.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.194+0000 7fc8a5200640 1 --2- 172.21.15.40:0/289021028 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc880077f70 0x7fc88007a430 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc894033000 tx=0x7fc894004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:44.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.196+0000 7fc89cc00640 1 -- 172.21.15.40:0/289021028 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc88c020020 con 0x7fc8a00d09e0 2024-09-11T00:27:44.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.391+0000 7fc8a6600640 1 -- 172.21.15.40:0/289021028 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8a00b8b50 con 0x7fc8a00d09e0 2024-09-11T00:27:44.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.392+0000 7fc89cc00640 1 -- 172.21.15.40:0/289021028 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16705 (secure 0 0 0) 0x7fc88c0622d0 con 0x7fc8a00d09e0 2024-09-11T00:27:44.394 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:27:44.394 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","created":"2024-09-11T00:23:22.512139+0000","modified":"2024-09-11T00:24:43.371051+0000","last_up_change":"2024-09-11T00:23:36.842446+0000","last_in_change":"2024-09-11T00:23:26.734953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:23:37.800502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:24:39.827986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T00:24:40.764894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee10e123-8817-4d94-a340-73d00121af37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6801","nonce":973366008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6803","nonce":973366008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6807","nonce":973366008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6805","nonce":973366008}]},"public_addr":"172.21.15.40:6801/973366008","cluster_addr":"172.21.15.40:6803/973366008","heartbeat_back_addr":"172.21.15.40:6807/973366008","heartbeat_front_addr":"172.21.15.40:6805/973366008","state":["exists","up"]},{"osd":1,"uuid":"f90895e9-8660-42b9-8aba-3f9d4d130b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6823","nonce":2542266029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6827","nonce":2542266029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6831","nonce":2542266029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6829","nonce":2542266029}]},"public_addr":"172.21.15.40:6823/2542266029","cluster_addr":"172.21.15.40:6827/2542266029","heartbeat_back_addr":"172.21.15.40:6831/2542266029","heartbeat_front_addr":"172.21.15.40:6829/2542266029","state":["exists","up"]},{"osd":2,"uuid":"a190497a-2aba-4748-8f1d-7e372259d65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6815","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6817","nonce":559505356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6819","nonce":559505356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6826","nonce":559505356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6822","nonce":559505356}]},"public_addr":"172.21.15.40:6817/559505356","cluster_addr":"172.21.15.40:6819/559505356","heartbeat_back_addr":"172.21.15.40:6826/559505356","heartbeat_front_addr":"172.21.15.40:6822/559505356","state":["exists","up"]},{"osd":3,"uuid":"8be32ced-898a-46f2-b850-1517667766b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6809","nonce":503633839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6811","nonce":503633839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6816","nonce":503633839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6813","nonce":503633839}]},"public_addr":"172.21.15.40:6809/503633839","cluster_addr":"172.21.15.40:6811/503633839","heartbeat_back_addr":"172.21.15.40:6816/503633839","heartbeat_front_addr":"172.21.15.40:6813/503633839","state":["exists","up"]},{"osd":4,"uuid":"9867fdfc-6f93-466e-b768-b5a1da7157de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6811","nonce":2418348042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6813","nonce":2418348042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6817","nonce":2418348042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6815","nonce":2418348042}]},"public_addr":"172.21.15.175:6811/2418348042","cluster_addr":"172.21.15.175:6813/2418348042","heartbeat_back_addr":"172.21.15.175:6817/2418348042","heartbeat_front_addr":"172.21.15.175:6815/2418348042","state":["exists","up"]},{"osd":5,"uuid":"e2f6f616-b5db-466e-942f-e2762171a8ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6827","nonce":520822300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6829","nonce":520822300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6833","nonce":520822300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6831","nonce":520822300}]},"public_addr":"172.21.15.175:6827/520822300","cluster_addr":"172.21.15.175:6829/520822300","heartbeat_back_addr":"172.21.15.175:6833/520822300","heartbeat_front_addr":"172.21.15.175:6831/520822300","state":["exists","up"]},{"osd":6,"uuid":"807ac045-bf63-4ff6-9a06-7f7022f9ef32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6819","nonce":1431736593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6821","nonce":1431736593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6825","nonce":1431736593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6823","nonce":1431736593}]},"public_addr":"172.21.15.175:6819/1431736593","cluster_addr":"172.21.15.175:6821/1431736593","heartbeat_back_addr":"172.21.15.175:6825/1431736593","heartbeat_front_addr":"172.21.15.175:6823/1431736593","state":["exists","up"]},{"osd":7,"uuid":"8e0b3293-390f-4b43-b29d-babdc5e88f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6803","nonce":3300317000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6805","nonce":3300317000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6809","nonce":3300317000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6807","nonce":3300317000}]},"public_addr":"172.21.15.175:6803/3300317000","cluster_addr":"172.21.15.175:6805/3300317000","heartbeat_back_addr":"172.21.15.175:6809/3300317000","heartbeat_front_addr":"172.21.15.175:6807/3300317000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:32.967062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.266558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.063509+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.616332+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.431077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.866822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.645225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.016210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:27:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.394+0000 7fc8a6600640 1 -- 172.21.15.40:0/289021028 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc880077f70 msgr2=0x7fc88007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.394+0000 7fc8a6600640 1 --2- 172.21.15.40:0/289021028 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc880077f70 0x7fc88007a430 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc894033000 tx=0x7fc894004730 comp rx=0 tx=0).stop 2024-09-11T00:27:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.394+0000 7fc8a6600640 1 -- 172.21.15.40:0/289021028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a00d09e0 msgr2=0x7fc8a0154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.394+0000 7fc8a6600640 1 --2- 172.21.15.40:0/289021028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a00d09e0 0x7fc8a0154f10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00c450 tx=0x7fc88c00c910 comp rx=0 tx=0).stop 2024-09-11T00:27:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.394+0000 7fc8a6600640 1 -- 172.21.15.40:0/289021028 shutdown_connections 2024-09-11T00:27:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.394+0000 7fc8a6600640 1 --2- 172.21.15.40:0/289021028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8a015dd10 0x7fc8a00b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.394+0000 7fc8a6600640 1 --2- 172.21.15.40:0/289021028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a00d09e0 0x7fc8a0154f10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.394+0000 7fc8a6600640 1 --2- 172.21.15.40:0/289021028 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc880077f70 0x7fc88007a430 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.394+0000 7fc8a6600640 1 --2- 172.21.15.40:0/289021028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a00b2d20 0x7fc8a00ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.394+0000 7fc8a6600640 1 -- 172.21.15.40:0/289021028 >> 172.21.15.40:0/289021028 conn(0x7fc8a00d3c20 msgr2=0x7fc8a00d4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.394+0000 7fc8a6600640 1 -- 172.21.15.40:0/289021028 shutdown_connections 2024-09-11T00:27:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.395+0000 7fc8a6600640 1 -- 172.21.15.40:0/289021028 wait complete. 2024-09-11T00:27:44.413 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T00:27:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.574+0000 7f76ef600640 1 -- 172.21.15.40:0/3248691622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76e80cba70 msgr2=0x7f76e80cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.574+0000 7f76ef600640 1 --2- 172.21.15.40:0/3248691622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76e80cba70 0x7f76e80cbe90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f76d0005fd0 tx=0x7f76d002a5d0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.574+0000 7f76ef600640 1 -- 172.21.15.40:0/3248691622 shutdown_connections 2024-09-11T00:27:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.574+0000 7f76ef600640 1 --2- 172.21.15.40:0/3248691622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76e80cba70 0x7f76e80cbe90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.574+0000 7f76ef600640 1 --2- 172.21.15.40:0/3248691622 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e815bcc0 0x7f76e80cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.574+0000 7f76ef600640 1 -- 172.21.15.40:0/3248691622 >> 172.21.15.40:0/3248691622 conn(0x7f76e80cfbb0 msgr2=0x7f76e80cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:44.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.574+0000 7f76ef600640 1 -- 172.21.15.40:0/3248691622 shutdown_connections 2024-09-11T00:27:44.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.574+0000 7f76ef600640 1 -- 172.21.15.40:0/3248691622 wait complete. 2024-09-11T00:27:44.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.576+0000 7f76ef600640 1 Processor -- start 2024-09-11T00:27:44.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.576+0000 7f76ef600640 1 -- start start 2024-09-11T00:27:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.577+0000 7f76ef600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76e80ca200 0x7f76e80a9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:44.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.577+0000 7f76ef600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e80cba70 0x7f76e80a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:44.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.577+0000 7f76ef600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76e815bcc0 0x7f76e81577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:44.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.577+0000 7f76ef600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f76e815f940 con 0x7f76e80ca200 2024-09-11T00:27:44.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.577+0000 7f76ef600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f76e815f7c0 con 0x7f76e815bcc0 2024-09-11T00:27:44.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.577+0000 7f76ef600640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f76e80cadc0 con 0x7f76e80cba70 2024-09-11T00:27:44.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.577+0000 7f76ecc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76e80ca200 0x7f76e80a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:44.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.577+0000 7f76ecc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76e80ca200 0x7f76e80a9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49872/0 (socket says 172.21.15.40:49872) 2024-09-11T00:27:44.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.577+0000 7f76ecc00640 1 -- 172.21.15.40:0/1045393179 learned_addr learned my addr 172.21.15.40:0/1045393179 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:44.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.577+0000 7f76dfe00640 1 --2- 172.21.15.40:0/1045393179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e80cba70 0x7f76e80a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:44.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.577+0000 7f76ed600640 1 --2- 172.21.15.40:0/1045393179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76e815bcc0 0x7f76e81577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:44.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.577+0000 7f76ecc00640 1 -- 172.21.15.40:0/1045393179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e80cba70 msgr2=0x7f76e80a99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.577+0000 7f76ecc00640 1 --2- 172.21.15.40:0/1045393179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e80cba70 0x7f76e80a99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.577+0000 7f76ecc00640 1 -- 172.21.15.40:0/1045393179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76e815bcc0 msgr2=0x7f76e81577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.577+0000 7f76ecc00640 1 --2- 172.21.15.40:0/1045393179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76e815bcc0 0x7f76e81577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.578+0000 7f76ecc00640 1 -- 172.21.15.40:0/1045393179 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e80c9680 con 0x7f76e80ca200 2024-09-11T00:27:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.578+0000 7f76dfe00640 1 --2- 172.21.15.40:0/1045393179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e80cba70 0x7f76e80a99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:27:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.578+0000 7f76ecc00640 1 --2- 172.21.15.40:0/1045393179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76e80ca200 0x7f76e80a9460 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f76d800d950 tx=0x7f76d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.578+0000 7f76e5600640 1 -- 172.21.15.40:0/1045393179 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8017070 con 0x7f76e80ca200 2024-09-11T00:27:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.578+0000 7f76e5600640 1 -- 172.21.15.40:0/1045393179 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76d8009d20 con 0x7f76e80ca200 2024-09-11T00:27:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.578+0000 7f76ef600640 1 -- 172.21.15.40:0/1045393179 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e815ca60 con 0x7f76e80ca200 2024-09-11T00:27:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.578+0000 7f76e5600640 1 -- 172.21.15.40:0/1045393179 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d80106c0 con 0x7f76e80ca200 2024-09-11T00:27:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.578+0000 7f76ef600640 1 -- 172.21.15.40:0/1045393179 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e815d020 con 0x7f76e80ca200 2024-09-11T00:27:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.579+0000 7f76ef600640 1 -- 172.21.15.40:0/1045393179 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76e806fa00 con 0x7f76e80ca200 2024-09-11T00:27:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.580+0000 7f76e5600640 1 -- 172.21.15.40:0/1045393179 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f76d8010860 con 0x7f76e80ca200 2024-09-11T00:27:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.581+0000 7f76e5600640 1 --2- 172.21.15.40:0/1045393179 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f76c4077f70 0x7f76c407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:44.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.581+0000 7f76e5600640 1 -- 172.21.15.40:0/1045393179 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f76d809a210 con 0x7f76e80ca200 2024-09-11T00:27:44.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.582+0000 7f76dfe00640 1 --2- 172.21.15.40:0/1045393179 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f76c4077f70 0x7f76c407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:44.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.583+0000 7f76dfe00640 1 --2- 172.21.15.40:0/1045393179 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f76c4077f70 0x7f76c407a430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f76d0033000 tx=0x7f76d0004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:44.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.585+0000 7f76e5600640 1 -- 172.21.15.40:0/1045393179 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f76d8062c70 con 0x7f76e80ca200 2024-09-11T00:27:44.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.822+0000 7f76ef600640 1 -- 172.21.15.40:0/1045393179 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f76e80008d0 con 0x7f76e80ca200 2024-09-11T00:27:44.824 INFO:tasks.ceph.mon.a.smithi040.stderr:2024-09-11T00:27:44.823+0000 7f9b63c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:27:44.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.825+0000 7f76e5600640 1 -- 172.21.15.40:0/1045393179 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7f76d8062570 con 0x7f76e80ca200 2024-09-11T00:27:44.827 INFO:teuthology.orchestra.run.smithi040.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T00:27:44.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.829+0000 7f76ef600640 1 -- 172.21.15.40:0/1045393179 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f76c4077f70 msgr2=0x7f76c407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:44.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.829+0000 7f76ef600640 1 --2- 172.21.15.40:0/1045393179 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f76c4077f70 0x7f76c407a430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f76d0033000 tx=0x7f76d0004730 comp rx=0 tx=0).stop 2024-09-11T00:27:44.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.829+0000 7f76ef600640 1 -- 172.21.15.40:0/1045393179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76e80ca200 msgr2=0x7f76e80a9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:44.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.829+0000 7f76ef600640 1 --2- 172.21.15.40:0/1045393179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76e80ca200 0x7f76e80a9460 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f76d800d950 tx=0x7f76d800de10 comp rx=0 tx=0).stop 2024-09-11T00:27:44.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.829+0000 7f76ef600640 1 -- 172.21.15.40:0/1045393179 shutdown_connections 2024-09-11T00:27:44.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.829+0000 7f76ef600640 1 --2- 172.21.15.40:0/1045393179 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f76c4077f70 0x7f76c407a430 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.829+0000 7f76ef600640 1 --2- 172.21.15.40:0/1045393179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76e815bcc0 0x7f76e81577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.829+0000 7f76ef600640 1 --2- 172.21.15.40:0/1045393179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e80cba70 0x7f76e80a99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.829+0000 7f76ef600640 1 --2- 172.21.15.40:0/1045393179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76e80ca200 0x7f76e80a9460 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:44.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.829+0000 7f76ef600640 1 -- 172.21.15.40:0/1045393179 >> 172.21.15.40:0/1045393179 conn(0x7f76e80cfbb0 msgr2=0x7f76e80b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:44.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.829+0000 7f76ef600640 1 -- 172.21.15.40:0/1045393179 shutdown_connections 2024-09-11T00:27:44.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:44.829+0000 7f76ef600640 1 -- 172.21.15.40:0/1045393179 wait complete. 2024-09-11T00:27:44.854 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T00:27:44.903 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2024-09-11T00:27:45.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.017+0000 7fe956800640 1 -- 172.21.15.40:0/3108993242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9500cc180 msgr2=0x7fe9500cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:45.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.017+0000 7fe956800640 1 --2- 172.21.15.40:0/3108993242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9500cc180 0x7fe9500cb420 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe938009830 tx=0x7fe93802a5c0 comp rx=0 tx=0).stop 2024-09-11T00:27:45.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.017+0000 7fe956800640 1 -- 172.21.15.40:0/3108993242 shutdown_connections 2024-09-11T00:27:45.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.017+0000 7fe956800640 1 --2- 172.21.15.40:0/3108993242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9500cc180 0x7fe9500cb420 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:45.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.017+0000 7fe956800640 1 -- 172.21.15.40:0/3108993242 >> 172.21.15.40:0/3108993242 conn(0x7fe9500cfbb0 msgr2=0x7fe9500cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:45.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.017+0000 7fe956800640 1 -- 172.21.15.40:0/3108993242 shutdown_connections 2024-09-11T00:27:45.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.017+0000 7fe956800640 1 -- 172.21.15.40:0/3108993242 wait complete. 2024-09-11T00:27:45.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.019+0000 7fe956800640 1 Processor -- start 2024-09-11T00:27:45.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.019+0000 7fe956800640 1 -- start start 2024-09-11T00:27:45.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.020+0000 7fe956800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe95006e910 0x7fe95015c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:45.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.020+0000 7fe956800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9500cc180 0x7fe9500c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:45.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.020+0000 7fe956800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe95015bcc0 0x7fe9500c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:45.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.020+0000 7fe956800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe95006f450 con 0x7fe95015bcc0 2024-09-11T00:27:45.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.020+0000 7fe956800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe95015f9d0 con 0x7fe95006e910 2024-09-11T00:27:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.020+0000 7fe956800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe95006f5d0 con 0x7fe9500cc180 2024-09-11T00:27:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.020+0000 7fe94fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe95015bcc0 0x7fe9500c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.020+0000 7fe94fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe95015bcc0 0x7fe9500c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49912/0 (socket says 172.21.15.40:49912) 2024-09-11T00:27:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.020+0000 7fe94fe00640 1 -- 172.21.15.40:0/2221257568 learned_addr learned my addr 172.21.15.40:0/2221257568 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.020+0000 7fe94f400640 1 --2- 172.21.15.40:0/2221257568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe95006e910 0x7fe95015c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.021+0000 7fe946a00640 1 --2- 172.21.15.40:0/2221257568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9500cc180 0x7fe9500c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.021+0000 7fe94fe00640 1 -- 172.21.15.40:0/2221257568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9500cc180 msgr2=0x7fe9500c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.021+0000 7fe94fe00640 1 --2- 172.21.15.40:0/2221257568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9500cc180 0x7fe9500c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.021+0000 7fe94fe00640 1 -- 172.21.15.40:0/2221257568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe95006e910 msgr2=0x7fe95015c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.021+0000 7fe94fe00640 1 --2- 172.21.15.40:0/2221257568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe95006e910 0x7fe95015c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.021+0000 7fe94fe00640 1 -- 172.21.15.40:0/2221257568 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9500c9890 con 0x7fe95015bcc0 2024-09-11T00:27:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.021+0000 7fe94f400640 1 --2- 172.21.15.40:0/2221257568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe95006e910 0x7fe95015c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:27:45.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.021+0000 7fe94fe00640 1 --2- 172.21.15.40:0/2221257568 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe95015bcc0 0x7fe9500c9110 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe94800c7a0 tx=0x7fe94800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:45.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.021+0000 7fe947e00640 1 -- 172.21.15.40:0/2221257568 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe948003b70 con 0x7fe95015bcc0 2024-09-11T00:27:45.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.021+0000 7fe947e00640 1 -- 172.21.15.40:0/2221257568 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe948003d10 con 0x7fe95015bcc0 2024-09-11T00:27:45.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.021+0000 7fe956800640 1 -- 172.21.15.40:0/2221257568 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9500c9b70 con 0x7fe95015bcc0 2024-09-11T00:27:45.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.021+0000 7fe947e00640 1 -- 172.21.15.40:0/2221257568 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94800aab0 con 0x7fe95015bcc0 2024-09-11T00:27:45.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.022+0000 7fe956800640 1 -- 172.21.15.40:0/2221257568 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9500c7000 con 0x7fe95015bcc0 2024-09-11T00:27:45.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.022+0000 7fe956800640 1 -- 172.21.15.40:0/2221257568 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe95006fa20 con 0x7fe95015bcc0 2024-09-11T00:27:45.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.024+0000 7fe947e00640 1 -- 172.21.15.40:0/2221257568 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe94800ac50 con 0x7fe95015bcc0 2024-09-11T00:27:45.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.025+0000 7fe947e00640 1 --2- 172.21.15.40:0/2221257568 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe92c077f70 0x7fe92c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:45.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.025+0000 7fe947e00640 1 -- 172.21.15.40:0/2221257568 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5795+0+0 (secure 0 0 0) 0x7fe948099d10 con 0x7fe95015bcc0 2024-09-11T00:27:45.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.026+0000 7fe94f400640 1 --2- 172.21.15.40:0/2221257568 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe92c077f70 0x7fe92c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:45.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.026+0000 7fe94f400640 1 --2- 172.21.15.40:0/2221257568 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe92c077f70 0x7fe92c07a430 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe940000f60 tx=0x7fe940009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:45.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.030+0000 7fe947e00640 1 -- 172.21.15.40:0/2221257568 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe94809f020 con 0x7fe95015bcc0 2024-09-11T00:27:45.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.261+0000 7fe956800640 1 -- 172.21.15.40:0/2221257568 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe9500b29e0 con 0x7fe95015bcc0 2024-09-11T00:27:45.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.827+0000 7fe947e00640 1 -- 172.21.15.40:0/2221257568 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7fe948062710 con 0x7fe95015bcc0 2024-09-11T00:27:45.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.830+0000 7fe956800640 1 -- 172.21.15.40:0/2221257568 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe92c077f70 msgr2=0x7fe92c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:45.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.830+0000 7fe956800640 1 --2- 172.21.15.40:0/2221257568 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe92c077f70 0x7fe92c07a430 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe940000f60 tx=0x7fe940009040 comp rx=0 tx=0).stop 2024-09-11T00:27:45.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.830+0000 7fe956800640 1 -- 172.21.15.40:0/2221257568 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe95015bcc0 msgr2=0x7fe9500c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:45.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.830+0000 7fe956800640 1 --2- 172.21.15.40:0/2221257568 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe95015bcc0 0x7fe9500c9110 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe94800c7a0 tx=0x7fe94800cc60 comp rx=0 tx=0).stop 2024-09-11T00:27:45.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.830+0000 7fe956800640 1 -- 172.21.15.40:0/2221257568 shutdown_connections 2024-09-11T00:27:45.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.830+0000 7fe956800640 1 --2- 172.21.15.40:0/2221257568 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe95015bcc0 0x7fe9500c9110 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:45.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.830+0000 7fe956800640 1 --2- 172.21.15.40:0/2221257568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9500cc180 0x7fe9500c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:45.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.830+0000 7fe956800640 1 --2- 172.21.15.40:0/2221257568 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe92c077f70 0x7fe92c07a430 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:45.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.830+0000 7fe956800640 1 --2- 172.21.15.40:0/2221257568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe95006e910 0x7fe95015c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:45.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.830+0000 7fe956800640 1 -- 172.21.15.40:0/2221257568 >> 172.21.15.40:0/2221257568 conn(0x7fe9500cfbb0 msgr2=0x7fe9500cafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:45.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.831+0000 7fe956800640 1 -- 172.21.15.40:0/2221257568 shutdown_connections 2024-09-11T00:27:45.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:45.831+0000 7fe956800640 1 -- 172.21.15.40:0/2221257568 wait complete. 2024-09-11T00:27:45.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T00:27:46.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.018+0000 7f23ce800640 1 -- 172.21.15.40:0/868373391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23c80d1810 msgr2=0x7f23c80d0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:46.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.018+0000 7f23ce800640 1 --2- 172.21.15.40:0/868373391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23c80d1810 0x7f23c80d0650 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009830 tx=0x7f23b402a3f0 comp rx=0 tx=0).stop 2024-09-11T00:27:46.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.018+0000 7f23ce800640 1 -- 172.21.15.40:0/868373391 shutdown_connections 2024-09-11T00:27:46.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.018+0000 7f23ce800640 1 --2- 172.21.15.40:0/868373391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23c80d1810 0x7f23c80d0650 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:46.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.018+0000 7f23ce800640 1 --2- 172.21.15.40:0/868373391 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23c815dd30 0x7f23c80d1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:46.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.018+0000 7f23ce800640 1 -- 172.21.15.40:0/868373391 >> 172.21.15.40:0/868373391 conn(0x7f23c809ce90 msgr2=0x7f23c80d3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:46.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.018+0000 7f23ce800640 1 -- 172.21.15.40:0/868373391 shutdown_connections 2024-09-11T00:27:46.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.018+0000 7f23ce800640 1 -- 172.21.15.40:0/868373391 wait complete. 2024-09-11T00:27:46.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.019+0000 7f23ce800640 1 Processor -- start 2024-09-11T00:27:46.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.020+0000 7f23ce800640 1 -- start start 2024-09-11T00:27:46.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.020+0000 7f23ce800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23c80d0b90 0x7f23c80a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:46.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.020+0000 7f23ce800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23c80d1810 0x7f23c815a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:46.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.020+0000 7f23ce800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23c815dd30 0x7f23c80cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:46.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.021+0000 7f23ce800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f23c80cedf0 con 0x7f23c80d1810 2024-09-11T00:27:46.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.021+0000 7f23ce800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f23c80b8700 con 0x7f23c80d0b90 2024-09-11T00:27:46.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.021+0000 7f23ce800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f23c80cef70 con 0x7f23c815dd30 2024-09-11T00:27:46.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.021+0000 7f23cca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23c80d1810 0x7f23c815a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:46.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.021+0000 7f23cca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23c80d1810 0x7f23c815a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49924/0 (socket says 172.21.15.40:49924) 2024-09-11T00:27:46.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.021+0000 7f23cca00640 1 -- 172.21.15.40:0/818057962 learned_addr learned my addr 172.21.15.40:0/818057962 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:46.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.021+0000 7f23cd400640 1 --2- 172.21.15.40:0/818057962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23c80d0b90 0x7f23c80a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:46.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.021+0000 7f23cde00640 1 --2- 172.21.15.40:0/818057962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23c815dd30 0x7f23c80cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:46.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.021+0000 7f23cca00640 1 -- 172.21.15.40:0/818057962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23c815dd30 msgr2=0x7f23c80cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:46.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.021+0000 7f23cca00640 1 --2- 172.21.15.40:0/818057962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23c815dd30 0x7f23c80cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:46.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.021+0000 7f23cca00640 1 -- 172.21.15.40:0/818057962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23c80d0b90 msgr2=0x7f23c80a14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:46.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.021+0000 7f23cca00640 1 --2- 172.21.15.40:0/818057962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23c80d0b90 0x7f23c80a14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:46.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.021+0000 7f23cca00640 1 -- 172.21.15.40:0/818057962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c81f43c0 con 0x7f23c80d1810 2024-09-11T00:27:46.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.022+0000 7f23cca00640 1 --2- 172.21.15.40:0/818057962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23c80d1810 0x7f23c815a720 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f23b4000c00 tx=0x7f23b4032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:46.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.022+0000 7f23c5600640 1 -- 172.21.15.40:0/818057962 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4040070 con 0x7f23c80d1810 2024-09-11T00:27:46.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.022+0000 7f23c5600640 1 -- 172.21.15.40:0/818057962 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23b40038e0 con 0x7f23c80d1810 2024-09-11T00:27:46.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.022+0000 7f23c5600640 1 -- 172.21.15.40:0/818057962 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4005c90 con 0x7f23c80d1810 2024-09-11T00:27:46.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.022+0000 7f23ce800640 1 -- 172.21.15.40:0/818057962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c81f46a0 con 0x7f23c80d1810 2024-09-11T00:27:46.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.022+0000 7f23ce800640 1 -- 172.21.15.40:0/818057962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c81f4c60 con 0x7f23c80d1810 2024-09-11T00:27:46.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.023+0000 7f23ce800640 1 -- 172.21.15.40:0/818057962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c80cf4c0 con 0x7f23c80d1810 2024-09-11T00:27:46.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.025+0000 7f23c5600640 1 -- 172.21.15.40:0/818057962 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f23b4045460 con 0x7f23c80d1810 2024-09-11T00:27:46.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.025+0000 7f23c5600640 1 --2- 172.21.15.40:0/818057962 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f23a8077f70 0x7f23a807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:46.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.026+0000 7f23c5600640 1 -- 172.21.15.40:0/818057962 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5795+0+0 (secure 0 0 0) 0x7f23b40bb410 con 0x7f23c80d1810 2024-09-11T00:27:46.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.026+0000 7f23cd400640 1 --2- 172.21.15.40:0/818057962 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f23a8077f70 0x7f23a807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:46.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.027+0000 7f23cd400640 1 --2- 172.21.15.40:0/818057962 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f23a8077f70 0x7f23a807a430 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009b30 tx=0x7f23bc005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:46.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.030+0000 7f23c5600640 1 -- 172.21.15.40:0/818057962 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f23b40837c0 con 0x7f23c80d1810 2024-09-11T00:27:46.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.226+0000 7f23ce800640 1 -- 172.21.15.40:0/818057962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f23c815ac60 con 0x7f23c80d1810 2024-09-11T00:27:46.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.833+0000 7f23c5600640 1 -- 172.21.15.40:0/818057962 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) ==== 181+0+0 (secure 0 0 0) 0x7f23b40881f0 con 0x7f23c80d1810 2024-09-11T00:27:46.835 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' removed 2024-09-11T00:27:46.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.836+0000 7f23ce800640 1 -- 172.21.15.40:0/818057962 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f23a8077f70 msgr2=0x7f23a807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:46.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.836+0000 7f23ce800640 1 --2- 172.21.15.40:0/818057962 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f23a8077f70 0x7f23a807a430 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009b30 tx=0x7f23bc005f90 comp rx=0 tx=0).stop 2024-09-11T00:27:46.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.836+0000 7f23ce800640 1 -- 172.21.15.40:0/818057962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23c80d1810 msgr2=0x7f23c815a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:46.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.836+0000 7f23ce800640 1 --2- 172.21.15.40:0/818057962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23c80d1810 0x7f23c815a720 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f23b4000c00 tx=0x7f23b4032c10 comp rx=0 tx=0).stop 2024-09-11T00:27:46.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.836+0000 7f23ce800640 1 -- 172.21.15.40:0/818057962 shutdown_connections 2024-09-11T00:27:46.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.836+0000 7f23ce800640 1 --2- 172.21.15.40:0/818057962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23c815dd30 0x7f23c80cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:46.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.836+0000 7f23ce800640 1 --2- 172.21.15.40:0/818057962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23c80d1810 0x7f23c815a720 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:46.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.836+0000 7f23ce800640 1 --2- 172.21.15.40:0/818057962 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f23a8077f70 0x7f23a807a430 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:46.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.836+0000 7f23ce800640 1 --2- 172.21.15.40:0/818057962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23c80d0b90 0x7f23c80a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:46.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.836+0000 7f23ce800640 1 -- 172.21.15.40:0/818057962 >> 172.21.15.40:0/818057962 conn(0x7f23c809ce90 msgr2=0x7f23c806db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:46.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.837+0000 7f23ce800640 1 -- 172.21.15.40:0/818057962 shutdown_connections 2024-09-11T00:27:46.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:46.837+0000 7f23ce800640 1 -- 172.21.15.40:0/818057962 wait complete. 2024-09-11T00:27:46.856 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T00:27:47.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.019+0000 7ff902c00640 1 -- 172.21.15.40:0/4131584879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8fc0cec60 msgr2=0x7ff8fc072340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:47.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.019+0000 7ff902c00640 1 --2- 172.21.15.40:0/4131584879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8fc0cec60 0x7ff8fc072340 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0af410 tx=0x7ff8f402a760 comp rx=0 tx=0).stop 2024-09-11T00:27:47.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.019+0000 7ff902c00640 1 -- 172.21.15.40:0/4131584879 shutdown_connections 2024-09-11T00:27:47.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.019+0000 7ff902c00640 1 --2- 172.21.15.40:0/4131584879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8fc0cec60 0x7ff8fc072340 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:47.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.019+0000 7ff902c00640 1 --2- 172.21.15.40:0/4131584879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8fc15b7c0 0x7ff8fc0cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:47.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.019+0000 7ff902c00640 1 -- 172.21.15.40:0/4131584879 >> 172.21.15.40:0/4131584879 conn(0x7ff8fc0cf850 msgr2=0x7ff8fc0cfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:47.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.019+0000 7ff902c00640 1 -- 172.21.15.40:0/4131584879 shutdown_connections 2024-09-11T00:27:47.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.019+0000 7ff902c00640 1 -- 172.21.15.40:0/4131584879 wait complete. 2024-09-11T00:27:47.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.021+0000 7ff902c00640 1 Processor -- start 2024-09-11T00:27:47.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.021+0000 7ff902c00640 1 -- start start 2024-09-11T00:27:47.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.022+0000 7ff902c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8fc06e0c0 0x7ff8fc154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:47.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.022+0000 7ff902c00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8fc0cec60 0x7ff8fc151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:47.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.022+0000 7ff902c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8fc15b7c0 0x7ff8fc13bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:47.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.022+0000 7ff902c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc072a00 con 0x7ff8fc06e0c0 2024-09-11T00:27:47.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.022+0000 7ff902c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc072880 con 0x7ff8fc15b7c0 2024-09-11T00:27:47.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.022+0000 7ff902c00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff8fc072b80 con 0x7ff8fc0cec60 2024-09-11T00:27:47.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.022+0000 7ff900e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8fc0cec60 0x7ff8fc151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:47.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.022+0000 7ff900e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8fc0cec60 0x7ff8fc151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.40:37934/0 (socket says 172.21.15.40:37934) 2024-09-11T00:27:47.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.022+0000 7ff900e00640 1 -- 172.21.15.40:0/2971441160 learned_addr learned my addr 172.21.15.40:0/2971441160 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:47.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.022+0000 7ff902200640 1 --2- 172.21.15.40:0/2971441160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8fc15b7c0 0x7ff8fc13bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:47.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.022+0000 7ff901800640 1 --2- 172.21.15.40:0/2971441160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8fc06e0c0 0x7ff8fc154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:47.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.023+0000 7ff900e00640 1 -- 172.21.15.40:0/2971441160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8fc15b7c0 msgr2=0x7ff8fc13bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:47.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.023+0000 7ff900e00640 1 --2- 172.21.15.40:0/2971441160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8fc15b7c0 0x7ff8fc13bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:47.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.023+0000 7ff900e00640 1 -- 172.21.15.40:0/2971441160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8fc06e0c0 msgr2=0x7ff8fc154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:47.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.023+0000 7ff900e00640 1 --2- 172.21.15.40:0/2971441160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8fc06e0c0 0x7ff8fc154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:47.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.023+0000 7ff900e00640 1 -- 172.21.15.40:0/2971441160 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8fc1e5620 con 0x7ff8fc0cec60 2024-09-11T00:27:47.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.023+0000 7ff901800640 1 --2- 172.21.15.40:0/2971441160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8fc06e0c0 0x7ff8fc154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:27:47.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.023+0000 7ff900e00640 1 --2- 172.21.15.40:0/2971441160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8fc0cec60 0x7ff8fc151d30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800c420 tx=0x7ff8e800c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:47.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.023+0000 7ff8f9600640 1 -- 172.21.15.40:0/2971441160 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8011790 con 0x7ff8fc0cec60 2024-09-11T00:27:47.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.023+0000 7ff8f9600640 1 -- 172.21.15.40:0/2971441160 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8e8017070 con 0x7ff8fc0cec60 2024-09-11T00:27:47.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.024+0000 7ff8f9600640 1 -- 172.21.15.40:0/2971441160 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8011c80 con 0x7ff8fc0cec60 2024-09-11T00:27:47.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.024+0000 7ff902c00640 1 -- 172.21.15.40:0/2971441160 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8fc1540d0 con 0x7ff8fc0cec60 2024-09-11T00:27:47.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.024+0000 7ff902c00640 1 -- 172.21.15.40:0/2971441160 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8fc1e5900 con 0x7ff8fc0cec60 2024-09-11T00:27:47.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.025+0000 7ff902c00640 1 -- 172.21.15.40:0/2971441160 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8fc073050 con 0x7ff8fc0cec60 2024-09-11T00:27:47.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.026+0000 7ff8f9600640 1 -- 172.21.15.40:0/2971441160 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff8e801c460 con 0x7ff8fc0cec60 2024-09-11T00:27:47.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.027+0000 7ff8f9600640 1 --2- 172.21.15.40:0/2971441160 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff8dc077fd0 0x7ff8dc07a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:47.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.027+0000 7ff8f9600640 1 -- 172.21.15.40:0/2971441160 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(37..37 src has 1..37) ==== 5357+0+0 (secure 0 0 0) 0x7ff8e809a3b0 con 0x7ff8fc0cec60 2024-09-11T00:27:47.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.027+0000 7ff901800640 1 --2- 172.21.15.40:0/2971441160 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff8dc077fd0 0x7ff8dc07a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:47.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.028+0000 7ff901800640 1 --2- 172.21.15.40:0/2971441160 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff8dc077fd0 0x7ff8dc07a490 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000bf40 tx=0x7ff8f000b2e0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:47.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.031+0000 7ff8f9600640 1 -- 172.21.15.40:0/2971441160 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff8e80629a0 con 0x7ff8fc0cec60 2024-09-11T00:27:47.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.228+0000 7ff902c00640 1 -- 172.21.15.40:0/2971441160 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff8fc0d0560 con 0x7ff8fc0cec60 2024-09-11T00:27:47.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.845+0000 7ff8f9600640 1 -- 172.21.15.40:0/2971441160 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) ==== 169+0+0 (secure 0 0 0) 0x7ff8e80673d0 con 0x7ff8fc0cec60 2024-09-11T00:27:47.847 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' removed 2024-09-11T00:27:47.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.848+0000 7ff902c00640 1 -- 172.21.15.40:0/2971441160 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff8dc077fd0 msgr2=0x7ff8dc07a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:47.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.848+0000 7ff902c00640 1 --2- 172.21.15.40:0/2971441160 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff8dc077fd0 0x7ff8dc07a490 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000bf40 tx=0x7ff8f000b2e0 comp rx=0 tx=0).stop 2024-09-11T00:27:47.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.848+0000 7ff902c00640 1 -- 172.21.15.40:0/2971441160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8fc0cec60 msgr2=0x7ff8fc151d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:47.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.848+0000 7ff902c00640 1 --2- 172.21.15.40:0/2971441160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8fc0cec60 0x7ff8fc151d30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800c420 tx=0x7ff8e800c8e0 comp rx=0 tx=0).stop 2024-09-11T00:27:47.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.848+0000 7ff902c00640 1 -- 172.21.15.40:0/2971441160 shutdown_connections 2024-09-11T00:27:47.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.848+0000 7ff902c00640 1 --2- 172.21.15.40:0/2971441160 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7ff8dc077fd0 0x7ff8dc07a490 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:47.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.848+0000 7ff902c00640 1 --2- 172.21.15.40:0/2971441160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8fc15b7c0 0x7ff8fc13bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:47.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.848+0000 7ff902c00640 1 --2- 172.21.15.40:0/2971441160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff8fc0cec60 0x7ff8fc151d30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:47.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.848+0000 7ff902c00640 1 --2- 172.21.15.40:0/2971441160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8fc06e0c0 0x7ff8fc154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:47.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.848+0000 7ff902c00640 1 -- 172.21.15.40:0/2971441160 >> 172.21.15.40:0/2971441160 conn(0x7ff8fc0cf850 msgr2=0x7ff8fc157c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:47.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.848+0000 7ff902c00640 1 -- 172.21.15.40:0/2971441160 shutdown_connections 2024-09-11T00:27:47.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:47.848+0000 7ff902c00640 1 -- 172.21.15.40:0/2971441160 wait complete. 2024-09-11T00:27:47.871 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-11T00:27:48.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.034+0000 7fe96b400640 1 -- 172.21.15.40:0/1189022710 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9640cc180 msgr2=0x7fe9640cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:48.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.034+0000 7fe96b400640 1 --2- 172.21.15.40:0/1189022710 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9640cc180 0x7fe9640cb420 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009860 tx=0x7fe94c02a510 comp rx=0 tx=0).stop 2024-09-11T00:27:48.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.035+0000 7fe96b400640 1 -- 172.21.15.40:0/1189022710 shutdown_connections 2024-09-11T00:27:48.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.035+0000 7fe96b400640 1 --2- 172.21.15.40:0/1189022710 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9640cc180 0x7fe9640cb420 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:48.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.035+0000 7fe96b400640 1 -- 172.21.15.40:0/1189022710 >> 172.21.15.40:0/1189022710 conn(0x7fe9640cfbb0 msgr2=0x7fe9640cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:48.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.035+0000 7fe96b400640 1 -- 172.21.15.40:0/1189022710 shutdown_connections 2024-09-11T00:27:48.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.035+0000 7fe96b400640 1 -- 172.21.15.40:0/1189022710 wait complete. 2024-09-11T00:27:48.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.036+0000 7fe96b400640 1 Processor -- start 2024-09-11T00:27:48.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.036+0000 7fe96b400640 1 -- start start 2024-09-11T00:27:48.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.037+0000 7fe96b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe96406e910 0x7fe9641f52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:48.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.037+0000 7fe96b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9640cc180 0x7fe9640ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:48.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.037+0000 7fe96b400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe96415bcc0 0x7fe9640aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:48.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.037+0000 7fe96b400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe96406f4b0 con 0x7fe9640cc180 2024-09-11T00:27:48.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.037+0000 7fe96b400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe96415f9d0 con 0x7fe96406e910 2024-09-11T00:27:48.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.037+0000 7fe96b400640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe96406f630 con 0x7fe96415bcc0 2024-09-11T00:27:48.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.038+0000 7fe95be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9640cc180 0x7fe9640ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:48.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.038+0000 7fe968a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe96406e910 0x7fe9641f52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:48.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.038+0000 7fe95be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9640cc180 0x7fe9640ae9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35526/0 (socket says 172.21.15.40:35526) 2024-09-11T00:27:48.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.038+0000 7fe95be00640 1 -- 172.21.15.40:0/1357479598 learned_addr learned my addr 172.21.15.40:0/1357479598 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:48.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.038+0000 7fe969400640 1 --2- 172.21.15.40:0/1357479598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe96415bcc0 0x7fe9640aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:48.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.038+0000 7fe95be00640 1 -- 172.21.15.40:0/1357479598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe96415bcc0 msgr2=0x7fe9640aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:48.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.038+0000 7fe95be00640 1 --2- 172.21.15.40:0/1357479598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe96415bcc0 0x7fe9640aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:48.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.038+0000 7fe95be00640 1 -- 172.21.15.40:0/1357479598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe96406e910 msgr2=0x7fe9641f52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:48.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.038+0000 7fe95be00640 1 --2- 172.21.15.40:0/1357479598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe96406e910 0x7fe9641f52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:48.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.038+0000 7fe95be00640 1 -- 172.21.15.40:0/1357479598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9640ad910 con 0x7fe9640cc180 2024-09-11T00:27:48.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.038+0000 7fe95be00640 1 --2- 172.21.15.40:0/1357479598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9640cc180 0x7fe9640ae9b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe94c02ab00 tx=0x7fe94c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:48.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.039+0000 7fe961600640 1 -- 172.21.15.40:0/1357479598 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c005c90 con 0x7fe9640cc180 2024-09-11T00:27:48.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.039+0000 7fe961600640 1 -- 172.21.15.40:0/1357479598 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe94c005110 con 0x7fe9640cc180 2024-09-11T00:27:48.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.039+0000 7fe961600640 1 -- 172.21.15.40:0/1357479598 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c005560 con 0x7fe9640cc180 2024-09-11T00:27:48.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.039+0000 7fe96b400640 1 -- 172.21.15.40:0/1357479598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9640adbf0 con 0x7fe9640cc180 2024-09-11T00:27:48.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.039+0000 7fe96b400640 1 -- 172.21.15.40:0/1357479598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9640ae1b0 con 0x7fe9640cc180 2024-09-11T00:27:48.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.040+0000 7fe96b400640 1 -- 172.21.15.40:0/1357479598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe96406fab0 con 0x7fe9640cc180 2024-09-11T00:27:48.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.041+0000 7fe961600640 1 -- 172.21.15.40:0/1357479598 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe94c0317c0 con 0x7fe9640cc180 2024-09-11T00:27:48.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.042+0000 7fe961600640 1 --2- 172.21.15.40:0/1357479598 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe940077f70 0x7fe94007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:48.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.042+0000 7fe961600640 1 -- 172.21.15.40:0/1357479598 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fe94c0bac70 con 0x7fe9640cc180 2024-09-11T00:27:48.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.043+0000 7fe968a00640 1 --2- 172.21.15.40:0/1357479598 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe940077f70 0x7fe94007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:48.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.043+0000 7fe968a00640 1 --2- 172.21.15.40:0/1357479598 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe940077f70 0x7fe94007a430 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe954001860 tx=0x7fe954009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:48.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.046+0000 7fe961600640 1 -- 172.21.15.40:0/1357479598 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe94c040030 con 0x7fe9640cc180 2024-09-11T00:27:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.240+0000 7fe96b400640 1 -- 172.21.15.40:0/1357479598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7fe96415b570 con 0x7fe9640cc180 2024-09-11T00:27:48.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.244+0000 7fe961600640 1 -- 172.21.15.40:0/1357479598 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v29) ==== 71+0+0 (secure 0 0 0) 0x7fe94c08c180 con 0x7fe9640cc180 2024-09-11T00:27:48.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.246+0000 7fe96b400640 1 -- 172.21.15.40:0/1357479598 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe940077f70 msgr2=0x7fe94007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:48.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.246+0000 7fe96b400640 1 --2- 172.21.15.40:0/1357479598 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe940077f70 0x7fe94007a430 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe954001860 tx=0x7fe954009040 comp rx=0 tx=0).stop 2024-09-11T00:27:48.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.246+0000 7fe96b400640 1 -- 172.21.15.40:0/1357479598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9640cc180 msgr2=0x7fe9640ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:48.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.246+0000 7fe96b400640 1 --2- 172.21.15.40:0/1357479598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9640cc180 0x7fe9640ae9b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe94c02ab00 tx=0x7fe94c003c10 comp rx=0 tx=0).stop 2024-09-11T00:27:48.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.247+0000 7fe96b400640 1 -- 172.21.15.40:0/1357479598 shutdown_connections 2024-09-11T00:27:48.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.247+0000 7fe96b400640 1 --2- 172.21.15.40:0/1357479598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe96415bcc0 0x7fe9640aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:48.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.247+0000 7fe96b400640 1 --2- 172.21.15.40:0/1357479598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9640cc180 0x7fe9640ae9b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:48.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.247+0000 7fe96b400640 1 --2- 172.21.15.40:0/1357479598 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fe940077f70 0x7fe94007a430 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:48.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.247+0000 7fe96b400640 1 --2- 172.21.15.40:0/1357479598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe96406e910 0x7fe9641f52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:48.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.247+0000 7fe96b400640 1 -- 172.21.15.40:0/1357479598 >> 172.21.15.40:0/1357479598 conn(0x7fe9640cfbb0 msgr2=0x7fe96406eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:48.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.247+0000 7fe96b400640 1 -- 172.21.15.40:0/1357479598 shutdown_connections 2024-09-11T00:27:48.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.247+0000 7fe96b400640 1 -- 172.21.15.40:0/1357479598 wait complete. 2024-09-11T00:27:48.265 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_acls.TestACLs.test_acls' 2024-09-11T00:27:48.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.427+0000 7fbe25e00640 1 -- 172.21.15.40:0/3466153068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe200cf130 msgr2=0x7fbe200d2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:48.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.427+0000 7fbe25e00640 1 --2- 172.21.15.40:0/3466153068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe200cf130 0x7fbe200d2060 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009830 tx=0x7fbe0c02a5a0 comp rx=0 tx=0).stop 2024-09-11T00:27:48.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.427+0000 7fbe25e00640 1 -- 172.21.15.40:0/3466153068 shutdown_connections 2024-09-11T00:27:48.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.427+0000 7fbe25e00640 1 --2- 172.21.15.40:0/3466153068 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe200d25a0 0x7fbe200b74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:48.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.427+0000 7fbe25e00640 1 --2- 172.21.15.40:0/3466153068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe200cf130 0x7fbe200d2060 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:48.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.427+0000 7fbe25e00640 1 -- 172.21.15.40:0/3466153068 >> 172.21.15.40:0/3466153068 conn(0x7fbe200d3b10 msgr2=0x7fbe200d3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:48.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.427+0000 7fbe25e00640 1 -- 172.21.15.40:0/3466153068 shutdown_connections 2024-09-11T00:27:48.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.427+0000 7fbe25e00640 1 -- 172.21.15.40:0/3466153068 wait complete. 2024-09-11T00:27:48.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.428+0000 7fbe25e00640 1 Processor -- start 2024-09-11T00:27:48.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.429+0000 7fbe25e00640 1 -- start start 2024-09-11T00:27:48.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.429+0000 7fbe25e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe200cf130 0x7fbe2015f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:48.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.430+0000 7fbe25e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe200d25a0 0x7fbe20147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:48.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.430+0000 7fbe25e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe2015dc70 0x7fbe20148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:48.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.430+0000 7fbe25e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbe200b7e60 con 0x7fbe200d25a0 2024-09-11T00:27:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.430+0000 7fbe25e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbe200b7ce0 con 0x7fbe200cf130 2024-09-11T00:27:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.430+0000 7fbe25e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbe200b7fe0 con 0x7fbe2015dc70 2024-09-11T00:27:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.430+0000 7fbe1fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe200d25a0 0x7fbe20147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.430+0000 7fbe1fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe200d25a0 0x7fbe20147be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35540/0 (socket says 172.21.15.40:35540) 2024-09-11T00:27:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.430+0000 7fbe1fe00640 1 -- 172.21.15.40:0/3491024828 learned_addr learned my addr 172.21.15.40:0/3491024828 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.430+0000 7fbe24a00640 1 --2- 172.21.15.40:0/3491024828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe200cf130 0x7fbe2015f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.430+0000 7fbe25400640 1 --2- 172.21.15.40:0/3491024828 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe2015dc70 0x7fbe20148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.430+0000 7fbe1fe00640 1 -- 172.21.15.40:0/3491024828 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe2015dc70 msgr2=0x7fbe20148120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.430+0000 7fbe1fe00640 1 --2- 172.21.15.40:0/3491024828 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe2015dc70 0x7fbe20148120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.430+0000 7fbe1fe00640 1 -- 172.21.15.40:0/3491024828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe200cf130 msgr2=0x7fbe2015f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.430+0000 7fbe1fe00640 1 --2- 172.21.15.40:0/3491024828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe200cf130 0x7fbe2015f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.430+0000 7fbe1fe00640 1 -- 172.21.15.40:0/3491024828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2015fbc0 con 0x7fbe200d25a0 2024-09-11T00:27:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.430+0000 7fbe24a00640 1 --2- 172.21.15.40:0/3491024828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe200cf130 0x7fbe2015f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:27:48.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.430+0000 7fbe25400640 1 --2- 172.21.15.40:0/3491024828 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe2015dc70 0x7fbe20148120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:27:48.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.431+0000 7fbe1fe00640 1 --2- 172.21.15.40:0/3491024828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe200d25a0 0x7fbe20147be0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009950 tx=0x7fbe0c032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:48.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.431+0000 7fbe1cc00640 1 -- 172.21.15.40:0/3491024828 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c040070 con 0x7fbe200d25a0 2024-09-11T00:27:48.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.431+0000 7fbe1cc00640 1 -- 172.21.15.40:0/3491024828 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe0c032e70 con 0x7fbe200d25a0 2024-09-11T00:27:48.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.431+0000 7fbe25e00640 1 -- 172.21.15.40:0/3491024828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe2015fe50 con 0x7fbe200d25a0 2024-09-11T00:27:48.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.431+0000 7fbe1cc00640 1 -- 172.21.15.40:0/3491024828 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c003d90 con 0x7fbe200d25a0 2024-09-11T00:27:48.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.431+0000 7fbe25e00640 1 -- 172.21.15.40:0/3491024828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe20160410 con 0x7fbe200d25a0 2024-09-11T00:27:48.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.432+0000 7fbe25e00640 1 -- 172.21.15.40:0/3491024828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe200b8570 con 0x7fbe200d25a0 2024-09-11T00:27:48.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.433+0000 7fbe1cc00640 1 -- 172.21.15.40:0/3491024828 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbe0c04d030 con 0x7fbe200d25a0 2024-09-11T00:27:48.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.434+0000 7fbe1cc00640 1 --2- 172.21.15.40:0/3491024828 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbe00077f70 0x7fbe0007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:48.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.434+0000 7fbe1cc00640 1 -- 172.21.15.40:0/3491024828 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fbe0c0bb100 con 0x7fbe200d25a0 2024-09-11T00:27:48.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.435+0000 7fbe24a00640 1 --2- 172.21.15.40:0/3491024828 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbe00077f70 0x7fbe0007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:48.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.435+0000 7fbe24a00640 1 --2- 172.21.15.40:0/3491024828 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbe00077f70 0x7fbe0007a430 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbe140016a0 tx=0x7fbe14009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:48.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.438+0000 7fbe1cc00640 1 -- 172.21.15.40:0/3491024828 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbe0c083e60 con 0x7fbe200d25a0 2024-09-11T00:27:48.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.704+0000 7fbe25e00640 1 -- 172.21.15.40:0/3491024828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) -- 0x7fbe2008db40 con 0x7fbe200d25a0 2024-09-11T00:27:48.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.841+0000 7fbe1cc00640 1 -- 172.21.15.40:0/3491024828 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v176) ==== 120+0+0 (secure 0 0 0) 0x7fbe0c083760 con 0x7fbe200d25a0 2024-09-11T00:27:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.844+0000 7fbe25e00640 1 -- 172.21.15.40:0/3491024828 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbe00077f70 msgr2=0x7fbe0007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.844+0000 7fbe25e00640 1 --2- 172.21.15.40:0/3491024828 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbe00077f70 0x7fbe0007a430 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbe140016a0 tx=0x7fbe14009040 comp rx=0 tx=0).stop 2024-09-11T00:27:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.844+0000 7fbe25e00640 1 -- 172.21.15.40:0/3491024828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe200d25a0 msgr2=0x7fbe20147be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.844+0000 7fbe25e00640 1 --2- 172.21.15.40:0/3491024828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe200d25a0 0x7fbe20147be0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009950 tx=0x7fbe0c032c80 comp rx=0 tx=0).stop 2024-09-11T00:27:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.844+0000 7fbe25e00640 1 -- 172.21.15.40:0/3491024828 shutdown_connections 2024-09-11T00:27:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.844+0000 7fbe25e00640 1 --2- 172.21.15.40:0/3491024828 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe2015dc70 0x7fbe20148120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.844+0000 7fbe25e00640 1 --2- 172.21.15.40:0/3491024828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe200d25a0 0x7fbe20147be0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.844+0000 7fbe25e00640 1 --2- 172.21.15.40:0/3491024828 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbe00077f70 0x7fbe0007a430 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.844+0000 7fbe25e00640 1 --2- 172.21.15.40:0/3491024828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe200cf130 0x7fbe2015f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.844+0000 7fbe25e00640 1 -- 172.21.15.40:0/3491024828 >> 172.21.15.40:0/3491024828 conn(0x7fbe200d3b10 msgr2=0x7fbe2006d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.844+0000 7fbe25e00640 1 -- 172.21.15.40:0/3491024828 shutdown_connections 2024-09-11T00:27:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:48.844+0000 7fbe25e00640 1 -- 172.21.15.40:0/3491024828 wait complete. 2024-09-11T00:27:48.862 INFO:tasks.cephfs_test_runner:test_acls (tasks.cephfs.test_acls.TestACLs) ... ok 2024-09-11T00:27:48.863 INFO:tasks.cephfs_test_runner: 2024-09-11T00:27:48.863 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-11T00:27:48.863 INFO:tasks.cephfs_test_runner:Ran 1 test in 208.435s 2024-09-11T00:27:48.863 INFO:tasks.cephfs_test_runner: 2024-09-11T00:27:48.863 INFO:tasks.cephfs_test_runner:OK 2024-09-11T00:27:48.863 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-11T00:27:48.874 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-11T00:27:48.882 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-11T00:27:48.883 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:27:48.883 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:27:48.921 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T00:27:48.921 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T00:27:48.921 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:27:48.997 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T00:27:48.997 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:27:48.997 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:27:49.037 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T00:27:49.037 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-11T00:27:49.037 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:27:49.114 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T00:27:49.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:27:49.115 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-09-11T00:27:49.193 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T00:27:49.193 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-11T00:27:49.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:27:49.193 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:27:49.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:27:49.291 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T00:27:49.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:27:49.589 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2024-09-11T00:27:49.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:27:49.877 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-09-11T00:27:49.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T00:27:49.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T00:27:49.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:27:49.917 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:27:50.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:27:50.017 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T00:27:50.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:27:50.288 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-09-11T00:27:50.597 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-11T00:27:50.609 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T00:27:50.609 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:27:50.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.769+0000 7fa041c00640 1 -- 172.21.15.40:0/2524960070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa03c0ae640 msgr2=0x7fa03c06edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:50.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.769+0000 7fa041c00640 1 --2- 172.21.15.40:0/2524960070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa03c0ae640 0x7fa03c06edd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa03c06e2a0 tx=0x7fa02402a5e0 comp rx=0 tx=0).stop 2024-09-11T00:27:50.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.769+0000 7fa041c00640 1 -- 172.21.15.40:0/2524960070 shutdown_connections 2024-09-11T00:27:50.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.769+0000 7fa041c00640 1 --2- 172.21.15.40:0/2524960070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa03c0ae640 0x7fa03c06edd0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:50.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.769+0000 7fa041c00640 1 --2- 172.21.15.40:0/2524960070 >> v2:172.21.15.175:3300/0 conn(0x7fa03c15baa0 0x7fa03c06e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:50.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.769+0000 7fa041c00640 1 -- 172.21.15.40:0/2524960070 >> 172.21.15.40:0/2524960070 conn(0x7fa03c0cf770 msgr2=0x7fa03c0cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:50.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.769+0000 7fa041c00640 1 -- 172.21.15.40:0/2524960070 shutdown_connections 2024-09-11T00:27:50.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.770+0000 7fa041c00640 1 -- 172.21.15.40:0/2524960070 wait complete. 2024-09-11T00:27:50.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.771+0000 7fa041c00640 1 Processor -- start 2024-09-11T00:27:50.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.771+0000 7fa041c00640 1 -- start start 2024-09-11T00:27:50.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.772+0000 7fa041c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa03c073830 0x7fa03c150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:50.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.772+0000 7fa041c00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa03c0ae640 0x7fa03c0cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:50.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.772+0000 7fa041c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa03c15baa0 0x7fa03c0c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:50.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.772+0000 7fa041c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c0b5760 con 0x7fa03c15baa0 2024-09-11T00:27:50.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.772+0000 7fa041c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c0d0720 con 0x7fa03c073830 2024-09-11T00:27:50.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.772+0000 7fa041c00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa03c15be80 con 0x7fa03c0ae640 2024-09-11T00:27:50.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.772+0000 7fa041200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa03c15baa0 0x7fa03c0c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:50.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.772+0000 7fa041200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa03c15baa0 0x7fa03c0c51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35560/0 (socket says 172.21.15.40:35560) 2024-09-11T00:27:50.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.773+0000 7fa041200640 1 -- 172.21.15.40:0/4022954119 learned_addr learned my addr 172.21.15.40:0/4022954119 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:50.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.773+0000 7fa033e00640 1 --2- 172.21.15.40:0/4022954119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa03c0ae640 0x7fa03c0cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:50.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.773+0000 7fa03be00640 1 --2- 172.21.15.40:0/4022954119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa03c073830 0x7fa03c150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:50.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.773+0000 7fa041200640 1 -- 172.21.15.40:0/4022954119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa03c0ae640 msgr2=0x7fa03c0cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:50.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.773+0000 7fa041200640 1 --2- 172.21.15.40:0/4022954119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa03c0ae640 0x7fa03c0cb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:50.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.773+0000 7fa041200640 1 -- 172.21.15.40:0/4022954119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa03c073830 msgr2=0x7fa03c150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:50.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.773+0000 7fa041200640 1 --2- 172.21.15.40:0/4022954119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa03c073830 0x7fa03c150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:50.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.773+0000 7fa041200640 1 -- 172.21.15.40:0/4022954119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa03c0c5940 con 0x7fa03c15baa0 2024-09-11T00:27:50.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.773+0000 7fa041200640 1 --2- 172.21.15.40:0/4022954119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa03c15baa0 0x7fa03c0c51b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa03400c7a0 tx=0x7fa03400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:50.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.773+0000 7fa038c00640 1 -- 172.21.15.40:0/4022954119 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa034003b70 con 0x7fa03c15baa0 2024-09-11T00:27:50.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.773+0000 7fa038c00640 1 -- 172.21.15.40:0/4022954119 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa034003d10 con 0x7fa03c15baa0 2024-09-11T00:27:50.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.773+0000 7fa041c00640 1 -- 172.21.15.40:0/4022954119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa03c0c5c20 con 0x7fa03c15baa0 2024-09-11T00:27:50.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.774+0000 7fa038c00640 1 -- 172.21.15.40:0/4022954119 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03400aab0 con 0x7fa03c15baa0 2024-09-11T00:27:50.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.774+0000 7fa041c00640 1 -- 172.21.15.40:0/4022954119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa03c0c61e0 con 0x7fa03c15baa0 2024-09-11T00:27:50.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.775+0000 7fa041c00640 1 -- 172.21.15.40:0/4022954119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa03c073c60 con 0x7fa03c15baa0 2024-09-11T00:27:50.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.776+0000 7fa038c00640 1 -- 172.21.15.40:0/4022954119 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa03400ac50 con 0x7fa03c15baa0 2024-09-11T00:27:50.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.777+0000 7fa038c00640 1 --2- 172.21.15.40:0/4022954119 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa018077fa0 0x7fa01807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:50.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.777+0000 7fa038c00640 1 -- 172.21.15.40:0/4022954119 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fa034099890 con 0x7fa03c15baa0 2024-09-11T00:27:50.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.777+0000 7fa03be00640 1 --2- 172.21.15.40:0/4022954119 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa018077fa0 0x7fa01807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:50.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.778+0000 7fa03be00640 1 --2- 172.21.15.40:0/4022954119 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa018077fa0 0x7fa01807a460 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa02c005fd0 tx=0x7fa02c005850 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.781+0000 7fa038c00640 1 -- 172.21.15.40:0/4022954119 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa034062690 con 0x7fa03c15baa0 2024-09-11T00:27:50.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.975+0000 7fa041c00640 1 -- 172.21.15.40:0/4022954119 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa03c0c6550 con 0x7fa018077fa0 2024-09-11T00:27:50.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.976+0000 7fa038c00640 1 -- 172.21.15.40:0/4022954119 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13473 (secure 0 0 0) 0x7fa03c0c6550 con 0x7fa018077fa0 2024-09-11T00:27:50.978 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:27:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T00:27:50.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.978+0000 7fa041c00640 1 -- 172.21.15.40:0/4022954119 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa018077fa0 msgr2=0x7fa01807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:50.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.978+0000 7fa041c00640 1 --2- 172.21.15.40:0/4022954119 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa018077fa0 0x7fa01807a460 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa02c005fd0 tx=0x7fa02c005850 comp rx=0 tx=0).stop 2024-09-11T00:27:50.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.978+0000 7fa041c00640 1 -- 172.21.15.40:0/4022954119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa03c15baa0 msgr2=0x7fa03c0c51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:50.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.978+0000 7fa041c00640 1 --2- 172.21.15.40:0/4022954119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa03c15baa0 0x7fa03c0c51b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa03400c7a0 tx=0x7fa03400cc60 comp rx=0 tx=0).stop 2024-09-11T00:27:50.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.979+0000 7fa041c00640 1 -- 172.21.15.40:0/4022954119 shutdown_connections 2024-09-11T00:27:50.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.979+0000 7fa041c00640 1 --2- 172.21.15.40:0/4022954119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa03c15baa0 0x7fa03c0c51b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:50.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.979+0000 7fa041c00640 1 --2- 172.21.15.40:0/4022954119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa03c0ae640 0x7fa03c0cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:50.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.979+0000 7fa041c00640 1 --2- 172.21.15.40:0/4022954119 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa018077fa0 0x7fa01807a460 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:50.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.979+0000 7fa041c00640 1 --2- 172.21.15.40:0/4022954119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa03c073830 0x7fa03c150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:50.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.979+0000 7fa041c00640 1 -- 172.21.15.40:0/4022954119 >> 172.21.15.40:0/4022954119 conn(0x7fa03c0cf770 msgr2=0x7fa03c15c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:50.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.979+0000 7fa041c00640 1 -- 172.21.15.40:0/4022954119 shutdown_connections 2024-09-11T00:27:50.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:50.979+0000 7fa041c00640 1 -- 172.21.15.40:0/4022954119 wait complete. 2024-09-11T00:27:50.996 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-11T00:27:49.840790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224736,"kb_used_data":4356,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749984,"statfs":{"total":773094113280,"available":772863983616,"internally_reserved":0,"allocated":4460544,"data_stored":2454699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7834,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001549"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":142,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:27:46.838730+0000","last_change":"2024-09-11T00:23:38.923873+0000","last_active":"2024-09-11T00:27:46.838730+0000","last_peered":"2024-09-11T00:27:46.838730+0000","last_clean":"2024-09-11T00:27:46.838730+0000","last_became_active":"2024-09-11T00:23:38.920629+0000","last_became_peered":"2024-09-11T00:23:38.920629+0000","last_unstale":"2024-09-11T00:27:46.838730+0000","last_undegraded":"2024-09-11T00:27:46.838730+0000","last_fullsized":"2024-09-11T00:27:46.838730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_clean_scrub_stamp":"2024-09-11T00:23:37.844553+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.533941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509493,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":999424,"data_stored":748505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":158663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509493,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":158719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509492,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":158151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":165105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":158117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":165105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542198,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":742334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:27:50.997 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:27:51.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.157+0000 7f5af9800640 1 -- 172.21.15.40:0/2499337470 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ad8004800 msgr2=0x7f5ad8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.157+0000 7f5af9800640 1 --2- 172.21.15.40:0/2499337470 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ad8004800 0x7f5ad8004c80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009b80 tx=0x7f5ad8005830 comp rx=0 tx=0).stop 2024-09-11T00:27:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.157+0000 7f5af3400640 1 -- 172.21.15.40:0/2499337470 reap_dead start 2024-09-11T00:27:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.157+0000 7f5af9800640 1 -- 172.21.15.40:0/2499337470 shutdown_connections 2024-09-11T00:27:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.157+0000 7f5af9800640 1 -- 172.21.15.40:0/2499337470 >> 172.21.15.40:0/2499337470 conn(0x7f5af40cfbb0 msgr2=0x7f5af40cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.157+0000 7f5af9800640 1 -- 172.21.15.40:0/2499337470 shutdown_connections 2024-09-11T00:27:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.157+0000 7f5af9800640 1 -- 172.21.15.40:0/2499337470 wait complete. 2024-09-11T00:27:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.158+0000 7f5af9800640 1 Processor -- start 2024-09-11T00:27:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.159+0000 7f5af9800640 1 -- start start 2024-09-11T00:27:51.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.159+0000 7f5af9800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ad8004800 0x7f5af40c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:51.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.159+0000 7f5af9800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5af40c36a0 0x7f5af41551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:51.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.159+0000 7f5af9800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5af41f2f70 0x7f5af4159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:51.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.159+0000 7f5af9800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5af406ed80 con 0x7f5af40c36a0 2024-09-11T00:27:51.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.159+0000 7f5af9800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5af415f9d0 con 0x7f5ad8004800 2024-09-11T00:27:51.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.159+0000 7f5af9800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5af406ef00 con 0x7f5af41f2f70 2024-09-11T00:27:51.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.160+0000 7f5af2000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5af40c36a0 0x7f5af41551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:51.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.160+0000 7f5af2000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5af40c36a0 0x7f5af41551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35584/0 (socket says 172.21.15.40:35584) 2024-09-11T00:27:51.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.160+0000 7f5af2000640 1 -- 172.21.15.40:0/2156571674 learned_addr learned my addr 172.21.15.40:0/2156571674 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:51.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.160+0000 7f5af2a00640 1 --2- 172.21.15.40:0/2156571674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ad8004800 0x7f5af40c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:51.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.160+0000 7f5af3400640 1 --2- 172.21.15.40:0/2156571674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5af41f2f70 0x7f5af4159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:51.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.160+0000 7f5af2000640 1 -- 172.21.15.40:0/2156571674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5af41f2f70 msgr2=0x7f5af4159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:51.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.160+0000 7f5af2000640 1 --2- 172.21.15.40:0/2156571674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5af41f2f70 0x7f5af4159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:51.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.160+0000 7f5af2000640 1 -- 172.21.15.40:0/2156571674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ad8004800 msgr2=0x7f5af40c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:51.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.160+0000 7f5af2000640 1 --2- 172.21.15.40:0/2156571674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ad8004800 0x7f5af40c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:51.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.160+0000 7f5af2000640 1 -- 172.21.15.40:0/2156571674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af40c6650 con 0x7f5af40c36a0 2024-09-11T00:27:51.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.161+0000 7f5af2000640 1 --2- 172.21.15.40:0/2156571674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5af40c36a0 0x7f5af41551c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5ae002b540 tx=0x7f5ae0033b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:51.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.161+0000 7f5aeaa00640 1 -- 172.21.15.40:0/2156571674 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0038040 con 0x7f5af40c36a0 2024-09-11T00:27:51.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.161+0000 7f5aeaa00640 1 -- 172.21.15.40:0/2156571674 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ae002b850 con 0x7f5af40c36a0 2024-09-11T00:27:51.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.161+0000 7f5aeaa00640 1 -- 172.21.15.40:0/2156571674 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0004020 con 0x7f5af40c36a0 2024-09-11T00:27:51.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.161+0000 7f5af9800640 1 -- 172.21.15.40:0/2156571674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af40c6370 con 0x7f5af40c36a0 2024-09-11T00:27:51.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.161+0000 7f5af9800640 1 -- 172.21.15.40:0/2156571674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af41f2770 con 0x7f5af40c36a0 2024-09-11T00:27:51.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.162+0000 7f5af9800640 1 -- 172.21.15.40:0/2156571674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af41f22a0 con 0x7f5af40c36a0 2024-09-11T00:27:51.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.163+0000 7f5aeaa00640 1 -- 172.21.15.40:0/2156571674 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5ae003b030 con 0x7f5af40c36a0 2024-09-11T00:27:51.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.164+0000 7f5aeaa00640 1 --2- 172.21.15.40:0/2156571674 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5ad4077fa0 0x7f5ad407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:51.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.164+0000 7f5aeaa00640 1 -- 172.21.15.40:0/2156571674 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f5ae00ba640 con 0x7f5af40c36a0 2024-09-11T00:27:51.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.165+0000 7f5af2a00640 1 --2- 172.21.15.40:0/2156571674 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5ad4077fa0 0x7f5ad407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:51.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.165+0000 7f5af2a00640 1 --2- 172.21.15.40:0/2156571674 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5ad4077fa0 0x7f5ad407a460 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4001eb0 tx=0x7f5ae4006040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:51.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.168+0000 7f5aeaa00640 1 -- 172.21.15.40:0/2156571674 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5ae002ba20 con 0x7f5af40c36a0 2024-09-11T00:27:51.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.360+0000 7f5af9800640 1 -- 172.21.15.40:0/2156571674 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5af4074380 con 0x7f5ad4077fa0 2024-09-11T00:27:51.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.361+0000 7f5aeaa00640 1 -- 172.21.15.40:0/2156571674 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13473 (secure 0 0 0) 0x7f5af4074380 con 0x7f5ad4077fa0 2024-09-11T00:27:51.362 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:27:51.363 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T00:27:51.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.363+0000 7f5af9800640 1 -- 172.21.15.40:0/2156571674 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5ad4077fa0 msgr2=0x7f5ad407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:51.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.363+0000 7f5af9800640 1 --2- 172.21.15.40:0/2156571674 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5ad4077fa0 0x7f5ad407a460 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4001eb0 tx=0x7f5ae4006040 comp rx=0 tx=0).stop 2024-09-11T00:27:51.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.363+0000 7f5af9800640 1 -- 172.21.15.40:0/2156571674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5af40c36a0 msgr2=0x7f5af41551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:51.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.363+0000 7f5af9800640 1 --2- 172.21.15.40:0/2156571674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5af40c36a0 0x7f5af41551c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5ae002b540 tx=0x7f5ae0033b30 comp rx=0 tx=0).stop 2024-09-11T00:27:51.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.363+0000 7f5af9800640 1 -- 172.21.15.40:0/2156571674 shutdown_connections 2024-09-11T00:27:51.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.363+0000 7f5af9800640 1 --2- 172.21.15.40:0/2156571674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5af41f2f70 0x7f5af4159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:51.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.363+0000 7f5af9800640 1 --2- 172.21.15.40:0/2156571674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5af40c36a0 0x7f5af41551c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:51.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.363+0000 7f5af9800640 1 --2- 172.21.15.40:0/2156571674 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5ad4077fa0 0x7f5ad407a460 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:51.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.363+0000 7f5af9800640 1 --2- 172.21.15.40:0/2156571674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ad8004800 0x7f5af40c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:51.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.363+0000 7f5af9800640 1 -- 172.21.15.40:0/2156571674 >> 172.21.15.40:0/2156571674 conn(0x7f5af40cfbb0 msgr2=0x7f5af40b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:51.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.363+0000 7f5af9800640 1 -- 172.21.15.40:0/2156571674 shutdown_connections 2024-09-11T00:27:51.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.363+0000 7f5af9800640 1 -- 172.21.15.40:0/2156571674 wait complete. 2024-09-11T00:27:51.381 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-11T00:27:49.840790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224736,"kb_used_data":4356,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749984,"statfs":{"total":773094113280,"available":772863983616,"internally_reserved":0,"allocated":4460544,"data_stored":2454699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7834,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001549"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":142,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:27:46.838730+0000","last_change":"2024-09-11T00:23:38.923873+0000","last_active":"2024-09-11T00:27:46.838730+0000","last_peered":"2024-09-11T00:27:46.838730+0000","last_clean":"2024-09-11T00:27:46.838730+0000","last_became_active":"2024-09-11T00:23:38.920629+0000","last_became_peered":"2024-09-11T00:23:38.920629+0000","last_unstale":"2024-09-11T00:27:46.838730+0000","last_undegraded":"2024-09-11T00:27:46.838730+0000","last_fullsized":"2024-09-11T00:27:46.838730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_clean_scrub_stamp":"2024-09-11T00:23:37.844553+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.533941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509493,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":999424,"data_stored":748505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":158663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509493,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":158719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509492,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":158151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":165105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":158117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":165105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542198,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":742334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:27:51.381 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T00:27:51.381 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:27:51.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.540+0000 7fbed5c00640 1 -- 172.21.15.40:0/2210359428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbed00734f0 msgr2=0x7fbed00ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:51.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.540+0000 7fbed5c00640 1 --2- 172.21.15.40:0/2210359428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbed00734f0 0x7fbed00ce450 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbec0005fd0 tx=0x7fbec002a540 comp rx=0 tx=0).stop 2024-09-11T00:27:51.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.540+0000 7fbed5c00640 1 -- 172.21.15.40:0/2210359428 shutdown_connections 2024-09-11T00:27:51.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.540+0000 7fbed5c00640 1 --2- 172.21.15.40:0/2210359428 >> v2:172.21.15.175:3300/0 conn(0x7fbed00cf970 0x7fbed00ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:51.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.540+0000 7fbed5c00640 1 --2- 172.21.15.40:0/2210359428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbed00734f0 0x7fbed00ce450 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:51.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.540+0000 7fbed5c00640 1 -- 172.21.15.40:0/2210359428 >> 172.21.15.40:0/2210359428 conn(0x7fbed00d0880 msgr2=0x7fbed00d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:51.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.540+0000 7fbed5c00640 1 -- 172.21.15.40:0/2210359428 shutdown_connections 2024-09-11T00:27:51.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.540+0000 7fbed5c00640 1 -- 172.21.15.40:0/2210359428 wait complete. 2024-09-11T00:27:51.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.542+0000 7fbed5c00640 1 Processor -- start 2024-09-11T00:27:51.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.542+0000 7fbed5c00640 1 -- start start 2024-09-11T00:27:51.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.542+0000 7fbed5c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbed00734f0 0x7fbed01576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:51.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.543+0000 7fbed5c00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbed0073e60 0x7fbed01f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:51.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.543+0000 7fbed5c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed00cf970 0x7fbed01f4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:51.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.543+0000 7fbed5c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbed0071130 con 0x7fbed00cf970 2024-09-11T00:27:51.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.543+0000 7fbed5c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbed0073ae0 con 0x7fbed00734f0 2024-09-11T00:27:51.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.543+0000 7fbed5c00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbed00ceed0 con 0x7fbed0073e60 2024-09-11T00:27:51.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.543+0000 7fbed5200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed00cf970 0x7fbed01f4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:51.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.543+0000 7fbed5200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed00cf970 0x7fbed01f4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35598/0 (socket says 172.21.15.40:35598) 2024-09-11T00:27:51.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.543+0000 7fbecfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbed00734f0 0x7fbed01576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:51.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.543+0000 7fbed5200640 1 -- 172.21.15.40:0/1060756821 learned_addr learned my addr 172.21.15.40:0/1060756821 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:51.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.543+0000 7fbec7400640 1 --2- 172.21.15.40:0/1060756821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbed0073e60 0x7fbed01f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:51.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.543+0000 7fbed5200640 1 -- 172.21.15.40:0/1060756821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbed0073e60 msgr2=0x7fbed01f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:51.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.543+0000 7fbed5200640 1 --2- 172.21.15.40:0/1060756821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbed0073e60 0x7fbed01f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:51.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.543+0000 7fbed5200640 1 -- 172.21.15.40:0/1060756821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbed00734f0 msgr2=0x7fbed01576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:51.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.543+0000 7fbed5200640 1 --2- 172.21.15.40:0/1060756821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbed00734f0 0x7fbed01576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:51.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.543+0000 7fbed5200640 1 -- 172.21.15.40:0/1060756821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed01e5210 con 0x7fbed00cf970 2024-09-11T00:27:51.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.544+0000 7fbed5200640 1 --2- 172.21.15.40:0/1060756821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed00cf970 0x7fbed01f4ae0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbec800c7d0 tx=0x7fbec800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:51.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.544+0000 7fbeccc00640 1 -- 172.21.15.40:0/1060756821 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8003b70 con 0x7fbed00cf970 2024-09-11T00:27:51.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.544+0000 7fbeccc00640 1 -- 172.21.15.40:0/1060756821 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbec8003d10 con 0x7fbed00cf970 2024-09-11T00:27:51.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.544+0000 7fbeccc00640 1 -- 172.21.15.40:0/1060756821 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec800aab0 con 0x7fbed00cf970 2024-09-11T00:27:51.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.544+0000 7fbed5c00640 1 -- 172.21.15.40:0/1060756821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed01e54f0 con 0x7fbed00cf970 2024-09-11T00:27:51.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.544+0000 7fbed5c00640 1 -- 172.21.15.40:0/1060756821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed0158130 con 0x7fbed00cf970 2024-09-11T00:27:51.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.545+0000 7fbed5c00640 1 -- 172.21.15.40:0/1060756821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbed00ccdc0 con 0x7fbed00cf970 2024-09-11T00:27:51.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.546+0000 7fbeccc00640 1 -- 172.21.15.40:0/1060756821 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbec800ac50 con 0x7fbed00cf970 2024-09-11T00:27:51.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.548+0000 7fbeccc00640 1 --2- 172.21.15.40:0/1060756821 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbeac077fa0 0x7fbeac07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:51.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.548+0000 7fbeccc00640 1 -- 172.21.15.40:0/1060756821 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fbec8099770 con 0x7fbed00cf970 2024-09-11T00:27:51.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.548+0000 7fbecfe00640 1 --2- 172.21.15.40:0/1060756821 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbeac077fa0 0x7fbeac07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:51.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.549+0000 7fbecfe00640 1 --2- 172.21.15.40:0/1060756821 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbeac077fa0 0x7fbeac07a460 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbec0033000 tx=0x7fbec0004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:51.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.552+0000 7fbeccc00640 1 -- 172.21.15.40:0/1060756821 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbed00ccdc0 con 0x7fbed00cf970 2024-09-11T00:27:51.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.743+0000 7fbed5c00640 1 -- 172.21.15.40:0/1060756821 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbed01e4fc0 con 0x7fbeac077fa0 2024-09-11T00:27:51.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.744+0000 7fbeccc00640 1 -- 172.21.15.40:0/1060756821 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13473 (secure 0 0 0) 0x7fbed01e4fc0 con 0x7fbeac077fa0 2024-09-11T00:27:51.746 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:27:51.746 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T00:27:51.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.747+0000 7fbed5c00640 1 -- 172.21.15.40:0/1060756821 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbeac077fa0 msgr2=0x7fbeac07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:51.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.747+0000 7fbed5c00640 1 --2- 172.21.15.40:0/1060756821 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbeac077fa0 0x7fbeac07a460 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbec0033000 tx=0x7fbec0004730 comp rx=0 tx=0).stop 2024-09-11T00:27:51.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.747+0000 7fbed5c00640 1 -- 172.21.15.40:0/1060756821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed00cf970 msgr2=0x7fbed01f4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:51.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.747+0000 7fbed5c00640 1 --2- 172.21.15.40:0/1060756821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed00cf970 0x7fbed01f4ae0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbec800c7d0 tx=0x7fbec800cc90 comp rx=0 tx=0).stop 2024-09-11T00:27:51.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.747+0000 7fbed5c00640 1 -- 172.21.15.40:0/1060756821 shutdown_connections 2024-09-11T00:27:51.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.747+0000 7fbed5c00640 1 --2- 172.21.15.40:0/1060756821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed00cf970 0x7fbed01f4ae0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:51.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.747+0000 7fbed5c00640 1 --2- 172.21.15.40:0/1060756821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbed0073e60 0x7fbed01f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:51.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.747+0000 7fbed5c00640 1 --2- 172.21.15.40:0/1060756821 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbeac077fa0 0x7fbeac07a460 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:51.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.747+0000 7fbed5c00640 1 --2- 172.21.15.40:0/1060756821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbed00734f0 0x7fbed01576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:51.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.747+0000 7fbed5c00640 1 -- 172.21.15.40:0/1060756821 >> 172.21.15.40:0/1060756821 conn(0x7fbed00d0880 msgr2=0x7fbed0071540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:51.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.747+0000 7fbed5c00640 1 -- 172.21.15.40:0/1060756821 shutdown_connections 2024-09-11T00:27:51.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.747+0000 7fbed5c00640 1 -- 172.21.15.40:0/1060756821 wait complete. 2024-09-11T00:27:51.764 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-11T00:27:49.840790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224736,"kb_used_data":4356,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749984,"statfs":{"total":773094113280,"available":772863983616,"internally_reserved":0,"allocated":4460544,"data_stored":2454699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7834,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001549"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":142,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-11T00:27:46.838730+0000","last_change":"2024-09-11T00:23:38.923873+0000","last_active":"2024-09-11T00:27:46.838730+0000","last_peered":"2024-09-11T00:27:46.838730+0000","last_clean":"2024-09-11T00:27:46.838730+0000","last_became_active":"2024-09-11T00:23:38.920629+0000","last_became_peered":"2024-09-11T00:23:38.920629+0000","last_unstale":"2024-09-11T00:27:46.838730+0000","last_undegraded":"2024-09-11T00:27:46.838730+0000","last_fullsized":"2024-09-11T00:27:46.838730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_clean_scrub_stamp":"2024-09-11T00:23:37.844553+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.533941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509493,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":999424,"data_stored":748505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":158663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509493,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":158719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509492,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":158151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":165105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":158117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":165105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542198,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":742334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:27:51.764 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:27:51.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.923+0000 7f42a6600640 1 -- 172.21.15.40:0/2564602228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42a015f050 msgr2=0x7f42a015e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:51.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.923+0000 7f42a6600640 1 --2- 172.21.15.40:0/2564602228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42a015f050 0x7f42a015e3b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4288005fd0 tx=0x7f428802a5d0 comp rx=0 tx=0).stop 2024-09-11T00:27:51.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.923+0000 7f42a6600640 1 -- 172.21.15.40:0/2564602228 shutdown_connections 2024-09-11T00:27:51.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.923+0000 7f42a6600640 1 --2- 172.21.15.40:0/2564602228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42a015f050 0x7f42a015e3b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:51.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.923+0000 7f42a6600640 1 -- 172.21.15.40:0/2564602228 >> 172.21.15.40:0/2564602228 conn(0x7f42a00cfbb0 msgr2=0x7f42a00cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:51.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.923+0000 7f42a6600640 1 -- 172.21.15.40:0/2564602228 shutdown_connections 2024-09-11T00:27:51.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.923+0000 7f42a6600640 1 -- 172.21.15.40:0/2564602228 wait complete. 2024-09-11T00:27:51.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.925+0000 7f42a6600640 1 Processor -- start 2024-09-11T00:27:51.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.925+0000 7f42a6600640 1 -- start start 2024-09-11T00:27:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.926+0000 7f42a6600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42a00cd780 0x7f42a014ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.926+0000 7f42a6600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42a015ec70 0x7f42a01545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.926+0000 7f42a6600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42a015f050 0x7f42a00b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.926+0000 7f42a6600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f42a0169450 con 0x7f42a00cd780 2024-09-11T00:27:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.926+0000 7f42a6600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f42a00ce070 con 0x7f42a015ec70 2024-09-11T00:27:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.926+0000 7f42a6600640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f42a01695d0 con 0x7f42a015f050 2024-09-11T00:27:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.926+0000 7f429f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42a00cd780 0x7f42a014ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.926+0000 7f429f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42a00cd780 0x7f42a014ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35614/0 (socket says 172.21.15.40:35614) 2024-09-11T00:27:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.926+0000 7f429f400640 1 -- 172.21.15.40:0/598781623 learned_addr learned my addr 172.21.15.40:0/598781623 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.926+0000 7f4296a00640 1 --2- 172.21.15.40:0/598781623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42a015ec70 0x7f42a01545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.927+0000 7f429f400640 1 -- 172.21.15.40:0/598781623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42a015f050 msgr2=0x7f42a00b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.927+0000 7f429f400640 1 --2- 172.21.15.40:0/598781623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42a015f050 0x7f42a00b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.927+0000 7f429f400640 1 -- 172.21.15.40:0/598781623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42a015ec70 msgr2=0x7f42a01545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.927+0000 7f429f400640 1 --2- 172.21.15.40:0/598781623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42a015ec70 0x7f42a01545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.927+0000 7f429f400640 1 -- 172.21.15.40:0/598781623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a00b3570 con 0x7f42a00cd780 2024-09-11T00:27:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.927+0000 7f429f400640 1 --2- 172.21.15.40:0/598781623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42a00cd780 0x7f42a014ee80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f429000c450 tx=0x7f429000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.927+0000 7f4297e00640 1 -- 172.21.15.40:0/598781623 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42900052d0 con 0x7f42a00cd780 2024-09-11T00:27:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.927+0000 7f4297e00640 1 -- 172.21.15.40:0/598781623 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4290005470 con 0x7f42a00cd780 2024-09-11T00:27:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.927+0000 7f4297e00640 1 -- 172.21.15.40:0/598781623 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290012870 con 0x7f42a00cd780 2024-09-11T00:27:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.927+0000 7f42a6600640 1 -- 172.21.15.40:0/598781623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a00b3850 con 0x7f42a00cd780 2024-09-11T00:27:51.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.927+0000 7f42a6600640 1 -- 172.21.15.40:0/598781623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a00b3e10 con 0x7f42a00cd780 2024-09-11T00:27:51.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.928+0000 7f42a6600640 1 -- 172.21.15.40:0/598781623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a00b5b30 con 0x7f42a00cd780 2024-09-11T00:27:51.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.930+0000 7f4297e00640 1 -- 172.21.15.40:0/598781623 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f42900035f0 con 0x7f42a00cd780 2024-09-11T00:27:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.930+0000 7f4297e00640 1 --2- 172.21.15.40:0/598781623 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f427c077fa0 0x7f427c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.931+0000 7f4297e00640 1 -- 172.21.15.40:0/598781623 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f4290099580 con 0x7f42a00cd780 2024-09-11T00:27:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.931+0000 7f4296a00640 1 --2- 172.21.15.40:0/598781623 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f427c077fa0 0x7f427c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:51.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.932+0000 7f4296a00640 1 --2- 172.21.15.40:0/598781623 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f427c077fa0 0x7f427c07a460 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4288033000 tx=0x7f4288004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:51.935+0000 7f4297e00640 1 -- 172.21.15.40:0/598781623 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f42900622e0 con 0x7f42a00cd780 2024-09-11T00:27:52.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:52.132+0000 7f42a6600640 1 -- 172.21.15.40:0/598781623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42a0154af0 con 0x7f42a00cd780 2024-09-11T00:27:52.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:52.133+0000 7f4297e00640 1 -- 172.21.15.40:0/598781623 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+13008 (secure 0 0 0) 0x7f4290061be0 con 0x7f42a00cd780 2024-09-11T00:27:52.496 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:27:52.496 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":38,"fsid":"f5cb250f-2a64-4822-87ba-c63d5f030b36","created":"2024-09-11T00:23:22.512139+0000","modified":"2024-09-11T00:27:47.834010+0000","last_up_change":"2024-09-11T00:23:36.842446+0000","last_in_change":"2024-09-11T00:23:26.734953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:23:37.800502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee10e123-8817-4d94-a340-73d00121af37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6801","nonce":973366008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6803","nonce":973366008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6807","nonce":973366008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":973366008},{"type":"v1","addr":"172.21.15.40:6805","nonce":973366008}]},"public_addr":"172.21.15.40:6801/973366008","cluster_addr":"172.21.15.40:6803/973366008","heartbeat_back_addr":"172.21.15.40:6807/973366008","heartbeat_front_addr":"172.21.15.40:6805/973366008","state":["exists","up"]},{"osd":1,"uuid":"f90895e9-8660-42b9-8aba-3f9d4d130b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6823","nonce":2542266029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6827","nonce":2542266029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6831","nonce":2542266029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2542266029},{"type":"v1","addr":"172.21.15.40:6829","nonce":2542266029}]},"public_addr":"172.21.15.40:6823/2542266029","cluster_addr":"172.21.15.40:6827/2542266029","heartbeat_back_addr":"172.21.15.40:6831/2542266029","heartbeat_front_addr":"172.21.15.40:6829/2542266029","state":["exists","up"]},{"osd":2,"uuid":"a190497a-2aba-4748-8f1d-7e372259d65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6815","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6817","nonce":559505356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6819","nonce":559505356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6826","nonce":559505356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":559505356},{"type":"v1","addr":"172.21.15.40:6822","nonce":559505356}]},"public_addr":"172.21.15.40:6817/559505356","cluster_addr":"172.21.15.40:6819/559505356","heartbeat_back_addr":"172.21.15.40:6826/559505356","heartbeat_front_addr":"172.21.15.40:6822/559505356","state":["exists","up"]},{"osd":3,"uuid":"8be32ced-898a-46f2-b850-1517667766b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6809","nonce":503633839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6811","nonce":503633839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6816","nonce":503633839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":503633839},{"type":"v1","addr":"172.21.15.40:6813","nonce":503633839}]},"public_addr":"172.21.15.40:6809/503633839","cluster_addr":"172.21.15.40:6811/503633839","heartbeat_back_addr":"172.21.15.40:6816/503633839","heartbeat_front_addr":"172.21.15.40:6813/503633839","state":["exists","up"]},{"osd":4,"uuid":"9867fdfc-6f93-466e-b768-b5a1da7157de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6811","nonce":2418348042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6813","nonce":2418348042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6817","nonce":2418348042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2418348042},{"type":"v1","addr":"172.21.15.175:6815","nonce":2418348042}]},"public_addr":"172.21.15.175:6811/2418348042","cluster_addr":"172.21.15.175:6813/2418348042","heartbeat_back_addr":"172.21.15.175:6817/2418348042","heartbeat_front_addr":"172.21.15.175:6815/2418348042","state":["exists","up"]},{"osd":5,"uuid":"e2f6f616-b5db-466e-942f-e2762171a8ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6827","nonce":520822300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6829","nonce":520822300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6833","nonce":520822300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":520822300},{"type":"v1","addr":"172.21.15.175:6831","nonce":520822300}]},"public_addr":"172.21.15.175:6827/520822300","cluster_addr":"172.21.15.175:6829/520822300","heartbeat_back_addr":"172.21.15.175:6833/520822300","heartbeat_front_addr":"172.21.15.175:6831/520822300","state":["exists","up"]},{"osd":6,"uuid":"807ac045-bf63-4ff6-9a06-7f7022f9ef32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6819","nonce":1431736593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6821","nonce":1431736593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6825","nonce":1431736593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1431736593},{"type":"v1","addr":"172.21.15.175:6823","nonce":1431736593}]},"public_addr":"172.21.15.175:6819/1431736593","cluster_addr":"172.21.15.175:6821/1431736593","heartbeat_back_addr":"172.21.15.175:6825/1431736593","heartbeat_front_addr":"172.21.15.175:6823/1431736593","state":["exists","up"]},{"osd":7,"uuid":"8e0b3293-390f-4b43-b29d-babdc5e88f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6803","nonce":3300317000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6805","nonce":3300317000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6809","nonce":3300317000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3300317000},{"type":"v1","addr":"172.21.15.175:6807","nonce":3300317000}]},"public_addr":"172.21.15.175:6803/3300317000","cluster_addr":"172.21.15.175:6805/3300317000","heartbeat_back_addr":"172.21.15.175:6809/3300317000","heartbeat_front_addr":"172.21.15.175:6807/3300317000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:32.967062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.266558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.063509+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.616332+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.431077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.866822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.645225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:23:33.016210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:6834/2666966234":"2024-09-12T00:27:44.823868+0000","172.21.15.40:6832/2666966234":"2024-09-12T00:27:44.823868+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:27:52.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:52.136+0000 7f42a6600640 1 -- 172.21.15.40:0/598781623 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f427c077fa0 msgr2=0x7f427c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:52.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:52.136+0000 7f42a6600640 1 --2- 172.21.15.40:0/598781623 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f427c077fa0 0x7f427c07a460 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4288033000 tx=0x7f4288004730 comp rx=0 tx=0).stop 2024-09-11T00:27:52.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:52.136+0000 7f42a6600640 1 -- 172.21.15.40:0/598781623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42a00cd780 msgr2=0x7f42a014ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:52.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:52.136+0000 7f42a6600640 1 --2- 172.21.15.40:0/598781623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42a00cd780 0x7f42a014ee80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f429000c450 tx=0x7f429000c910 comp rx=0 tx=0).stop 2024-09-11T00:27:52.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:52.136+0000 7f42a6600640 1 -- 172.21.15.40:0/598781623 shutdown_connections 2024-09-11T00:27:52.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:52.136+0000 7f42a6600640 1 --2- 172.21.15.40:0/598781623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42a015f050 0x7f42a00b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:52.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:52.136+0000 7f42a6600640 1 --2- 172.21.15.40:0/598781623 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f427c077fa0 0x7f427c07a460 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:52.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:52.136+0000 7f42a6600640 1 --2- 172.21.15.40:0/598781623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42a015ec70 0x7f42a01545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:52.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:52.136+0000 7f42a6600640 1 --2- 172.21.15.40:0/598781623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42a00cd780 0x7f42a014ee80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:52.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:52.136+0000 7f42a6600640 1 -- 172.21.15.40:0/598781623 >> 172.21.15.40:0/598781623 conn(0x7f42a00cfbb0 msgr2=0x7f42a00cb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:52.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:52.136+0000 7f42a6600640 1 -- 172.21.15.40:0/598781623 shutdown_connections 2024-09-11T00:27:52.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:52.136+0000 7f42a6600640 1 -- 172.21.15.40:0/598781623 wait complete. 2024-09-11T00:27:53.500 INFO:tasks.ceph:Scrubbing osd.0 2024-09-11T00:27:53.501 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-11T00:27:53.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.675+0000 7f518ca00640 1 -- 172.21.15.40:0/2516029187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51880cb350 msgr2=0x7f518806f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:53.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.675+0000 7f518ca00640 1 --2- 172.21.15.40:0/2516029187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51880cb350 0x7f518806f500 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5170005fd0 tx=0x7f517002a660 comp rx=0 tx=0).stop 2024-09-11T00:27:53.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.675+0000 7f518ca00640 1 -- 172.21.15.40:0/2516029187 shutdown_connections 2024-09-11T00:27:53.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.675+0000 7f518ca00640 1 --2- 172.21.15.40:0/2516029187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51880cb350 0x7f518806f500 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:53.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.675+0000 7f518ca00640 1 --2- 172.21.15.40:0/2516029187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f518815beb0 0x7f51880d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:53.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.675+0000 7f518ca00640 1 -- 172.21.15.40:0/2516029187 >> 172.21.15.40:0/2516029187 conn(0x7f51880cf950 msgr2=0x7f51880cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:53.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.675+0000 7f518ca00640 1 -- 172.21.15.40:0/2516029187 shutdown_connections 2024-09-11T00:27:53.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.675+0000 7f518ca00640 1 -- 172.21.15.40:0/2516029187 wait complete. 2024-09-11T00:27:53.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.677+0000 7f518ca00640 1 Processor -- start 2024-09-11T00:27:53.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.677+0000 7f518ca00640 1 -- start start 2024-09-11T00:27:53.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.678+0000 7f518ca00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51880cb350 0x7f51880c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:53.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.678+0000 7f518ca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f518815beb0 0x7f5188159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:53.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.678+0000 7f518ca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51880c8430 0x7f51881f3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:53.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.678+0000 7f518ca00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5188073c20 con 0x7f518815beb0 2024-09-11T00:27:53.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.678+0000 7f518ca00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f51880b31d0 con 0x7f51880c8430 2024-09-11T00:27:53.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.678+0000 7f518ca00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5188073da0 con 0x7f51880cb350 2024-09-11T00:27:53.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.678+0000 7f517d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f518815beb0 0x7f5188159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:53.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.678+0000 7f517d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f518815beb0 0x7f5188159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35630/0 (socket says 172.21.15.40:35630) 2024-09-11T00:27:53.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.678+0000 7f517d400640 1 -- 172.21.15.40:0/4116227941 learned_addr learned my addr 172.21.15.40:0/4116227941 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:53.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.679+0000 7f5185e00640 1 --2- 172.21.15.40:0/4116227941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51880cb350 0x7f51880c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:53.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.679+0000 7f5186800640 1 --2- 172.21.15.40:0/4116227941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51880c8430 0x7f51881f3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:53.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.679+0000 7f517d400640 1 -- 172.21.15.40:0/4116227941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51880cb350 msgr2=0x7f51880c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:53.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.679+0000 7f517d400640 1 --2- 172.21.15.40:0/4116227941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51880cb350 0x7f51880c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:53.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.679+0000 7f517d400640 1 -- 172.21.15.40:0/4116227941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51880c8430 msgr2=0x7f51881f3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:53.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.679+0000 7f517d400640 1 --2- 172.21.15.40:0/4116227941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51880c8430 0x7f51881f3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:53.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.679+0000 7f517d400640 1 -- 172.21.15.40:0/4116227941 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51880c6e50 con 0x7f518815beb0 2024-09-11T00:27:53.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.679+0000 7f517d400640 1 --2- 172.21.15.40:0/4116227941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f518815beb0 0x7f5188159310 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5170009850 tx=0x7f51700038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:53.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.679+0000 7f517ea00640 1 -- 172.21.15.40:0/4116227941 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517003f070 con 0x7f518815beb0 2024-09-11T00:27:53.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.679+0000 7f517ea00640 1 -- 172.21.15.40:0/4116227941 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51700047a0 con 0x7f518815beb0 2024-09-11T00:27:53.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.679+0000 7f517ea00640 1 -- 172.21.15.40:0/4116227941 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5170035030 con 0x7f518815beb0 2024-09-11T00:27:53.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.679+0000 7f518ca00640 1 -- 172.21.15.40:0/4116227941 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51880c7130 con 0x7f518815beb0 2024-09-11T00:27:53.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.679+0000 7f518ca00640 1 -- 172.21.15.40:0/4116227941 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51880c76f0 con 0x7f518815beb0 2024-09-11T00:27:53.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.680+0000 7f518ca00640 1 -- 172.21.15.40:0/4116227941 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f518806f500 con 0x7f518815beb0 2024-09-11T00:27:53.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.682+0000 7f517ea00640 1 -- 172.21.15.40:0/4116227941 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5170004b90 con 0x7f518815beb0 2024-09-11T00:27:53.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.682+0000 7f517ea00640 1 --2- 172.21.15.40:0/4116227941 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5164077f70 0x7f516407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:53.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.683+0000 7f517ea00640 1 -- 172.21.15.40:0/4116227941 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f51700bac70 con 0x7f518815beb0 2024-09-11T00:27:53.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.683+0000 7f517ea00640 1 --2- 172.21.15.40:0/4116227941 >> [v2:172.21.15.40:6800/973366008,v1:172.21.15.40:6801/973366008] conn(0x7f516407de30 0x7f5164080250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:53.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.683+0000 7f517ea00640 1 -- 172.21.15.40:0/4116227941 --> [v2:172.21.15.40:6800/973366008,v1:172.21.15.40:6801/973366008] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5164080900 con 0x7f516407de30 2024-09-11T00:27:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.683+0000 7f517ea00640 1 -- 172.21.15.40:0/4116227941 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f51700bd290 con 0x7f518815beb0 2024-09-11T00:27:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.683+0000 7f5185e00640 1 --2- 172.21.15.40:0/4116227941 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5164077f70 0x7f516407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.683+0000 7f5186800640 1 --2- 172.21.15.40:0/4116227941 >> [v2:172.21.15.40:6800/973366008,v1:172.21.15.40:6801/973366008] conn(0x7f516407de30 0x7f5164080250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.684+0000 7f5186800640 1 --2- 172.21.15.40:0/4116227941 >> [v2:172.21.15.40:6800/973366008,v1:172.21.15.40:6801/973366008] conn(0x7f516407de30 0x7f5164080250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.684+0000 7f5185e00640 1 --2- 172.21.15.40:0/4116227941 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5164077f70 0x7f516407a430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5178005fd0 tx=0x7f5178005850 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:53.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.684+0000 7f517ea00640 1 -- 172.21.15.40:0/4116227941 <== osd.0 v2:172.21.15.40:6800/973366008 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5164080900 con 0x7f516407de30 2024-09-11T00:27:53.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.698+0000 7f518ca00640 1 -- 172.21.15.40:0/4116227941 --> [v2:172.21.15.40:6800/973366008,v1:172.21.15.40:6801/973366008] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f51880c9b40 con 0x7f516407de30 2024-09-11T00:27:53.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.698+0000 7f517ea00640 1 -- 172.21.15.40:0/4116227941 <== osd.0 v2:172.21.15.40:6800/973366008 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f51880c9b40 con 0x7f516407de30 2024-09-11T00:27:53.700 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T00:27:53.700 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T00:27:53.700 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T00:27:53.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.698+0000 7f518ca00640 1 -- 172.21.15.40:0/4116227941 >> [v2:172.21.15.40:6800/973366008,v1:172.21.15.40:6801/973366008] conn(0x7f516407de30 msgr2=0x7f5164080250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:53.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.698+0000 7f518ca00640 1 --2- 172.21.15.40:0/4116227941 >> [v2:172.21.15.40:6800/973366008,v1:172.21.15.40:6801/973366008] conn(0x7f516407de30 0x7f5164080250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:53.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.699+0000 7f518ca00640 1 -- 172.21.15.40:0/4116227941 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5164077f70 msgr2=0x7f516407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:53.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.699+0000 7f518ca00640 1 --2- 172.21.15.40:0/4116227941 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5164077f70 0x7f516407a430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5178005fd0 tx=0x7f5178005850 comp rx=0 tx=0).stop 2024-09-11T00:27:53.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.699+0000 7f518ca00640 1 -- 172.21.15.40:0/4116227941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f518815beb0 msgr2=0x7f5188159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:53.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.699+0000 7f518ca00640 1 --2- 172.21.15.40:0/4116227941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f518815beb0 0x7f5188159310 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5170009850 tx=0x7f51700038a0 comp rx=0 tx=0).stop 2024-09-11T00:27:53.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.699+0000 7f5186800640 1 -- 172.21.15.40:0/4116227941 reap_dead start 2024-09-11T00:27:53.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.699+0000 7f518ca00640 1 -- 172.21.15.40:0/4116227941 shutdown_connections 2024-09-11T00:27:53.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.699+0000 7f518ca00640 1 -- 172.21.15.40:0/4116227941 >> 172.21.15.40:0/4116227941 conn(0x7f51880cf950 msgr2=0x7f51880c9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:53.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.699+0000 7f518ca00640 1 -- 172.21.15.40:0/4116227941 shutdown_connections 2024-09-11T00:27:53.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.699+0000 7f518ca00640 1 -- 172.21.15.40:0/4116227941 wait complete. 2024-09-11T00:27:53.716 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-11T00:27:53.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.876+0000 7fdced400640 1 -- 172.21.15.40:0/279735085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdce8161d90 msgr2=0x7fdce8162170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:53.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.876+0000 7fdced400640 1 --2- 172.21.15.40:0/279735085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdce8161d90 0x7fdce8162170 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdce808e0d0 tx=0x7fdcd802a4d0 comp rx=0 tx=0).stop 2024-09-11T00:27:53.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.876+0000 7fdced400640 1 -- 172.21.15.40:0/279735085 shutdown_connections 2024-09-11T00:27:53.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.876+0000 7fdced400640 1 --2- 172.21.15.40:0/279735085 >> v2:172.21.15.175:3300/0 conn(0x7fdce8160f80 0x7fdce81613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:53.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.876+0000 7fdced400640 1 --2- 172.21.15.40:0/279735085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdce806e280 0x7fdce80ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:53.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.876+0000 7fdced400640 1 --2- 172.21.15.40:0/279735085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdce8161d90 0x7fdce8162170 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:53.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.876+0000 7fdced400640 1 -- 172.21.15.40:0/279735085 >> 172.21.15.40:0/279735085 conn(0x7fdce80d3ba0 msgr2=0x7fdce80d3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:53.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.876+0000 7fdced400640 1 -- 172.21.15.40:0/279735085 shutdown_connections 2024-09-11T00:27:53.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.876+0000 7fdced400640 1 -- 172.21.15.40:0/279735085 wait complete. 2024-09-11T00:27:53.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.877+0000 7fdced400640 1 Processor -- start 2024-09-11T00:27:53.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.878+0000 7fdced400640 1 -- start start 2024-09-11T00:27:53.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.878+0000 7fdced400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce806e280 0x7fdce814db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:53.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.879+0000 7fdced400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdce8160f80 0x7fdce80a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:53.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.879+0000 7fdced400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdce8161d90 0x7fdce80cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:53.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.879+0000 7fdced400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdce80b33b0 con 0x7fdce8161d90 2024-09-11T00:27:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.879+0000 7fdced400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdce80b3230 con 0x7fdce806e280 2024-09-11T00:27:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.879+0000 7fdced400640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdce806d330 con 0x7fdce8160f80 2024-09-11T00:27:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.879+0000 7fdceca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdce8161d90 0x7fdce80cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.879+0000 7fdceca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdce8161d90 0x7fdce80cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35660/0 (socket says 172.21.15.40:35660) 2024-09-11T00:27:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.879+0000 7fdceca00640 1 -- 172.21.15.40:0/1672615212 learned_addr learned my addr 172.21.15.40:0/1672615212 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.879+0000 7fdce7e00640 1 --2- 172.21.15.40:0/1672615212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce806e280 0x7fdce814db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.879+0000 7fdcdfe00640 1 --2- 172.21.15.40:0/1672615212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdce8160f80 0x7fdce80a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.879+0000 7fdceca00640 1 -- 172.21.15.40:0/1672615212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdce8160f80 msgr2=0x7fdce80a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.879+0000 7fdceca00640 1 --2- 172.21.15.40:0/1672615212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdce8160f80 0x7fdce80a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.879+0000 7fdceca00640 1 -- 172.21.15.40:0/1672615212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce806e280 msgr2=0x7fdce814db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.879+0000 7fdceca00640 1 --2- 172.21.15.40:0/1672615212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce806e280 0x7fdce814db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.879+0000 7fdceca00640 1 -- 172.21.15.40:0/1672615212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce8150900 con 0x7fdce8161d90 2024-09-11T00:27:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.880+0000 7fdceca00640 1 --2- 172.21.15.40:0/1672615212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdce8161d90 0x7fdce80cd490 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdce000eb40 tx=0x7fdce000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.880+0000 7fdce4c00640 1 -- 172.21.15.40:0/1672615212 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce0004b20 con 0x7fdce8161d90 2024-09-11T00:27:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.880+0000 7fdce4c00640 1 -- 172.21.15.40:0/1672615212 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdce0004ce0 con 0x7fdce8161d90 2024-09-11T00:27:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.880+0000 7fdced400640 1 -- 172.21.15.40:0/1672615212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce80b4720 con 0x7fdce8161d90 2024-09-11T00:27:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.880+0000 7fdce4c00640 1 -- 172.21.15.40:0/1672615212 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce0005280 con 0x7fdce8161d90 2024-09-11T00:27:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.880+0000 7fdced400640 1 -- 172.21.15.40:0/1672615212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce80b4ce0 con 0x7fdce8161d90 2024-09-11T00:27:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.881+0000 7fdced400640 1 -- 172.21.15.40:0/1672615212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce806c610 con 0x7fdce8161d90 2024-09-11T00:27:53.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.882+0000 7fdce4c00640 1 -- 172.21.15.40:0/1672615212 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdce0005420 con 0x7fdce8161d90 2024-09-11T00:27:53.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.883+0000 7fdce4c00640 1 --2- 172.21.15.40:0/1672615212 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdcc4077f70 0x7fdcc407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:53.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.883+0000 7fdce4c00640 1 -- 172.21.15.40:0/1672615212 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fdce009a6f0 con 0x7fdce8161d90 2024-09-11T00:27:53.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.884+0000 7fdce7e00640 1 --2- 172.21.15.40:0/1672615212 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdcc4077f70 0x7fdcc407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:53.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.885+0000 7fdce7e00640 1 --2- 172.21.15.40:0/1672615212 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdcc4077f70 0x7fdcc407a430 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8033000 tx=0x7fdcd8004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:53.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:53.887+0000 7fdce4c00640 1 -- 172.21.15.40:0/1672615212 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fdce806c610 con 0x7fdce8161d90 2024-09-11T00:27:54.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.079+0000 7fdced400640 1 -- 172.21.15.40:0/1672615212 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fdce814d860 con 0x7fdcc4077f70 2024-09-11T00:27:54.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.080+0000 7fdce4c00640 1 -- 172.21.15.40:0/1672615212 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdce814d860 con 0x7fdcc4077f70 2024-09-11T00:27:54.082 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 0 to deep-scrub 2024-09-11T00:27:54.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.082+0000 7fdced400640 1 -- 172.21.15.40:0/1672615212 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdcc4077f70 msgr2=0x7fdcc407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:54.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.082+0000 7fdced400640 1 --2- 172.21.15.40:0/1672615212 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdcc4077f70 0x7fdcc407a430 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8033000 tx=0x7fdcd8004730 comp rx=0 tx=0).stop 2024-09-11T00:27:54.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.082+0000 7fdced400640 1 -- 172.21.15.40:0/1672615212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdce8161d90 msgr2=0x7fdce80cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:54.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.082+0000 7fdced400640 1 --2- 172.21.15.40:0/1672615212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdce8161d90 0x7fdce80cd490 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdce000eb40 tx=0x7fdce000c2d0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.082+0000 7fdced400640 1 -- 172.21.15.40:0/1672615212 shutdown_connections 2024-09-11T00:27:54.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.082+0000 7fdced400640 1 --2- 172.21.15.40:0/1672615212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdce8161d90 0x7fdce80cd490 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.082+0000 7fdced400640 1 --2- 172.21.15.40:0/1672615212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdce8160f80 0x7fdce80a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.082+0000 7fdced400640 1 --2- 172.21.15.40:0/1672615212 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdcc4077f70 0x7fdcc407a430 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.082+0000 7fdced400640 1 --2- 172.21.15.40:0/1672615212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce806e280 0x7fdce814db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.082+0000 7fdced400640 1 -- 172.21.15.40:0/1672615212 >> 172.21.15.40:0/1672615212 conn(0x7fdce80d3ba0 msgr2=0x7fdce80b8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:54.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.083+0000 7fdced400640 1 -- 172.21.15.40:0/1672615212 shutdown_connections 2024-09-11T00:27:54.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.083+0000 7fdced400640 1 -- 172.21.15.40:0/1672615212 wait complete. 2024-09-11T00:27:54.101 INFO:tasks.ceph:Scrubbing osd.1 2024-09-11T00:27:54.101 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-11T00:27:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.263+0000 7fbc66e00640 1 -- 172.21.15.40:0/2317643878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6015beb0 msgr2=0x7fbc600d0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.263+0000 7fbc66e00640 1 --2- 172.21.15.40:0/2317643878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6015beb0 0x7fbc600d0470 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbc600730f0 tx=0x7fbc5002a680 comp rx=0 tx=0).stop 2024-09-11T00:27:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.263+0000 7fbc66e00640 1 -- 172.21.15.40:0/2317643878 shutdown_connections 2024-09-11T00:27:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.264+0000 7fbc66e00640 1 --2- 172.21.15.40:0/2317643878 >> v2:172.21.15.175:3300/0 conn(0x7fbc600cb350 0x7fbc6006f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.264+0000 7fbc66e00640 1 --2- 172.21.15.40:0/2317643878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6015beb0 0x7fbc600d0470 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.264+0000 7fbc66e00640 1 -- 172.21.15.40:0/2317643878 >> 172.21.15.40:0/2317643878 conn(0x7fbc600cf950 msgr2=0x7fbc600cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.264+0000 7fbc66e00640 1 -- 172.21.15.40:0/2317643878 shutdown_connections 2024-09-11T00:27:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.264+0000 7fbc66e00640 1 -- 172.21.15.40:0/2317643878 wait complete. 2024-09-11T00:27:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.265+0000 7fbc66e00640 1 Processor -- start 2024-09-11T00:27:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.265+0000 7fbc66e00640 1 -- start start 2024-09-11T00:27:54.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.266+0000 7fbc66e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc600cb350 0x7fbc6015db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:54.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.266+0000 7fbc66e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc6015beb0 0x7fbc601f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:54.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.266+0000 7fbc66e00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc600aaac0 0x7fbc600aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:54.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.266+0000 7fbc66e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbc60073c20 con 0x7fbc600cb350 2024-09-11T00:27:54.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.266+0000 7fbc66e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbc600b3120 con 0x7fbc6015beb0 2024-09-11T00:27:54.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.266+0000 7fbc66e00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbc60073da0 con 0x7fbc600aaac0 2024-09-11T00:27:54.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.266+0000 7fbc5fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc600cb350 0x7fbc6015db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:54.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.266+0000 7fbc5fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc600cb350 0x7fbc6015db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35676/0 (socket says 172.21.15.40:35676) 2024-09-11T00:27:54.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.266+0000 7fbc5fe00640 1 -- 172.21.15.40:0/4037911425 learned_addr learned my addr 172.21.15.40:0/4037911425 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:54.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.267+0000 7fbc57400640 1 --2- 172.21.15.40:0/4037911425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc6015beb0 0x7fbc601f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:54.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.267+0000 7fbc64e00640 1 --2- 172.21.15.40:0/4037911425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc600aaac0 0x7fbc600aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:54.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.267+0000 7fbc5fe00640 1 -- 172.21.15.40:0/4037911425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc600aaac0 msgr2=0x7fbc600aaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:54.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.267+0000 7fbc5fe00640 1 --2- 172.21.15.40:0/4037911425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc600aaac0 0x7fbc600aaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.267+0000 7fbc5fe00640 1 -- 172.21.15.40:0/4037911425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc6015beb0 msgr2=0x7fbc601f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:54.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.267+0000 7fbc5fe00640 1 --2- 172.21.15.40:0/4037911425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc6015beb0 0x7fbc601f4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.267+0000 7fbc5fe00640 1 -- 172.21.15.40:0/4037911425 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc600a97b0 con 0x7fbc600cb350 2024-09-11T00:27:54.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.267+0000 7fbc57400640 1 --2- 172.21.15.40:0/4037911425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc6015beb0 0x7fbc601f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:27:54.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.267+0000 7fbc5fe00640 1 --2- 172.21.15.40:0/4037911425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc600cb350 0x7fbc6015db50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbc50034040 tx=0x7fbc50003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:54.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.267+0000 7fbc5cc00640 1 -- 172.21.15.40:0/4037911425 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5003e030 con 0x7fbc600cb350 2024-09-11T00:27:54.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.268+0000 7fbc5cc00640 1 -- 172.21.15.40:0/4037911425 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc50003e00 con 0x7fbc600cb350 2024-09-11T00:27:54.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.268+0000 7fbc5cc00640 1 -- 172.21.15.40:0/4037911425 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc50035040 con 0x7fbc600cb350 2024-09-11T00:27:54.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.268+0000 7fbc66e00640 1 -- 172.21.15.40:0/4037911425 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc600a9a90 con 0x7fbc600cb350 2024-09-11T00:27:54.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.268+0000 7fbc66e00640 1 -- 172.21.15.40:0/4037911425 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc600aa050 con 0x7fbc600cb350 2024-09-11T00:27:54.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.268+0000 7fbc66e00640 1 -- 172.21.15.40:0/4037911425 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbc600734e0 con 0x7fbc600cb350 2024-09-11T00:27:54.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.270+0000 7fbc5cc00640 1 -- 172.21.15.40:0/4037911425 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbc500049c0 con 0x7fbc600cb350 2024-09-11T00:27:54.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.271+0000 7fbc5cc00640 1 --2- 172.21.15.40:0/4037911425 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbc3c077fa0 0x7fbc3c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:54.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.271+0000 7fbc5cc00640 1 -- 172.21.15.40:0/4037911425 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fbc500ba460 con 0x7fbc600cb350 2024-09-11T00:27:54.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.271+0000 7fbc5cc00640 1 --2- 172.21.15.40:0/4037911425 >> [v2:172.21.15.40:6821/2542266029,v1:172.21.15.40:6823/2542266029] conn(0x7fbc3c07de60 0x7fbc3c080280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:54.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.271+0000 7fbc5cc00640 1 -- 172.21.15.40:0/4037911425 --> [v2:172.21.15.40:6821/2542266029,v1:172.21.15.40:6823/2542266029] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc5003be50 con 0x7fbc3c07de60 2024-09-11T00:27:54.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.271+0000 7fbc5cc00640 1 -- 172.21.15.40:0/4037911425 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fbc500c1050 con 0x7fbc600cb350 2024-09-11T00:27:54.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.271+0000 7fbc57400640 1 --2- 172.21.15.40:0/4037911425 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbc3c077fa0 0x7fbc3c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:54.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.271+0000 7fbc64e00640 1 --2- 172.21.15.40:0/4037911425 >> [v2:172.21.15.40:6821/2542266029,v1:172.21.15.40:6823/2542266029] conn(0x7fbc3c07de60 0x7fbc3c080280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:54.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.272+0000 7fbc57400640 1 --2- 172.21.15.40:0/4037911425 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbc3c077fa0 0x7fbc3c07a460 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbc480058c0 tx=0x7fbc48005850 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:54.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.272+0000 7fbc64e00640 1 --2- 172.21.15.40:0/4037911425 >> [v2:172.21.15.40:6821/2542266029,v1:172.21.15.40:6823/2542266029] conn(0x7fbc3c07de60 0x7fbc3c080280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:54.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.273+0000 7fbc5cc00640 1 -- 172.21.15.40:0/4037911425 <== osd.1 v2:172.21.15.40:6821/2542266029 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbc5003be50 con 0x7fbc3c07de60 2024-09-11T00:27:54.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.286+0000 7fbc66e00640 1 -- 172.21.15.40:0/4037911425 --> [v2:172.21.15.40:6821/2542266029,v1:172.21.15.40:6823/2542266029] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbc6006f500 con 0x7fbc3c07de60 2024-09-11T00:27:54.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.286+0000 7fbc5cc00640 1 -- 172.21.15.40:0/4037911425 <== osd.1 v2:172.21.15.40:6821/2542266029 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbc6006f500 con 0x7fbc3c07de60 2024-09-11T00:27:54.288 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T00:27:54.288 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T00:27:54.288 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T00:27:54.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.287+0000 7fbc66e00640 1 -- 172.21.15.40:0/4037911425 >> [v2:172.21.15.40:6821/2542266029,v1:172.21.15.40:6823/2542266029] conn(0x7fbc3c07de60 msgr2=0x7fbc3c080280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:54.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.287+0000 7fbc66e00640 1 --2- 172.21.15.40:0/4037911425 >> [v2:172.21.15.40:6821/2542266029,v1:172.21.15.40:6823/2542266029] conn(0x7fbc3c07de60 0x7fbc3c080280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.287+0000 7fbc66e00640 1 -- 172.21.15.40:0/4037911425 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbc3c077fa0 msgr2=0x7fbc3c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:54.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.287+0000 7fbc66e00640 1 --2- 172.21.15.40:0/4037911425 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fbc3c077fa0 0x7fbc3c07a460 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbc480058c0 tx=0x7fbc48005850 comp rx=0 tx=0).stop 2024-09-11T00:27:54.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.287+0000 7fbc66e00640 1 -- 172.21.15.40:0/4037911425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc600cb350 msgr2=0x7fbc6015db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:54.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.287+0000 7fbc66e00640 1 --2- 172.21.15.40:0/4037911425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc600cb350 0x7fbc6015db50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbc50034040 tx=0x7fbc50003910 comp rx=0 tx=0).stop 2024-09-11T00:27:54.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.287+0000 7fbc64e00640 1 -- 172.21.15.40:0/4037911425 reap_dead start 2024-09-11T00:27:54.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.287+0000 7fbc66e00640 1 -- 172.21.15.40:0/4037911425 shutdown_connections 2024-09-11T00:27:54.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.287+0000 7fbc66e00640 1 -- 172.21.15.40:0/4037911425 >> 172.21.15.40:0/4037911425 conn(0x7fbc600cf950 msgr2=0x7fbc600cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:54.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.287+0000 7fbc66e00640 1 -- 172.21.15.40:0/4037911425 shutdown_connections 2024-09-11T00:27:54.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.287+0000 7fbc66e00640 1 -- 172.21.15.40:0/4037911425 wait complete. 2024-09-11T00:27:54.304 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-11T00:27:54.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.465+0000 7fdfab000640 1 -- 172.21.15.40:0/553950943 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfa415dd10 msgr2=0x7fdfa40d4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:54.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.465+0000 7fdfab000640 1 --2- 172.21.15.40:0/553950943 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfa415dd10 0x7fdfa40d4740 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdfa40d2020 tx=0x7fdf9802aa00 comp rx=0 tx=0).stop 2024-09-11T00:27:54.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.465+0000 7fdfab000640 1 -- 172.21.15.40:0/553950943 shutdown_connections 2024-09-11T00:27:54.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.465+0000 7fdfab000640 1 --2- 172.21.15.40:0/553950943 >> v2:172.21.15.175:3300/0 conn(0x7fdfa40b2d20 0x7fdfa40d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.465+0000 7fdfab000640 1 --2- 172.21.15.40:0/553950943 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfa415dd10 0x7fdfa40d4740 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.465+0000 7fdfab000640 1 -- 172.21.15.40:0/553950943 >> 172.21.15.40:0/553950943 conn(0x7fdfa40d3c20 msgr2=0x7fdfa40d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:54.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.465+0000 7fdfab000640 1 -- 172.21.15.40:0/553950943 shutdown_connections 2024-09-11T00:27:54.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.465+0000 7fdfab000640 1 -- 172.21.15.40:0/553950943 wait complete. 2024-09-11T00:27:54.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.467+0000 7fdfab000640 1 Processor -- start 2024-09-11T00:27:54.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.467+0000 7fdfab000640 1 -- start start 2024-09-11T00:27:54.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.468+0000 7fdfab000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa40b2d20 0x7fdfa4154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:54.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.468+0000 7fdfab000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfa40d0810 0x7fdfa40ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:54.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.468+0000 7fdfab000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfa415dd10 0x7fdfa40cd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:54.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.468+0000 7fdfab000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa40cee40 con 0x7fdfa415dd10 2024-09-11T00:27:54.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.468+0000 7fdfab000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa406e1e0 con 0x7fdfa40b2d20 2024-09-11T00:27:54.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.468+0000 7fdfab000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa40cefc0 con 0x7fdfa40d0810 2024-09-11T00:27:54.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.468+0000 7fdfaa600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfa415dd10 0x7fdfa40cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:54.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.468+0000 7fdfaa600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfa415dd10 0x7fdfa40cd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35686/0 (socket says 172.21.15.40:35686) 2024-09-11T00:27:54.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.468+0000 7fdfaa600640 1 -- 172.21.15.40:0/788926646 learned_addr learned my addr 172.21.15.40:0/788926646 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:54.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.469+0000 7fdfa9200640 1 --2- 172.21.15.40:0/788926646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfa40d0810 0x7fdfa40ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:54.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.469+0000 7fdfa9c00640 1 --2- 172.21.15.40:0/788926646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa40b2d20 0x7fdfa4154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:54.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.469+0000 7fdfaa600640 1 -- 172.21.15.40:0/788926646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfa40d0810 msgr2=0x7fdfa40ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:54.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.469+0000 7fdfaa600640 1 --2- 172.21.15.40:0/788926646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfa40d0810 0x7fdfa40ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.469+0000 7fdfaa600640 1 -- 172.21.15.40:0/788926646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa40b2d20 msgr2=0x7fdfa4154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:54.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.469+0000 7fdfaa600640 1 --2- 172.21.15.40:0/788926646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa40b2d20 0x7fdfa4154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.469+0000 7fdfaa600640 1 -- 172.21.15.40:0/788926646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa40c8440 con 0x7fdfa415dd10 2024-09-11T00:27:54.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.469+0000 7fdfaa600640 1 --2- 172.21.15.40:0/788926646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfa415dd10 0x7fdfa40cd400 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00c390 tx=0x7fdf9c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:54.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.469+0000 7fdfa1600640 1 -- 172.21.15.40:0/788926646 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c0052d0 con 0x7fdfa415dd10 2024-09-11T00:27:54.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.469+0000 7fdfa1600640 1 -- 172.21.15.40:0/788926646 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf9c007020 con 0x7fdfa415dd10 2024-09-11T00:27:54.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.469+0000 7fdfa1600640 1 -- 172.21.15.40:0/788926646 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c007470 con 0x7fdfa415dd10 2024-09-11T00:27:54.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.469+0000 7fdfab000640 1 -- 172.21.15.40:0/788926646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa40c8720 con 0x7fdfa415dd10 2024-09-11T00:27:54.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.470+0000 7fdfab000640 1 -- 172.21.15.40:0/788926646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa41550b0 con 0x7fdfa415dd10 2024-09-11T00:27:54.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.471+0000 7fdfab000640 1 -- 172.21.15.40:0/788926646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa40b7420 con 0x7fdfa415dd10 2024-09-11T00:27:54.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.472+0000 7fdfa1600640 1 -- 172.21.15.40:0/788926646 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdf9c0067d0 con 0x7fdfa415dd10 2024-09-11T00:27:54.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.472+0000 7fdfa1600640 1 --2- 172.21.15.40:0/788926646 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdf84077f70 0x7fdf8407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:54.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.473+0000 7fdfa1600640 1 -- 172.21.15.40:0/788926646 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fdf9c098e20 con 0x7fdfa415dd10 2024-09-11T00:27:54.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.473+0000 7fdfa9c00640 1 --2- 172.21.15.40:0/788926646 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdf84077f70 0x7fdf8407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:54.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.474+0000 7fdfa9c00640 1 --2- 172.21.15.40:0/788926646 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdf84077f70 0x7fdf8407a430 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdf98035000 tx=0x7fdf9803b040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:54.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.477+0000 7fdfa1600640 1 -- 172.21.15.40:0/788926646 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fdfa40b7420 con 0x7fdfa415dd10 2024-09-11T00:27:54.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.670+0000 7fdfab000640 1 -- 172.21.15.40:0/788926646 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fdfa40cf4e0 con 0x7fdf84077f70 2024-09-11T00:27:54.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.671+0000 7fdfa1600640 1 -- 172.21.15.40:0/788926646 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdfa40cf4e0 con 0x7fdf84077f70 2024-09-11T00:27:54.672 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 1 to deep-scrub 2024-09-11T00:27:54.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.673+0000 7fdfab000640 1 -- 172.21.15.40:0/788926646 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdf84077f70 msgr2=0x7fdf8407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:54.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.673+0000 7fdfab000640 1 --2- 172.21.15.40:0/788926646 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdf84077f70 0x7fdf8407a430 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdf98035000 tx=0x7fdf9803b040 comp rx=0 tx=0).stop 2024-09-11T00:27:54.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.673+0000 7fdfab000640 1 -- 172.21.15.40:0/788926646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfa415dd10 msgr2=0x7fdfa40cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:54.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.673+0000 7fdfab000640 1 --2- 172.21.15.40:0/788926646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfa415dd10 0x7fdfa40cd400 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00c390 tx=0x7fdf9c00c850 comp rx=0 tx=0).stop 2024-09-11T00:27:54.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.673+0000 7fdfab000640 1 -- 172.21.15.40:0/788926646 shutdown_connections 2024-09-11T00:27:54.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.673+0000 7fdfab000640 1 --2- 172.21.15.40:0/788926646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfa415dd10 0x7fdfa40cd400 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.673+0000 7fdfab000640 1 --2- 172.21.15.40:0/788926646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfa40d0810 0x7fdfa40ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.673+0000 7fdfab000640 1 --2- 172.21.15.40:0/788926646 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdf84077f70 0x7fdf8407a430 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.673+0000 7fdfab000640 1 --2- 172.21.15.40:0/788926646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa40b2d20 0x7fdfa4154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.673+0000 7fdfab000640 1 -- 172.21.15.40:0/788926646 >> 172.21.15.40:0/788926646 conn(0x7fdfa40d3c20 msgr2=0x7fdfa415ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:54.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.674+0000 7fdfab000640 1 -- 172.21.15.40:0/788926646 shutdown_connections 2024-09-11T00:27:54.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.674+0000 7fdfab000640 1 -- 172.21.15.40:0/788926646 wait complete. 2024-09-11T00:27:54.691 INFO:tasks.ceph:Scrubbing osd.2 2024-09-11T00:27:54.691 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-11T00:27:54.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.855+0000 7fd383200640 1 -- 172.21.15.40:0/692724965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd38406e0f0 msgr2=0x7fd368004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:54.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.855+0000 7fd383200640 1 --2- 172.21.15.40:0/692724965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd38406e0f0 0x7fd368004800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009b20 tx=0x7fd368005830 comp rx=0 tx=0).stop 2024-09-11T00:27:54.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.855+0000 7fd382800640 1 -- 172.21.15.40:0/692724965 reap_dead start 2024-09-11T00:27:54.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.855+0000 7fd383200640 1 -- 172.21.15.40:0/692724965 shutdown_connections 2024-09-11T00:27:54.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.855+0000 7fd383200640 1 -- 172.21.15.40:0/692724965 >> 172.21.15.40:0/692724965 conn(0x7fd3840b4df0 msgr2=0x7fd3840b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:54.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.855+0000 7fd383200640 1 -- 172.21.15.40:0/692724965 shutdown_connections 2024-09-11T00:27:54.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.855+0000 7fd383200640 1 -- 172.21.15.40:0/692724965 wait complete. 2024-09-11T00:27:54.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.857+0000 7fd383200640 1 Processor -- start 2024-09-11T00:27:54.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.857+0000 7fd383200640 1 -- start start 2024-09-11T00:27:54.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.858+0000 7fd383200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd38406e0f0 0x7fd3841548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:54.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.858+0000 7fd383200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd38414a1d0 0x7fd384149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:54.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.858+0000 7fd383200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3840b1860 0x7fd3840b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:54.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.858+0000 7fd383200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd3840b27b0 con 0x7fd3840b1860 2024-09-11T00:27:54.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.858+0000 7fd383200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd3840b2630 con 0x7fd38414a1d0 2024-09-11T00:27:54.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.858+0000 7fd383200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd3840b2930 con 0x7fd38406e0f0 2024-09-11T00:27:54.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.858+0000 7fd382800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3840b1860 0x7fd3840b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:54.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.858+0000 7fd382800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3840b1860 0x7fd3840b1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35698/0 (socket says 172.21.15.40:35698) 2024-09-11T00:27:54.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.858+0000 7fd382800640 1 -- 172.21.15.40:0/1750875411 learned_addr learned my addr 172.21.15.40:0/1750875411 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:54.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.859+0000 7fd381e00640 1 --2- 172.21.15.40:0/1750875411 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd38406e0f0 0x7fd3841548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:54.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.859+0000 7fd379400640 1 --2- 172.21.15.40:0/1750875411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd38414a1d0 0x7fd384149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:54.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.859+0000 7fd382800640 1 -- 172.21.15.40:0/1750875411 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd38406e0f0 msgr2=0x7fd3841548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:54.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.859+0000 7fd382800640 1 --2- 172.21.15.40:0/1750875411 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd38406e0f0 0x7fd3841548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.859+0000 7fd382800640 1 -- 172.21.15.40:0/1750875411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd38414a1d0 msgr2=0x7fd384149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:54.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.859+0000 7fd382800640 1 --2- 172.21.15.40:0/1750875411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd38414a1d0 0x7fd384149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.859+0000 7fd382800640 1 -- 172.21.15.40:0/1750875411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38414e410 con 0x7fd3840b1860 2024-09-11T00:27:54.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.859+0000 7fd382800640 1 --2- 172.21.15.40:0/1750875411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3840b1860 0x7fd3840b1d10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd38415bf60 tx=0x7fd37c006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:54.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.859+0000 7fd37aa00640 1 -- 172.21.15.40:0/1750875411 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c011900 con 0x7fd3840b1860 2024-09-11T00:27:54.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.859+0000 7fd37aa00640 1 -- 172.21.15.40:0/1750875411 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd37c018070 con 0x7fd3840b1860 2024-09-11T00:27:54.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.859+0000 7fd37aa00640 1 -- 172.21.15.40:0/1750875411 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c011d60 con 0x7fd3840b1860 2024-09-11T00:27:54.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.860+0000 7fd383200640 1 -- 172.21.15.40:0/1750875411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38414e6f0 con 0x7fd3840b1860 2024-09-11T00:27:54.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.860+0000 7fd383200640 1 -- 172.21.15.40:0/1750875411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd38414ecb0 con 0x7fd3840b1860 2024-09-11T00:27:54.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.860+0000 7fd383200640 1 -- 172.21.15.40:0/1750875411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd38415b510 con 0x7fd3840b1860 2024-09-11T00:27:54.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.862+0000 7fd37aa00640 1 -- 172.21.15.40:0/1750875411 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd37c01d460 con 0x7fd3840b1860 2024-09-11T00:27:54.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.863+0000 7fd37aa00640 1 --2- 172.21.15.40:0/1750875411 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fd360077fd0 0x7fd36007a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:54.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.863+0000 7fd37aa00640 1 -- 172.21.15.40:0/1750875411 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fd37c09a3f0 con 0x7fd3840b1860 2024-09-11T00:27:54.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.863+0000 7fd37aa00640 1 --2- 172.21.15.40:0/1750875411 >> [v2:172.21.15.40:6815/559505356,v1:172.21.15.40:6817/559505356] conn(0x7fd36007de90 0x7fd3600802b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:54.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.863+0000 7fd37aa00640 1 -- 172.21.15.40:0/1750875411 --> [v2:172.21.15.40:6815/559505356,v1:172.21.15.40:6817/559505356] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd360080960 con 0x7fd36007de90 2024-09-11T00:27:54.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.863+0000 7fd37aa00640 1 -- 172.21.15.40:0/1750875411 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fd37c0a1050 con 0x7fd3840b1860 2024-09-11T00:27:54.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.863+0000 7fd381e00640 1 --2- 172.21.15.40:0/1750875411 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fd360077fd0 0x7fd36007a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:54.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.863+0000 7fd379400640 1 --2- 172.21.15.40:0/1750875411 >> [v2:172.21.15.40:6815/559505356,v1:172.21.15.40:6817/559505356] conn(0x7fd36007de90 0x7fd3600802b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:54.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.864+0000 7fd379400640 1 --2- 172.21.15.40:0/1750875411 >> [v2:172.21.15.40:6815/559505356,v1:172.21.15.40:6817/559505356] conn(0x7fd36007de90 0x7fd3600802b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:54.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.864+0000 7fd381e00640 1 --2- 172.21.15.40:0/1750875411 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fd360077fd0 0x7fd36007a490 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd374006bb0 tx=0x7fd374006720 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:54.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.865+0000 7fd37aa00640 1 -- 172.21.15.40:0/1750875411 <== osd.2 v2:172.21.15.40:6815/559505356 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd360080960 con 0x7fd36007de90 2024-09-11T00:27:54.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.878+0000 7fd383200640 1 -- 172.21.15.40:0/1750875411 --> [v2:172.21.15.40:6815/559505356,v1:172.21.15.40:6817/559505356] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd384158be0 con 0x7fd36007de90 2024-09-11T00:27:54.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.879+0000 7fd37aa00640 1 -- 172.21.15.40:0/1750875411 <== osd.2 v2:172.21.15.40:6815/559505356 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd384158be0 con 0x7fd36007de90 2024-09-11T00:27:54.880 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T00:27:54.880 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T00:27:54.881 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T00:27:54.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.879+0000 7fd383200640 1 -- 172.21.15.40:0/1750875411 >> [v2:172.21.15.40:6815/559505356,v1:172.21.15.40:6817/559505356] conn(0x7fd36007de90 msgr2=0x7fd3600802b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:54.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.879+0000 7fd383200640 1 --2- 172.21.15.40:0/1750875411 >> [v2:172.21.15.40:6815/559505356,v1:172.21.15.40:6817/559505356] conn(0x7fd36007de90 0x7fd3600802b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:54.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.879+0000 7fd383200640 1 -- 172.21.15.40:0/1750875411 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fd360077fd0 msgr2=0x7fd36007a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:54.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.879+0000 7fd383200640 1 --2- 172.21.15.40:0/1750875411 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fd360077fd0 0x7fd36007a490 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd374006bb0 tx=0x7fd374006720 comp rx=0 tx=0).stop 2024-09-11T00:27:54.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.879+0000 7fd383200640 1 -- 172.21.15.40:0/1750875411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3840b1860 msgr2=0x7fd3840b1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:54.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.879+0000 7fd383200640 1 --2- 172.21.15.40:0/1750875411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3840b1860 0x7fd3840b1d10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd38415bf60 tx=0x7fd37c006430 comp rx=0 tx=0).stop 2024-09-11T00:27:54.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.879+0000 7fd382800640 1 -- 172.21.15.40:0/1750875411 reap_dead start 2024-09-11T00:27:54.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.879+0000 7fd383200640 1 -- 172.21.15.40:0/1750875411 shutdown_connections 2024-09-11T00:27:54.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.879+0000 7fd383200640 1 -- 172.21.15.40:0/1750875411 >> 172.21.15.40:0/1750875411 conn(0x7fd3840b4df0 msgr2=0x7fd384074620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:54.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.879+0000 7fd383200640 1 -- 172.21.15.40:0/1750875411 shutdown_connections 2024-09-11T00:27:54.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:54.880+0000 7fd383200640 1 -- 172.21.15.40:0/1750875411 wait complete. 2024-09-11T00:27:54.896 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-11T00:27:55.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.056+0000 7fdf77800640 1 -- 172.21.15.40:0/2591290511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf7006e910 msgr2=0x7fdf7006eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:55.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.056+0000 7fdf77800640 1 --2- 172.21.15.40:0/2591290511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf7006e910 0x7fdf7006eda0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdf68005fd0 tx=0x7fdf6802a8b0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.056+0000 7fdf77800640 1 -- 172.21.15.40:0/2591290511 shutdown_connections 2024-09-11T00:27:55.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.056+0000 7fdf77800640 1 --2- 172.21.15.40:0/2591290511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf7006e910 0x7fdf7006eda0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.056+0000 7fdf77800640 1 --2- 172.21.15.40:0/2591290511 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf700cc180 0x7fdf700cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.056+0000 7fdf77800640 1 -- 172.21.15.40:0/2591290511 >> 172.21.15.40:0/2591290511 conn(0x7fdf700cfbb0 msgr2=0x7fdf700cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:55.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.056+0000 7fdf77800640 1 -- 172.21.15.40:0/2591290511 shutdown_connections 2024-09-11T00:27:55.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.056+0000 7fdf77800640 1 -- 172.21.15.40:0/2591290511 wait complete. 2024-09-11T00:27:55.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.058+0000 7fdf77800640 1 Processor -- start 2024-09-11T00:27:55.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.058+0000 7fdf77800640 1 -- start start 2024-09-11T00:27:55.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.059+0000 7fdf77800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf7006e910 0x7fdf700ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:55.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.059+0000 7fdf77800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf700cc180 0x7fdf7015ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:55.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.059+0000 7fdf77800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf7015bcc0 0x7fdf701f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:55.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.059+0000 7fdf77800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7006f2e0 con 0x7fdf700cc180 2024-09-11T00:27:55.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.059+0000 7fdf77800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7015f9d0 con 0x7fdf7006e910 2024-09-11T00:27:55.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.059+0000 7fdf77800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdf7006f460 con 0x7fdf7015bcc0 2024-09-11T00:27:55.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.059+0000 7fdf6fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf700cc180 0x7fdf7015ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:55.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.059+0000 7fdf6fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf700cc180 0x7fdf7015ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35724/0 (socket says 172.21.15.40:35724) 2024-09-11T00:27:55.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.059+0000 7fdf6fe00640 1 -- 172.21.15.40:0/425784440 learned_addr learned my addr 172.21.15.40:0/425784440 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:55.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.059+0000 7fdf74e00640 1 --2- 172.21.15.40:0/425784440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf7006e910 0x7fdf700ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:55.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.059+0000 7fdf75800640 1 --2- 172.21.15.40:0/425784440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf7015bcc0 0x7fdf701f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:55.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.059+0000 7fdf6fe00640 1 -- 172.21.15.40:0/425784440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf7015bcc0 msgr2=0x7fdf701f44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:55.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.059+0000 7fdf6fe00640 1 --2- 172.21.15.40:0/425784440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf7015bcc0 0x7fdf701f44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.059+0000 7fdf6fe00640 1 -- 172.21.15.40:0/425784440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf7006e910 msgr2=0x7fdf700ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:55.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.059+0000 7fdf6fe00640 1 --2- 172.21.15.40:0/425784440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf7006e910 0x7fdf700ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.059+0000 7fdf6fe00640 1 -- 172.21.15.40:0/425784440 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7015f140 con 0x7fdf700cc180 2024-09-11T00:27:55.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.060+0000 7fdf6fe00640 1 --2- 172.21.15.40:0/425784440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf700cc180 0x7fdf7015ec00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c00e9f0 tx=0x7fdf5c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.060+0000 7fdf6cc00640 1 -- 172.21.15.40:0/425784440 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c00cd80 con 0x7fdf700cc180 2024-09-11T00:27:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.060+0000 7fdf6cc00640 1 -- 172.21.15.40:0/425784440 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf5c010430 con 0x7fdf700cc180 2024-09-11T00:27:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.060+0000 7fdf6cc00640 1 -- 172.21.15.40:0/425784440 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c010840 con 0x7fdf700cc180 2024-09-11T00:27:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.060+0000 7fdf77800640 1 -- 172.21.15.40:0/425784440 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf701f8050 con 0x7fdf700cc180 2024-09-11T00:27:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.060+0000 7fdf77800640 1 -- 172.21.15.40:0/425784440 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf701f8610 con 0x7fdf700cc180 2024-09-11T00:27:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.061+0000 7fdf77800640 1 -- 172.21.15.40:0/425784440 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf7006f920 con 0x7fdf700cc180 2024-09-11T00:27:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.062+0000 7fdf6cc00640 1 -- 172.21.15.40:0/425784440 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdf5c0109e0 con 0x7fdf700cc180 2024-09-11T00:27:55.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.064+0000 7fdf6cc00640 1 --2- 172.21.15.40:0/425784440 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdf50077f70 0x7fdf5007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:55.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.064+0000 7fdf6cc00640 1 -- 172.21.15.40:0/425784440 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fdf5c09a5c0 con 0x7fdf700cc180 2024-09-11T00:27:55.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.064+0000 7fdf74e00640 1 --2- 172.21.15.40:0/425784440 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdf50077f70 0x7fdf5007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:55.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.065+0000 7fdf74e00640 1 --2- 172.21.15.40:0/425784440 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdf50077f70 0x7fdf5007a430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdf64007fd0 tx=0x7fdf64001390 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:55.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.068+0000 7fdf6cc00640 1 -- 172.21.15.40:0/425784440 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fdf5c062d90 con 0x7fdf700cc180 2024-09-11T00:27:55.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.263+0000 7fdf77800640 1 -- 172.21.15.40:0/425784440 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fdf7014b890 con 0x7fdf50077f70 2024-09-11T00:27:55.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.264+0000 7fdf6cc00640 1 -- 172.21.15.40:0/425784440 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdf6400f680 con 0x7fdf50077f70 2024-09-11T00:27:55.266 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 2 to deep-scrub 2024-09-11T00:27:55.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.266+0000 7fdf77800640 1 -- 172.21.15.40:0/425784440 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdf50077f70 msgr2=0x7fdf5007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:55.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.266+0000 7fdf77800640 1 --2- 172.21.15.40:0/425784440 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdf50077f70 0x7fdf5007a430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdf64007fd0 tx=0x7fdf64001390 comp rx=0 tx=0).stop 2024-09-11T00:27:55.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.266+0000 7fdf77800640 1 -- 172.21.15.40:0/425784440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf700cc180 msgr2=0x7fdf7015ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:55.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.266+0000 7fdf77800640 1 --2- 172.21.15.40:0/425784440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf700cc180 0x7fdf7015ec00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c00e9f0 tx=0x7fdf5c00eeb0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.266+0000 7fdf77800640 1 -- 172.21.15.40:0/425784440 shutdown_connections 2024-09-11T00:27:55.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.266+0000 7fdf77800640 1 --2- 172.21.15.40:0/425784440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdf7015bcc0 0x7fdf701f44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.266+0000 7fdf77800640 1 --2- 172.21.15.40:0/425784440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf700cc180 0x7fdf7015ec00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.266+0000 7fdf77800640 1 --2- 172.21.15.40:0/425784440 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fdf50077f70 0x7fdf5007a430 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.266+0000 7fdf77800640 1 --2- 172.21.15.40:0/425784440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf7006e910 0x7fdf700ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.266+0000 7fdf77800640 1 -- 172.21.15.40:0/425784440 >> 172.21.15.40:0/425784440 conn(0x7fdf700cfbb0 msgr2=0x7fdf700cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:55.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.266+0000 7fdf77800640 1 -- 172.21.15.40:0/425784440 shutdown_connections 2024-09-11T00:27:55.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.267+0000 7fdf77800640 1 -- 172.21.15.40:0/425784440 wait complete. 2024-09-11T00:27:55.284 INFO:tasks.ceph:Scrubbing osd.3 2024-09-11T00:27:55.284 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-11T00:27:55.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.448+0000 7f2f23600640 1 -- 172.21.15.40:0/1127833873 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f1c074780 msgr2=0x7f2f1c0ca860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:55.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.448+0000 7f2f23600640 1 --2- 172.21.15.40:0/1127833873 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f1c074780 0x7f2f1c0ca860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009be0 tx=0x7f2f1402a920 comp rx=0 tx=0).stop 2024-09-11T00:27:55.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.448+0000 7f2f23600640 1 -- 172.21.15.40:0/1127833873 shutdown_connections 2024-09-11T00:27:55.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.448+0000 7f2f23600640 1 --2- 172.21.15.40:0/1127833873 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f1c074780 0x7f2f1c0ca860 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.448+0000 7f2f23600640 1 -- 172.21.15.40:0/1127833873 >> 172.21.15.40:0/1127833873 conn(0x7f2f1c0d0210 msgr2=0x7f2f1c0d0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:55.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.448+0000 7f2f23600640 1 -- 172.21.15.40:0/1127833873 shutdown_connections 2024-09-11T00:27:55.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.448+0000 7f2f23600640 1 -- 172.21.15.40:0/1127833873 wait complete. 2024-09-11T00:27:55.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.450+0000 7f2f23600640 1 Processor -- start 2024-09-11T00:27:55.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.450+0000 7f2f23600640 1 -- start start 2024-09-11T00:27:55.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.451+0000 7f2f23600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f1c074780 0x7f2f1c0c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:55.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.451+0000 7f2f23600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f1c0af800 0x7f2f1c0cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:55.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.451+0000 7f2f23600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f1c15f220 0x7f2f1c150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:55.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.451+0000 7f2f23600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c0cada0 con 0x7f2f1c0af800 2024-09-11T00:27:55.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.451+0000 7f2f23600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c06d430 con 0x7f2f1c074780 2024-09-11T00:27:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.451+0000 7f2f23600640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2f1c0caf20 con 0x7f2f1c15f220 2024-09-11T00:27:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.451+0000 7f2f1be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f1c0af800 0x7f2f1c0cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.451+0000 7f2f1be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f1c0af800 0x7f2f1c0cf740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35732/0 (socket says 172.21.15.40:35732) 2024-09-11T00:27:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.451+0000 7f2f1be00640 1 -- 172.21.15.40:0/4189940978 learned_addr learned my addr 172.21.15.40:0/4189940978 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.451+0000 7f2f20c00640 1 --2- 172.21.15.40:0/4189940978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f1c074780 0x7f2f1c0c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.451+0000 7f2f21600640 1 --2- 172.21.15.40:0/4189940978 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f1c15f220 0x7f2f1c150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.451+0000 7f2f1be00640 1 -- 172.21.15.40:0/4189940978 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f1c15f220 msgr2=0x7f2f1c150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.451+0000 7f2f1be00640 1 --2- 172.21.15.40:0/4189940978 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f1c15f220 0x7f2f1c150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.451+0000 7f2f1be00640 1 -- 172.21.15.40:0/4189940978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f1c074780 msgr2=0x7f2f1c0c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.451+0000 7f2f1be00640 1 --2- 172.21.15.40:0/4189940978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f1c074780 0x7f2f1c0c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.451+0000 7f2f1be00640 1 -- 172.21.15.40:0/4189940978 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1c0cfc80 con 0x7f2f1c0af800 2024-09-11T00:27:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.451+0000 7f2f20c00640 1 --2- 172.21.15.40:0/4189940978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f1c074780 0x7f2f1c0c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:27:55.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.452+0000 7f2f1be00640 1 --2- 172.21.15.40:0/4189940978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f1c0af800 0x7f2f1c0cf740 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800c4d0 tx=0x7f2f0800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:55.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.452+0000 7f2f18c00640 1 -- 172.21.15.40:0/4189940978 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08016020 con 0x7f2f1c0af800 2024-09-11T00:27:55.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.452+0000 7f2f18c00640 1 -- 172.21.15.40:0/4189940978 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f08012920 con 0x7f2f1c0af800 2024-09-11T00:27:55.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.452+0000 7f2f23600640 1 -- 172.21.15.40:0/4189940978 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f1c0c7970 con 0x7f2f1c0af800 2024-09-11T00:27:55.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.452+0000 7f2f18c00640 1 -- 172.21.15.40:0/4189940978 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08012d70 con 0x7f2f1c0af800 2024-09-11T00:27:55.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.452+0000 7f2f23600640 1 -- 172.21.15.40:0/4189940978 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f1c0c5a40 con 0x7f2f1c0af800 2024-09-11T00:27:55.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.453+0000 7f2f23600640 1 -- 172.21.15.40:0/4189940978 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2f1c06f430 con 0x7f2f1c0af800 2024-09-11T00:27:55.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.455+0000 7f2f18c00640 1 -- 172.21.15.40:0/4189940978 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2f0801b400 con 0x7f2f1c0af800 2024-09-11T00:27:55.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.455+0000 7f2f18c00640 1 --2- 172.21.15.40:0/4189940978 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2efc077f70 0x7f2efc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:55.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.456+0000 7f2f18c00640 1 -- 172.21.15.40:0/4189940978 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f2f08099d80 con 0x7f2f1c0af800 2024-09-11T00:27:55.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.456+0000 7f2f18c00640 1 --2- 172.21.15.40:0/4189940978 >> [v2:172.21.15.40:6808/503633839,v1:172.21.15.40:6809/503633839] conn(0x7f2efc07de30 0x7f2efc080250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:55.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.456+0000 7f2f18c00640 1 -- 172.21.15.40:0/4189940978 --> [v2:172.21.15.40:6808/503633839,v1:172.21.15.40:6809/503633839] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f0800ee50 con 0x7f2efc07de30 2024-09-11T00:27:55.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.456+0000 7f2f18c00640 1 -- 172.21.15.40:0/4189940978 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f2f0809c480 con 0x7f2f1c0af800 2024-09-11T00:27:55.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.456+0000 7f2f20c00640 1 --2- 172.21.15.40:0/4189940978 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2efc077f70 0x7f2efc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:55.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.456+0000 7f2f21600640 1 --2- 172.21.15.40:0/4189940978 >> [v2:172.21.15.40:6808/503633839,v1:172.21.15.40:6809/503633839] conn(0x7f2efc07de30 0x7f2efc080250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:55.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.457+0000 7f2f21600640 1 --2- 172.21.15.40:0/4189940978 >> [v2:172.21.15.40:6808/503633839,v1:172.21.15.40:6809/503633839] conn(0x7f2efc07de30 0x7f2efc080250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:55.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.457+0000 7f2f20c00640 1 --2- 172.21.15.40:0/4189940978 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2efc077f70 0x7f2efc07a430 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2f10007fd0 tx=0x7f2f10009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:55.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.457+0000 7f2f18c00640 1 -- 172.21.15.40:0/4189940978 <== osd.3 v2:172.21.15.40:6808/503633839 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2f0800ee50 con 0x7f2efc07de30 2024-09-11T00:27:55.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.471+0000 7f2f23600640 1 -- 172.21.15.40:0/4189940978 --> [v2:172.21.15.40:6808/503633839,v1:172.21.15.40:6809/503633839] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2f1c0c6770 con 0x7f2efc07de30 2024-09-11T00:27:55.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.471+0000 7f2f18c00640 1 -- 172.21.15.40:0/4189940978 <== osd.3 v2:172.21.15.40:6808/503633839 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2f1c0c6770 con 0x7f2efc07de30 2024-09-11T00:27:55.473 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T00:27:55.473 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T00:27:55.473 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T00:27:55.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.471+0000 7f2f23600640 1 -- 172.21.15.40:0/4189940978 >> [v2:172.21.15.40:6808/503633839,v1:172.21.15.40:6809/503633839] conn(0x7f2efc07de30 msgr2=0x7f2efc080250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:55.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.471+0000 7f2f23600640 1 --2- 172.21.15.40:0/4189940978 >> [v2:172.21.15.40:6808/503633839,v1:172.21.15.40:6809/503633839] conn(0x7f2efc07de30 0x7f2efc080250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.472+0000 7f2f23600640 1 -- 172.21.15.40:0/4189940978 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2efc077f70 msgr2=0x7f2efc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:55.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.472+0000 7f2f23600640 1 --2- 172.21.15.40:0/4189940978 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f2efc077f70 0x7f2efc07a430 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2f10007fd0 tx=0x7f2f10009040 comp rx=0 tx=0).stop 2024-09-11T00:27:55.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.472+0000 7f2f23600640 1 -- 172.21.15.40:0/4189940978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f1c0af800 msgr2=0x7f2f1c0cf740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:55.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.472+0000 7f2f23600640 1 --2- 172.21.15.40:0/4189940978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f1c0af800 0x7f2f1c0cf740 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800c4d0 tx=0x7f2f0800c990 comp rx=0 tx=0).stop 2024-09-11T00:27:55.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.472+0000 7f2f21600640 1 -- 172.21.15.40:0/4189940978 reap_dead start 2024-09-11T00:27:55.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.472+0000 7f2f23600640 1 -- 172.21.15.40:0/4189940978 shutdown_connections 2024-09-11T00:27:55.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.472+0000 7f2f23600640 1 -- 172.21.15.40:0/4189940978 >> 172.21.15.40:0/4189940978 conn(0x7f2f1c0d0210 msgr2=0x7f2f1c06ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:55.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.472+0000 7f2f23600640 1 -- 172.21.15.40:0/4189940978 shutdown_connections 2024-09-11T00:27:55.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.472+0000 7f2f23600640 1 -- 172.21.15.40:0/4189940978 wait complete. 2024-09-11T00:27:55.488 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-11T00:27:55.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.648+0000 7f4c45400640 1 -- 172.21.15.40:0/4159446592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c4015bcc0 msgr2=0x7f4c400cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:55.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.648+0000 7f4c45400640 1 --2- 172.21.15.40:0/4159446592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c4015bcc0 0x7f4c400cb420 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4c30005fd0 tx=0x7f4c3002a580 comp rx=0 tx=0).stop 2024-09-11T00:27:55.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.648+0000 7f4c45400640 1 -- 172.21.15.40:0/4159446592 shutdown_connections 2024-09-11T00:27:55.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.648+0000 7f4c45400640 1 --2- 172.21.15.40:0/4159446592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c400ca200 0x7f4c400ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.648+0000 7f4c45400640 1 --2- 172.21.15.40:0/4159446592 >> v2:172.21.15.175:3300/0 conn(0x7f4c400cba70 0x7f4c400cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.648+0000 7f4c45400640 1 --2- 172.21.15.40:0/4159446592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c4015bcc0 0x7f4c400cb420 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.648+0000 7f4c45400640 1 -- 172.21.15.40:0/4159446592 >> 172.21.15.40:0/4159446592 conn(0x7f4c400cfbb0 msgr2=0x7f4c400cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:55.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.648+0000 7f4c45400640 1 -- 172.21.15.40:0/4159446592 shutdown_connections 2024-09-11T00:27:55.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.648+0000 7f4c45400640 1 -- 172.21.15.40:0/4159446592 wait complete. 2024-09-11T00:27:55.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.650+0000 7f4c45400640 1 Processor -- start 2024-09-11T00:27:55.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.650+0000 7f4c45400640 1 -- start start 2024-09-11T00:27:55.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.651+0000 7f4c45400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c400ca200 0x7f4c40147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:55.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.651+0000 7f4c45400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c400cba70 0x7f4c4015df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:55.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.651+0000 7f4c45400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c4015bcc0 0x7f4c4015e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:55.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.651+0000 7f4c45400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4015f940 con 0x7f4c400cba70 2024-09-11T00:27:55.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.651+0000 7f4c45400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4015f7c0 con 0x7f4c4015bcc0 2024-09-11T00:27:55.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.651+0000 7f4c45400640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4c400cabd0 con 0x7f4c400ca200 2024-09-11T00:27:55.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.651+0000 7f4c3de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c400cba70 0x7f4c4015df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:55.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.651+0000 7f4c3de00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c400cba70 0x7f4c4015df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35744/0 (socket says 172.21.15.40:35744) 2024-09-11T00:27:55.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.651+0000 7f4c3e800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c400ca200 0x7f4c40147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:55.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.651+0000 7f4c3de00640 1 -- 172.21.15.40:0/550508174 learned_addr learned my addr 172.21.15.40:0/550508174 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:55.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.651+0000 7f4c3f200640 1 --2- 172.21.15.40:0/550508174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c4015bcc0 0x7f4c4015e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:55.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.651+0000 7f4c3de00640 1 -- 172.21.15.40:0/550508174 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c400ca200 msgr2=0x7f4c40147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:55.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.651+0000 7f4c3de00640 1 --2- 172.21.15.40:0/550508174 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c400ca200 0x7f4c40147b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.651+0000 7f4c3de00640 1 -- 172.21.15.40:0/550508174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c4015bcc0 msgr2=0x7f4c4015e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:55.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.652+0000 7f4c3de00640 1 --2- 172.21.15.40:0/550508174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c4015bcc0 0x7f4c4015e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.652+0000 7f4c3de00640 1 -- 172.21.15.40:0/550508174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c400b4360 con 0x7f4c400cba70 2024-09-11T00:27:55.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.652+0000 7f4c3e800640 1 --2- 172.21.15.40:0/550508174 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c400ca200 0x7f4c40147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:27:55.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.652+0000 7f4c3de00640 1 --2- 172.21.15.40:0/550508174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c400cba70 0x7f4c4015df20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00b4a0 tx=0x7f4c2c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:55.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.652+0000 7f4c36a00640 1 -- 172.21.15.40:0/550508174 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c014070 con 0x7f4c400cba70 2024-09-11T00:27:55.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.652+0000 7f4c36a00640 1 -- 172.21.15.40:0/550508174 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c2c010700 con 0x7f4c400cba70 2024-09-11T00:27:55.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.652+0000 7f4c45400640 1 -- 172.21.15.40:0/550508174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c400b4640 con 0x7f4c400cba70 2024-09-11T00:27:55.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.652+0000 7f4c36a00640 1 -- 172.21.15.40:0/550508174 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c010b50 con 0x7f4c400cba70 2024-09-11T00:27:55.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.652+0000 7f4c45400640 1 -- 172.21.15.40:0/550508174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c4015c650 con 0x7f4c400cba70 2024-09-11T00:27:55.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.653+0000 7f4c45400640 1 -- 172.21.15.40:0/550508174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c400cbec0 con 0x7f4c400cba70 2024-09-11T00:27:55.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.654+0000 7f4c36a00640 1 -- 172.21.15.40:0/550508174 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4c2c017360 con 0x7f4c400cba70 2024-09-11T00:27:55.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.655+0000 7f4c36a00640 1 --2- 172.21.15.40:0/550508174 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4c20077f70 0x7f4c2007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:55.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.655+0000 7f4c36a00640 1 -- 172.21.15.40:0/550508174 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f4c2c099770 con 0x7f4c400cba70 2024-09-11T00:27:55.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.656+0000 7f4c3e800640 1 --2- 172.21.15.40:0/550508174 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4c20077f70 0x7f4c2007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.657+0000 7f4c3e800640 1 --2- 172.21.15.40:0/550508174 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4c20077f70 0x7f4c2007a430 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4c30033000 tx=0x7f4c30004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:55.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.659+0000 7f4c36a00640 1 -- 172.21.15.40:0/550508174 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4c2c061f10 con 0x7f4c400cba70 2024-09-11T00:27:55.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.854+0000 7f4c45400640 1 -- 172.21.15.40:0/550508174 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f4c4015c820 con 0x7f4c20077f70 2024-09-11T00:27:55.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.854+0000 7f4c36a00640 1 -- 172.21.15.40:0/550508174 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4c4015c820 con 0x7f4c20077f70 2024-09-11T00:27:55.856 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 3 to deep-scrub 2024-09-11T00:27:55.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.857+0000 7f4c45400640 1 -- 172.21.15.40:0/550508174 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4c20077f70 msgr2=0x7f4c2007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:55.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.857+0000 7f4c45400640 1 --2- 172.21.15.40:0/550508174 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4c20077f70 0x7f4c2007a430 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4c30033000 tx=0x7f4c30004730 comp rx=0 tx=0).stop 2024-09-11T00:27:55.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.857+0000 7f4c45400640 1 -- 172.21.15.40:0/550508174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c400cba70 msgr2=0x7f4c4015df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:55.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.857+0000 7f4c45400640 1 --2- 172.21.15.40:0/550508174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c400cba70 0x7f4c4015df20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00b4a0 tx=0x7f4c2c00b960 comp rx=0 tx=0).stop 2024-09-11T00:27:55.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.857+0000 7f4c45400640 1 -- 172.21.15.40:0/550508174 shutdown_connections 2024-09-11T00:27:55.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.857+0000 7f4c45400640 1 --2- 172.21.15.40:0/550508174 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4c20077f70 0x7f4c2007a430 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.857+0000 7f4c45400640 1 --2- 172.21.15.40:0/550508174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c4015bcc0 0x7f4c4015e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.857+0000 7f4c45400640 1 --2- 172.21.15.40:0/550508174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c400cba70 0x7f4c4015df20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.857+0000 7f4c45400640 1 --2- 172.21.15.40:0/550508174 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c400ca200 0x7f4c40147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:55.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.857+0000 7f4c45400640 1 -- 172.21.15.40:0/550508174 >> 172.21.15.40:0/550508174 conn(0x7f4c400cfbb0 msgr2=0x7f4c4006e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:55.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.857+0000 7f4c45400640 1 -- 172.21.15.40:0/550508174 shutdown_connections 2024-09-11T00:27:55.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:55.857+0000 7f4c45400640 1 -- 172.21.15.40:0/550508174 wait complete. 2024-09-11T00:27:55.874 INFO:tasks.ceph:Scrubbing osd.4 2024-09-11T00:27:55.874 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-11T00:27:56.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.036+0000 7fc03a400640 1 -- 172.21.15.40:0/3281866704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0340723d0 msgr2=0x7fc0340ad870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.036+0000 7fc03a400640 1 --2- 172.21.15.40:0/3281866704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0340723d0 0x7fc0340ad870 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc034069570 tx=0x7fc02c02a8f0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.036+0000 7fc03a400640 1 -- 172.21.15.40:0/3281866704 shutdown_connections 2024-09-11T00:27:56.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.036+0000 7fc03a400640 1 --2- 172.21.15.40:0/3281866704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0340723d0 0x7fc0340ad870 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.036+0000 7fc03a400640 1 --2- 172.21.15.40:0/3281866704 >> v2:172.21.15.175:3300/0 conn(0x7fc0340aee80 0x7fc0340cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.036+0000 7fc03a400640 1 --2- 172.21.15.40:0/3281866704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0341614e0 0x7fc0340cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.036+0000 7fc03a400640 1 -- 172.21.15.40:0/3281866704 >> 172.21.15.40:0/3281866704 conn(0x7fc0340cf950 msgr2=0x7fc0340cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.036+0000 7fc03a400640 1 -- 172.21.15.40:0/3281866704 shutdown_connections 2024-09-11T00:27:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.036+0000 7fc03a400640 1 -- 172.21.15.40:0/3281866704 wait complete. 2024-09-11T00:27:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.038+0000 7fc03a400640 1 Processor -- start 2024-09-11T00:27:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.038+0000 7fc03a400640 1 -- start start 2024-09-11T00:27:56.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.039+0000 7fc03a400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0340723d0 0x7fc0341f86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:56.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.039+0000 7fc03a400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0340aee80 0x7fc034154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:56.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.039+0000 7fc03a400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0341614e0 0x7fc0340afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:56.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.039+0000 7fc03a400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc0340ae140 con 0x7fc0341614e0 2024-09-11T00:27:56.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.039+0000 7fc03a400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc0340adfc0 con 0x7fc0340723d0 2024-09-11T00:27:56.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.039+0000 7fc03a400640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc0340ae2c0 con 0x7fc0340aee80 2024-09-11T00:27:56.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.039+0000 7fc033e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0341614e0 0x7fc0340afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:56.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.039+0000 7fc033e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0341614e0 0x7fc0340afbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35776/0 (socket says 172.21.15.40:35776) 2024-09-11T00:27:56.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.039+0000 7fc033e00640 1 -- 172.21.15.40:0/3975231249 learned_addr learned my addr 172.21.15.40:0/3975231249 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:56.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.039+0000 7fc02be00640 1 --2- 172.21.15.40:0/3975231249 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0340aee80 0x7fc034154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:56.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.040+0000 7fc033400640 1 --2- 172.21.15.40:0/3975231249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0340723d0 0x7fc0341f86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:56.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.040+0000 7fc033e00640 1 -- 172.21.15.40:0/3975231249 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0340aee80 msgr2=0x7fc034154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.040+0000 7fc033e00640 1 --2- 172.21.15.40:0/3975231249 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0340aee80 0x7fc034154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.040+0000 7fc033e00640 1 -- 172.21.15.40:0/3975231249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0340723d0 msgr2=0x7fc0341f86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.040+0000 7fc033e00640 1 --2- 172.21.15.40:0/3975231249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0340723d0 0x7fc0341f86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.040+0000 7fc033e00640 1 -- 172.21.15.40:0/3975231249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0341f4c90 con 0x7fc0341614e0 2024-09-11T00:27:56.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.040+0000 7fc033e00640 1 --2- 172.21.15.40:0/3975231249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0341614e0 0x7fc0340afbc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc02c009d60 tx=0x7fc02c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:56.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.040+0000 7fc02b400640 1 -- 172.21.15.40:0/3975231249 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c004240 con 0x7fc0341614e0 2024-09-11T00:27:56.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.040+0000 7fc02b400640 1 -- 172.21.15.40:0/3975231249 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc02c02d070 con 0x7fc0341614e0 2024-09-11T00:27:56.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.040+0000 7fc02b400640 1 -- 172.21.15.40:0/3975231249 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c0046a0 con 0x7fc0341614e0 2024-09-11T00:27:56.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.040+0000 7fc03a400640 1 -- 172.21.15.40:0/3975231249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0341f4f70 con 0x7fc0341614e0 2024-09-11T00:27:56.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.040+0000 7fc03a400640 1 -- 172.21.15.40:0/3975231249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc034155510 con 0x7fc0341614e0 2024-09-11T00:27:56.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.041+0000 7fc03a400640 1 -- 172.21.15.40:0/3975231249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc03406c560 con 0x7fc0341614e0 2024-09-11T00:27:56.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.043+0000 7fc02b400640 1 -- 172.21.15.40:0/3975231249 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc02c031480 con 0x7fc0341614e0 2024-09-11T00:27:56.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.043+0000 7fc02b400640 1 --2- 172.21.15.40:0/3975231249 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc010077f70 0x7fc01007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:56.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.044+0000 7fc02b400640 1 -- 172.21.15.40:0/3975231249 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fc02c0bb290 con 0x7fc0341614e0 2024-09-11T00:27:56.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.044+0000 7fc02b400640 1 --2- 172.21.15.40:0/3975231249 >> [v2:172.21.15.175:6810/2418348042,v1:172.21.15.175:6811/2418348042] conn(0x7fc01007de30 0x7fc010080250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:56.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.044+0000 7fc02b400640 1 -- 172.21.15.40:0/3975231249 --> [v2:172.21.15.175:6810/2418348042,v1:172.21.15.175:6811/2418348042] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc02c03be90 con 0x7fc01007de30 2024-09-11T00:27:56.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.044+0000 7fc02b400640 1 -- 172.21.15.40:0/3975231249 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc02c0c2050 con 0x7fc0341614e0 2024-09-11T00:27:56.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.044+0000 7fc033400640 1 --2- 172.21.15.40:0/3975231249 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc010077f70 0x7fc01007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:56.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.044+0000 7fc02be00640 1 --2- 172.21.15.40:0/3975231249 >> [v2:172.21.15.175:6810/2418348042,v1:172.21.15.175:6811/2418348042] conn(0x7fc01007de30 0x7fc010080250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:56.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.045+0000 7fc033400640 1 --2- 172.21.15.40:0/3975231249 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc010077f70 0x7fc01007a430 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc024005fd0 tx=0x7fc024005850 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:56.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.045+0000 7fc02be00640 1 --2- 172.21.15.40:0/3975231249 >> [v2:172.21.15.175:6810/2418348042,v1:172.21.15.175:6811/2418348042] conn(0x7fc01007de30 0x7fc010080250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:56.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.046+0000 7fc02b400640 1 -- 172.21.15.40:0/3975231249 <== osd.4 v2:172.21.15.175:6810/2418348042 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc02c03be90 con 0x7fc01007de30 2024-09-11T00:27:56.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.059+0000 7fc03a400640 1 -- 172.21.15.40:0/3975231249 --> [v2:172.21.15.175:6810/2418348042,v1:172.21.15.175:6811/2418348042] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc0340ad870 con 0x7fc01007de30 2024-09-11T00:27:56.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.060+0000 7fc02b400640 1 -- 172.21.15.40:0/3975231249 <== osd.4 v2:172.21.15.175:6810/2418348042 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc0340ad870 con 0x7fc01007de30 2024-09-11T00:27:56.061 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T00:27:56.062 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T00:27:56.062 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T00:27:56.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.060+0000 7fc03a400640 1 -- 172.21.15.40:0/3975231249 >> [v2:172.21.15.175:6810/2418348042,v1:172.21.15.175:6811/2418348042] conn(0x7fc01007de30 msgr2=0x7fc010080250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.060+0000 7fc03a400640 1 --2- 172.21.15.40:0/3975231249 >> [v2:172.21.15.175:6810/2418348042,v1:172.21.15.175:6811/2418348042] conn(0x7fc01007de30 0x7fc010080250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.060+0000 7fc03a400640 1 -- 172.21.15.40:0/3975231249 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc010077f70 msgr2=0x7fc01007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.060+0000 7fc03a400640 1 --2- 172.21.15.40:0/3975231249 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc010077f70 0x7fc01007a430 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc024005fd0 tx=0x7fc024005850 comp rx=0 tx=0).stop 2024-09-11T00:27:56.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.060+0000 7fc03a400640 1 -- 172.21.15.40:0/3975231249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0341614e0 msgr2=0x7fc0340afbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.060+0000 7fc03a400640 1 --2- 172.21.15.40:0/3975231249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0341614e0 0x7fc0340afbc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc02c009d60 tx=0x7fc02c003c20 comp rx=0 tx=0).stop 2024-09-11T00:27:56.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.060+0000 7fc033e00640 1 -- 172.21.15.40:0/3975231249 reap_dead start 2024-09-11T00:27:56.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.061+0000 7fc03a400640 1 -- 172.21.15.40:0/3975231249 shutdown_connections 2024-09-11T00:27:56.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.061+0000 7fc03a400640 1 -- 172.21.15.40:0/3975231249 >> 172.21.15.40:0/3975231249 conn(0x7fc0340cf950 msgr2=0x7fc03406f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:56.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.061+0000 7fc03a400640 1 -- 172.21.15.40:0/3975231249 shutdown_connections 2024-09-11T00:27:56.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.061+0000 7fc03a400640 1 -- 172.21.15.40:0/3975231249 wait complete. 2024-09-11T00:27:56.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-11T00:27:56.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.234+0000 7f4136a00640 1 -- 172.21.15.40:0/1686806211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41300ae640 msgr2=0x7f413006edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.234+0000 7f4136a00640 1 --2- 172.21.15.40:0/1686806211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41300ae640 0x7f413006edd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f411c005fd0 tx=0x7f411c02a540 comp rx=0 tx=0).stop 2024-09-11T00:27:56.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.235+0000 7f4136a00640 1 -- 172.21.15.40:0/1686806211 shutdown_connections 2024-09-11T00:27:56.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.235+0000 7f4136a00640 1 --2- 172.21.15.40:0/1686806211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41300ae640 0x7f413006edd0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.235+0000 7f4136a00640 1 --2- 172.21.15.40:0/1686806211 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f413015baa0 0x7f413006e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.235+0000 7f4136a00640 1 -- 172.21.15.40:0/1686806211 >> 172.21.15.40:0/1686806211 conn(0x7f41300cf770 msgr2=0x7f41300cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:56.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.235+0000 7f4136a00640 1 -- 172.21.15.40:0/1686806211 shutdown_connections 2024-09-11T00:27:56.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.235+0000 7f4136a00640 1 -- 172.21.15.40:0/1686806211 wait complete. 2024-09-11T00:27:56.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.236+0000 7f4136a00640 1 Processor -- start 2024-09-11T00:27:56.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.236+0000 7f4136a00640 1 -- start start 2024-09-11T00:27:56.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.237+0000 7f4136a00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4130073830 0x7f4130150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:56.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.237+0000 7f4136a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41300ae640 0x7f41300ad870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:56.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.237+0000 7f4136a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413015baa0 0x7f41300addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:56.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.237+0000 7f4136a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f413015be80 con 0x7f413015baa0 2024-09-11T00:27:56.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.237+0000 7f4136a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f41300b5760 con 0x7f41300ae640 2024-09-11T00:27:56.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.237+0000 7f4136a00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f413015c000 con 0x7f4130073830 2024-09-11T00:27:56.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.238+0000 7f4135600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4130073830 0x7f4130150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:56.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.238+0000 7f4136000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413015baa0 0x7f41300addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:56.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.238+0000 7f4135600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4130073830 0x7f4130150cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.40:37848/0 (socket says 172.21.15.40:37848) 2024-09-11T00:27:56.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.238+0000 7f4134c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41300ae640 0x7f41300ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:56.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.238+0000 7f4135600640 1 -- 172.21.15.40:0/593612241 learned_addr learned my addr 172.21.15.40:0/593612241 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:56.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.238+0000 7f4136000640 1 -- 172.21.15.40:0/593612241 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4130073830 msgr2=0x7f4130150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.238+0000 7f4136000640 1 --2- 172.21.15.40:0/593612241 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4130073830 0x7f4130150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.238+0000 7f4136000640 1 -- 172.21.15.40:0/593612241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41300ae640 msgr2=0x7f41300ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.238+0000 7f4136000640 1 --2- 172.21.15.40:0/593612241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41300ae640 0x7f41300ad870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.238+0000 7f4136000640 1 -- 172.21.15.40:0/593612241 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41300c3340 con 0x7f413015baa0 2024-09-11T00:27:56.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.238+0000 7f4136000640 1 --2- 172.21.15.40:0/593612241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413015baa0 0x7f41300addb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f412800c680 tx=0x7f412800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:56.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.239+0000 7f412d600640 1 -- 172.21.15.40:0/593612241 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4128003b70 con 0x7f413015baa0 2024-09-11T00:27:56.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.239+0000 7f412d600640 1 -- 172.21.15.40:0/593612241 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4128003d10 con 0x7f413015baa0 2024-09-11T00:27:56.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.239+0000 7f412d600640 1 -- 172.21.15.40:0/593612241 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4128005330 con 0x7f413015baa0 2024-09-11T00:27:56.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.239+0000 7f4136a00640 1 -- 172.21.15.40:0/593612241 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41300cb690 con 0x7f413015baa0 2024-09-11T00:27:56.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.239+0000 7f4136a00640 1 -- 172.21.15.40:0/593612241 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41300c38c0 con 0x7f413015baa0 2024-09-11T00:27:56.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.240+0000 7f4136a00640 1 -- 172.21.15.40:0/593612241 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f413015c4b0 con 0x7f413015baa0 2024-09-11T00:27:56.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.241+0000 7f412d600640 1 -- 172.21.15.40:0/593612241 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f41280054d0 con 0x7f413015baa0 2024-09-11T00:27:56.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.242+0000 7f412d600640 1 --2- 172.21.15.40:0/593612241 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4110077fa0 0x7f411007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:56.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.242+0000 7f412d600640 1 -- 172.21.15.40:0/593612241 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f4128099640 con 0x7f413015baa0 2024-09-11T00:27:56.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.242+0000 7f4135600640 1 --2- 172.21.15.40:0/593612241 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4110077fa0 0x7f411007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:56.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.243+0000 7f4135600640 1 --2- 172.21.15.40:0/593612241 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4110077fa0 0x7f411007a460 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4124009bf0 tx=0x7f4124005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:56.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.246+0000 7f412d600640 1 -- 172.21.15.40:0/593612241 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f41280057f0 con 0x7f413015baa0 2024-09-11T00:27:56.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.456+0000 7f4136a00640 1 -- 172.21.15.40:0/593612241 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f41300b5000 con 0x7f4110077fa0 2024-09-11T00:27:56.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.457+0000 7f412d600640 1 -- 172.21.15.40:0/593612241 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f41300b5000 con 0x7f4110077fa0 2024-09-11T00:27:56.458 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 4 to deep-scrub 2024-09-11T00:27:56.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.459+0000 7f4136a00640 1 -- 172.21.15.40:0/593612241 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4110077fa0 msgr2=0x7f411007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.459+0000 7f4136a00640 1 --2- 172.21.15.40:0/593612241 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4110077fa0 0x7f411007a460 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4124009bf0 tx=0x7f4124005f90 comp rx=0 tx=0).stop 2024-09-11T00:27:56.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.459+0000 7f4136a00640 1 -- 172.21.15.40:0/593612241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413015baa0 msgr2=0x7f41300addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.459+0000 7f4136a00640 1 --2- 172.21.15.40:0/593612241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413015baa0 0x7f41300addb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f412800c680 tx=0x7f412800cb40 comp rx=0 tx=0).stop 2024-09-11T00:27:56.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.459+0000 7f4136a00640 1 -- 172.21.15.40:0/593612241 shutdown_connections 2024-09-11T00:27:56.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.459+0000 7f4136a00640 1 --2- 172.21.15.40:0/593612241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413015baa0 0x7f41300addb0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.459+0000 7f4136a00640 1 --2- 172.21.15.40:0/593612241 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4110077fa0 0x7f411007a460 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.459+0000 7f4136a00640 1 --2- 172.21.15.40:0/593612241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41300ae640 0x7f41300ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.459+0000 7f4136a00640 1 --2- 172.21.15.40:0/593612241 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4130073830 0x7f4130150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.459+0000 7f4136a00640 1 -- 172.21.15.40:0/593612241 >> 172.21.15.40:0/593612241 conn(0x7f41300cf770 msgr2=0x7f41300b45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:56.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.459+0000 7f4136a00640 1 -- 172.21.15.40:0/593612241 shutdown_connections 2024-09-11T00:27:56.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.459+0000 7f4136a00640 1 -- 172.21.15.40:0/593612241 wait complete. 2024-09-11T00:27:56.476 INFO:tasks.ceph:Scrubbing osd.5 2024-09-11T00:27:56.477 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-11T00:27:56.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.641+0000 7fa0fbe00640 1 -- 172.21.15.40:0/420908900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0fc0b38f0 msgr2=0x7fa0fc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.641+0000 7fa0fbe00640 1 --2- 172.21.15.40:0/420908900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0fc0b38f0 0x7fa0fc06cff0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0d1ad0 tx=0x7fa0f402aa30 comp rx=0 tx=0).stop 2024-09-11T00:27:56.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.641+0000 7fa0fbe00640 1 -- 172.21.15.40:0/420908900 shutdown_connections 2024-09-11T00:27:56.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.641+0000 7fa0fbe00640 1 --2- 172.21.15.40:0/420908900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0fc0b38f0 0x7fa0fc06cff0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.641+0000 7fa0fbe00640 1 --2- 172.21.15.40:0/420908900 >> v2:172.21.15.175:3300/0 conn(0x7fa0fc0b3f40 0x7fa0fc06cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.641+0000 7fa0fbe00640 1 --2- 172.21.15.40:0/420908900 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0fc0b4da0 0x7fa0fc0afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.641+0000 7fa0fbe00640 1 -- 172.21.15.40:0/420908900 >> 172.21.15.40:0/420908900 conn(0x7fa0fc0b2580 msgr2=0x7fa0fc0b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:56.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.641+0000 7fa0fbe00640 1 -- 172.21.15.40:0/420908900 shutdown_connections 2024-09-11T00:27:56.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.641+0000 7fa0fbe00640 1 -- 172.21.15.40:0/420908900 wait complete. 2024-09-11T00:27:56.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.643+0000 7fa0fbe00640 1 Processor -- start 2024-09-11T00:27:56.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.643+0000 7fa0fbe00640 1 -- start start 2024-09-11T00:27:56.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.644+0000 7fa0fbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0fc0b38f0 0x7fa0fc15a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:56.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.644+0000 7fa0fbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0fc0b3f40 0x7fa0fc14c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:56.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.644+0000 7fa0fbe00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0fc0b4da0 0x7fa0fc0cf260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:56.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.644+0000 7fa0fbe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc161b20 con 0x7fa0fc0b3f40 2024-09-11T00:27:56.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.644+0000 7fa0fbe00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc1619a0 con 0x7fa0fc0b38f0 2024-09-11T00:27:56.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.644+0000 7fa0fbe00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa0fc161ca0 con 0x7fa0fc0b4da0 2024-09-11T00:27:56.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.644+0000 7fa0fa000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0fc0b3f40 0x7fa0fc14c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:56.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.644+0000 7fa0fa000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0fc0b3f40 0x7fa0fc14c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35802/0 (socket says 172.21.15.40:35802) 2024-09-11T00:27:56.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.644+0000 7fa0fa000640 1 -- 172.21.15.40:0/3720388845 learned_addr learned my addr 172.21.15.40:0/3720388845 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:56.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.644+0000 7fa0fb400640 1 --2- 172.21.15.40:0/3720388845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0fc0b4da0 0x7fa0fc0cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:56.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.644+0000 7fa0faa00640 1 --2- 172.21.15.40:0/3720388845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0fc0b38f0 0x7fa0fc15a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:56.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.644+0000 7fa0fa000640 1 -- 172.21.15.40:0/3720388845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0fc0b4da0 msgr2=0x7fa0fc0cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.644+0000 7fa0fa000640 1 --2- 172.21.15.40:0/3720388845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0fc0b4da0 0x7fa0fc0cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.644+0000 7fa0fa000640 1 -- 172.21.15.40:0/3720388845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0fc0b38f0 msgr2=0x7fa0fc15a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.644+0000 7fa0fa000640 1 --2- 172.21.15.40:0/3720388845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0fc0b38f0 0x7fa0fc15a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.644+0000 7fa0fa000640 1 -- 172.21.15.40:0/3720388845 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0fc1492a0 con 0x7fa0fc0b3f40 2024-09-11T00:27:56.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.644+0000 7fa0faa00640 1 --2- 172.21.15.40:0/3720388845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0fc0b38f0 0x7fa0fc15a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:27:56.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.644+0000 7fa0fb400640 1 --2- 172.21.15.40:0/3720388845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0fc0b4da0 0x7fa0fc0cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:27:56.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.645+0000 7fa0fa000640 1 --2- 172.21.15.40:0/3720388845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0fc0b3f40 0x7fa0fc14c6f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800ea20 tx=0x7fa0e800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:56.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.645+0000 7fa0f3400640 1 -- 172.21.15.40:0/3720388845 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e800ccc0 con 0x7fa0fc0b3f40 2024-09-11T00:27:56.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.645+0000 7fa0f3400640 1 -- 172.21.15.40:0/3720388845 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0e800ce60 con 0x7fa0fc0b3f40 2024-09-11T00:27:56.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.645+0000 7fa0f3400640 1 -- 172.21.15.40:0/3720388845 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8004280 con 0x7fa0fc0b3f40 2024-09-11T00:27:56.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.645+0000 7fa0fbe00640 1 -- 172.21.15.40:0/3720388845 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0fc149580 con 0x7fa0fc0b3f40 2024-09-11T00:27:56.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.645+0000 7fa0fbe00640 1 -- 172.21.15.40:0/3720388845 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0fc149b40 con 0x7fa0fc0b3f40 2024-09-11T00:27:56.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.646+0000 7fa0fbe00640 1 -- 172.21.15.40:0/3720388845 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa0fc148f50 con 0x7fa0fc0b3f40 2024-09-11T00:27:56.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.647+0000 7fa0f3400640 1 -- 172.21.15.40:0/3720388845 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa0e80035f0 con 0x7fa0fc0b3f40 2024-09-11T00:27:56.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.648+0000 7fa0f3400640 1 --2- 172.21.15.40:0/3720388845 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa0dc077f70 0x7fa0dc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:56.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.648+0000 7fa0f3400640 1 -- 172.21.15.40:0/3720388845 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fa0e809a450 con 0x7fa0fc0b3f40 2024-09-11T00:27:56.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.649+0000 7fa0f3400640 1 --2- 172.21.15.40:0/3720388845 >> [v2:172.21.15.175:6826/520822300,v1:172.21.15.175:6827/520822300] conn(0x7fa0dc07de30 0x7fa0dc080250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:56.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.649+0000 7fa0f3400640 1 -- 172.21.15.40:0/3720388845 --> [v2:172.21.15.175:6826/520822300,v1:172.21.15.175:6827/520822300] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa0dc080900 con 0x7fa0dc07de30 2024-09-11T00:27:56.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.649+0000 7fa0f3400640 1 -- 172.21.15.40:0/3720388845 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa0e80a1050 con 0x7fa0fc0b3f40 2024-09-11T00:27:56.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.649+0000 7fa0faa00640 1 --2- 172.21.15.40:0/3720388845 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa0dc077f70 0x7fa0dc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:56.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.649+0000 7fa0fb400640 1 --2- 172.21.15.40:0/3720388845 >> [v2:172.21.15.175:6826/520822300,v1:172.21.15.175:6827/520822300] conn(0x7fa0dc07de30 0x7fa0dc080250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:56.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.649+0000 7fa0faa00640 1 --2- 172.21.15.40:0/3720388845 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa0dc077f70 0x7fa0dc07a430 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc051000 tx=0x7fa0ec005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:56.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.650+0000 7fa0fb400640 1 --2- 172.21.15.40:0/3720388845 >> [v2:172.21.15.175:6826/520822300,v1:172.21.15.175:6827/520822300] conn(0x7fa0dc07de30 0x7fa0dc080250 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:56.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.650+0000 7fa0f3400640 1 -- 172.21.15.40:0/3720388845 <== osd.5 v2:172.21.15.175:6826/520822300 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa0dc080900 con 0x7fa0dc07de30 2024-09-11T00:27:56.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.664+0000 7fa0fbe00640 1 -- 172.21.15.40:0/3720388845 --> [v2:172.21.15.175:6826/520822300,v1:172.21.15.175:6827/520822300] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa0fc0afc30 con 0x7fa0dc07de30 2024-09-11T00:27:56.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.664+0000 7fa0f3400640 1 -- 172.21.15.40:0/3720388845 <== osd.5 v2:172.21.15.175:6826/520822300 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa0fc0afc30 con 0x7fa0dc07de30 2024-09-11T00:27:56.666 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T00:27:56.666 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T00:27:56.666 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T00:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.665+0000 7fa0fbe00640 1 -- 172.21.15.40:0/3720388845 >> [v2:172.21.15.175:6826/520822300,v1:172.21.15.175:6827/520822300] conn(0x7fa0dc07de30 msgr2=0x7fa0dc080250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.665+0000 7fa0fbe00640 1 --2- 172.21.15.40:0/3720388845 >> [v2:172.21.15.175:6826/520822300,v1:172.21.15.175:6827/520822300] conn(0x7fa0dc07de30 0x7fa0dc080250 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.665+0000 7fa0fbe00640 1 -- 172.21.15.40:0/3720388845 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa0dc077f70 msgr2=0x7fa0dc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.665+0000 7fa0fbe00640 1 --2- 172.21.15.40:0/3720388845 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fa0dc077f70 0x7fa0dc07a430 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc051000 tx=0x7fa0ec005f90 comp rx=0 tx=0).stop 2024-09-11T00:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.665+0000 7fa0fbe00640 1 -- 172.21.15.40:0/3720388845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0fc0b3f40 msgr2=0x7fa0fc14c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.665+0000 7fa0fbe00640 1 --2- 172.21.15.40:0/3720388845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0fc0b3f40 0x7fa0fc14c6f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800ea20 tx=0x7fa0e800eee0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.665+0000 7fa0fb400640 1 -- 172.21.15.40:0/3720388845 reap_dead start 2024-09-11T00:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.665+0000 7fa0fbe00640 1 -- 172.21.15.40:0/3720388845 shutdown_connections 2024-09-11T00:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.665+0000 7fa0fbe00640 1 -- 172.21.15.40:0/3720388845 >> 172.21.15.40:0/3720388845 conn(0x7fa0fc0b2580 msgr2=0x7fa0fc0b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.665+0000 7fa0fbe00640 1 -- 172.21.15.40:0/3720388845 shutdown_connections 2024-09-11T00:27:56.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.665+0000 7fa0fbe00640 1 -- 172.21.15.40:0/3720388845 wait complete. 2024-09-11T00:27:56.681 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-11T00:27:56.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.840+0000 7f500c400640 1 -- 172.21.15.40:0/949244325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50040cd510 msgr2=0x7f50040cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.840+0000 7f500c400640 1 --2- 172.21.15.40:0/949244325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50040cd510 0x7f50040cedb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5004070b20 tx=0x7f4ff002a680 comp rx=0 tx=0).stop 2024-09-11T00:27:56.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.840+0000 7f500c400640 1 -- 172.21.15.40:0/949244325 shutdown_connections 2024-09-11T00:27:56.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.840+0000 7f500c400640 1 --2- 172.21.15.40:0/949244325 >> v2:172.21.15.175:3300/0 conn(0x7f50040cf2f0 0x7f500415dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.840+0000 7f500c400640 1 --2- 172.21.15.40:0/949244325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50040cd510 0x7f50040cedb0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.840+0000 7f500c400640 1 -- 172.21.15.40:0/949244325 >> 172.21.15.40:0/949244325 conn(0x7f500408bf80 msgr2=0x7f50040d2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:56.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.840+0000 7f500c400640 1 -- 172.21.15.40:0/949244325 shutdown_connections 2024-09-11T00:27:56.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.840+0000 7f500c400640 1 -- 172.21.15.40:0/949244325 wait complete. 2024-09-11T00:27:56.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.842+0000 7f500c400640 1 Processor -- start 2024-09-11T00:27:56.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.842+0000 7f500c400640 1 -- start start 2024-09-11T00:27:56.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.843+0000 7f500c400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50040b1830 0x7f5004152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:56.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.843+0000 7f500c400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50040cd510 0x7f50040c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:56.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.843+0000 7f500c400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50040cf2f0 0x7f50040c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.843+0000 7f500c400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f500415e560 con 0x7f50040cf2f0 2024-09-11T00:27:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.843+0000 7f500c400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f500415e3e0 con 0x7f50040cd510 2024-09-11T00:27:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.843+0000 7f500c400640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f500415e6e0 con 0x7f50040b1830 2024-09-11T00:27:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.843+0000 7f500ae00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50040cf2f0 0x7f50040c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.843+0000 7f500ae00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50040cf2f0 0x7f50040c6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35820/0 (socket says 172.21.15.40:35820) 2024-09-11T00:27:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.843+0000 7f500ae00640 1 -- 172.21.15.40:0/3581832563 learned_addr learned my addr 172.21.15.40:0/3581832563 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.843+0000 7f5009a00640 1 --2- 172.21.15.40:0/3581832563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50040b1830 0x7f5004152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.843+0000 7f5009000640 1 --2- 172.21.15.40:0/3581832563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50040cd510 0x7f50040c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.843+0000 7f500ae00640 1 -- 172.21.15.40:0/3581832563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50040b1830 msgr2=0x7f5004152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.843+0000 7f500ae00640 1 --2- 172.21.15.40:0/3581832563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50040b1830 0x7f5004152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.843+0000 7f500ae00640 1 -- 172.21.15.40:0/3581832563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50040cd510 msgr2=0x7f50040c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.843+0000 7f500ae00640 1 --2- 172.21.15.40:0/3581832563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50040cd510 0x7f50040c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.843+0000 7f500ae00640 1 -- 172.21.15.40:0/3581832563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50040c9630 con 0x7f50040cf2f0 2024-09-11T00:27:56.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.844+0000 7f500ae00640 1 --2- 172.21.15.40:0/3581832563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50040cf2f0 0x7f50040c6460 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00ea80 tx=0x7f4ffc00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:56.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.844+0000 7f5001600640 1 -- 172.21.15.40:0/3581832563 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc004b20 con 0x7f50040cf2f0 2024-09-11T00:27:56.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.844+0000 7f5001600640 1 -- 172.21.15.40:0/3581832563 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ffc004ce0 con 0x7f50040cf2f0 2024-09-11T00:27:56.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.844+0000 7f5001600640 1 -- 172.21.15.40:0/3581832563 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc005280 con 0x7f50040cf2f0 2024-09-11T00:27:56.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.844+0000 7f500c400640 1 -- 172.21.15.40:0/3581832563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50040c98d0 con 0x7f50040cf2f0 2024-09-11T00:27:56.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.844+0000 7f500c400640 1 -- 172.21.15.40:0/3581832563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50040c9e90 con 0x7f50040cf2f0 2024-09-11T00:27:56.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.845+0000 7f500c400640 1 -- 172.21.15.40:0/3581832563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f500415ec00 con 0x7f50040cf2f0 2024-09-11T00:27:56.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.846+0000 7f5001600640 1 -- 172.21.15.40:0/3581832563 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4ffc005420 con 0x7f50040cf2f0 2024-09-11T00:27:56.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.847+0000 7f5001600640 1 --2- 172.21.15.40:0/3581832563 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4fe4077f70 0x7f4fe407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:56.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.847+0000 7f5001600640 1 -- 172.21.15.40:0/3581832563 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f4ffc09a6c0 con 0x7f50040cf2f0 2024-09-11T00:27:56.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.848+0000 7f5009a00640 1 --2- 172.21.15.40:0/3581832563 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4fe4077f70 0x7f4fe407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:56.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.848+0000 7f5009a00640 1 --2- 172.21.15.40:0/3581832563 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4fe4077f70 0x7f4fe407a430 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8001680 tx=0x7f4ff8009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:56.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:56.851+0000 7f5001600640 1 -- 172.21.15.40:0/3581832563 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4ffc0634c0 con 0x7f50040cf2f0 2024-09-11T00:27:57.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.045+0000 7f500c400640 1 -- 172.21.15.40:0/3581832563 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f50040cc7b0 con 0x7f4fe4077f70 2024-09-11T00:27:57.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.046+0000 7f5001600640 1 -- 172.21.15.40:0/3581832563 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f50040cc7b0 con 0x7f4fe4077f70 2024-09-11T00:27:57.047 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 5 to deep-scrub 2024-09-11T00:27:57.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.048+0000 7f500c400640 1 -- 172.21.15.40:0/3581832563 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4fe4077f70 msgr2=0x7f4fe407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:57.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.048+0000 7f500c400640 1 --2- 172.21.15.40:0/3581832563 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4fe4077f70 0x7f4fe407a430 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8001680 tx=0x7f4ff8009040 comp rx=0 tx=0).stop 2024-09-11T00:27:57.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.048+0000 7f500c400640 1 -- 172.21.15.40:0/3581832563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50040cf2f0 msgr2=0x7f50040c6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:57.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.048+0000 7f500c400640 1 --2- 172.21.15.40:0/3581832563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50040cf2f0 0x7f50040c6460 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00ea80 tx=0x7f4ffc00ef40 comp rx=0 tx=0).stop 2024-09-11T00:27:57.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.048+0000 7f500c400640 1 -- 172.21.15.40:0/3581832563 shutdown_connections 2024-09-11T00:27:57.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.048+0000 7f500c400640 1 --2- 172.21.15.40:0/3581832563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50040cf2f0 0x7f50040c6460 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.048+0000 7f500c400640 1 --2- 172.21.15.40:0/3581832563 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f4fe4077f70 0x7f4fe407a430 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.048+0000 7f500c400640 1 --2- 172.21.15.40:0/3581832563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50040cd510 0x7f50040c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.048+0000 7f500c400640 1 --2- 172.21.15.40:0/3581832563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50040b1830 0x7f5004152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.048+0000 7f500c400640 1 -- 172.21.15.40:0/3581832563 >> 172.21.15.40:0/3581832563 conn(0x7f500408bf80 msgr2=0x7f50040b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:57.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.049+0000 7f500c400640 1 -- 172.21.15.40:0/3581832563 shutdown_connections 2024-09-11T00:27:57.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.049+0000 7f500c400640 1 -- 172.21.15.40:0/3581832563 wait complete. 2024-09-11T00:27:57.065 INFO:tasks.ceph:Scrubbing osd.6 2024-09-11T00:27:57.066 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-11T00:27:57.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.229+0000 7f5c54800640 1 -- 172.21.15.40:0/2769967750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c34004d40 msgr2=0x7f5c340051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:57.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.229+0000 7f5c54800640 1 --2- 172.21.15.40:0/2769967750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c34004d40 0x7f5c340051a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5c48009ed0 tx=0x7f5c34005830 comp rx=0 tx=0).stop 2024-09-11T00:27:57.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.229+0000 7f5c52800640 1 -- 172.21.15.40:0/2769967750 reap_dead start 2024-09-11T00:27:57.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.229+0000 7f5c54800640 1 -- 172.21.15.40:0/2769967750 shutdown_connections 2024-09-11T00:27:57.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.229+0000 7f5c54800640 1 -- 172.21.15.40:0/2769967750 >> 172.21.15.40:0/2769967750 conn(0x7f5c4c0cf950 msgr2=0x7f5c4c0cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:57.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.229+0000 7f5c54800640 1 -- 172.21.15.40:0/2769967750 shutdown_connections 2024-09-11T00:27:57.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.229+0000 7f5c54800640 1 -- 172.21.15.40:0/2769967750 wait complete. 2024-09-11T00:27:57.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.231+0000 7f5c54800640 1 Processor -- start 2024-09-11T00:27:57.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.231+0000 7f5c54800640 1 -- start start 2024-09-11T00:27:57.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.232+0000 7f5c54800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c34004d40 0x7f5c4c1f8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:57.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.232+0000 7f5c54800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c4c0b4b20 0x7f5c4c1f5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:57.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.232+0000 7f5c54800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c4c0c5ab0 0x7f5c4c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:57.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.232+0000 7f5c54800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c06ecd0 con 0x7f5c4c0c5ab0 2024-09-11T00:27:57.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.232+0000 7f5c54800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c0726f0 con 0x7f5c34004d40 2024-09-11T00:27:57.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.232+0000 7f5c54800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5c4c06ee50 con 0x7f5c4c0b4b20 2024-09-11T00:27:57.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.232+0000 7f5c52800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c4c0c5ab0 0x7f5c4c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:57.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.232+0000 7f5c52800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c4c0c5ab0 0x7f5c4c15c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35840/0 (socket says 172.21.15.40:35840) 2024-09-11T00:27:57.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.232+0000 7f5c52800640 1 -- 172.21.15.40:0/1401336224 learned_addr learned my addr 172.21.15.40:0/1401336224 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:57.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.233+0000 7f5c51400640 1 --2- 172.21.15.40:0/1401336224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c4c0b4b20 0x7f5c4c1f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:57.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.233+0000 7f5c51e00640 1 --2- 172.21.15.40:0/1401336224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c34004d40 0x7f5c4c1f8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:57.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.233+0000 7f5c52800640 1 -- 172.21.15.40:0/1401336224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c4c0b4b20 msgr2=0x7f5c4c1f5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:57.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.233+0000 7f5c52800640 1 --2- 172.21.15.40:0/1401336224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c4c0b4b20 0x7f5c4c1f5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.233+0000 7f5c52800640 1 -- 172.21.15.40:0/1401336224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c34004d40 msgr2=0x7f5c4c1f8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:57.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.233+0000 7f5c52800640 1 --2- 172.21.15.40:0/1401336224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c34004d40 0x7f5c4c1f8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.233+0000 7f5c52800640 1 -- 172.21.15.40:0/1401336224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4c1f4db0 con 0x7f5c4c0c5ab0 2024-09-11T00:27:57.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.233+0000 7f5c52800640 1 --2- 172.21.15.40:0/1401336224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c4c0c5ab0 0x7f5c4c15c070 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5c48036040 tx=0x7f5c48033c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:57.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.233+0000 7f5c46000640 1 -- 172.21.15.40:0/1401336224 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c48043070 con 0x7f5c4c0c5ab0 2024-09-11T00:27:57.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.233+0000 7f5c46000640 1 -- 172.21.15.40:0/1401336224 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c48033d20 con 0x7f5c4c0c5ab0 2024-09-11T00:27:57.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.233+0000 7f5c54800640 1 -- 172.21.15.40:0/1401336224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4c1f8ac0 con 0x7f5c4c0c5ab0 2024-09-11T00:27:57.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.233+0000 7f5c46000640 1 -- 172.21.15.40:0/1401336224 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c48038040 con 0x7f5c4c0c5ab0 2024-09-11T00:27:57.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.233+0000 7f5c54800640 1 -- 172.21.15.40:0/1401336224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c4c1f87d0 con 0x7f5c4c0c5ab0 2024-09-11T00:27:57.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.234+0000 7f5c54800640 1 -- 172.21.15.40:0/1401336224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5c4c1f5120 con 0x7f5c4c0c5ab0 2024-09-11T00:27:57.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.236+0000 7f5c46000640 1 -- 172.21.15.40:0/1401336224 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5c4803b050 con 0x7f5c4c0c5ab0 2024-09-11T00:27:57.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.236+0000 7f5c46000640 1 --2- 172.21.15.40:0/1401336224 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5c30077f70 0x7f5c3007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:57.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.237+0000 7f5c46000640 1 -- 172.21.15.40:0/1401336224 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f5c480b9570 con 0x7f5c4c0c5ab0 2024-09-11T00:27:57.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.237+0000 7f5c46000640 1 --2- 172.21.15.40:0/1401336224 >> [v2:172.21.15.175:6818/1431736593,v1:172.21.15.175:6819/1431736593] conn(0x7f5c3007de30 0x7f5c30080250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:57.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.237+0000 7f5c46000640 1 -- 172.21.15.40:0/1401336224 --> [v2:172.21.15.175:6818/1431736593,v1:172.21.15.175:6819/1431736593] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c4800e1a0 con 0x7f5c3007de30 2024-09-11T00:27:57.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.237+0000 7f5c46000640 1 -- 172.21.15.40:0/1401336224 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5c480c0050 con 0x7f5c4c0c5ab0 2024-09-11T00:27:57.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.237+0000 7f5c51e00640 1 --2- 172.21.15.40:0/1401336224 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5c30077f70 0x7f5c3007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:57.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.237+0000 7f5c51400640 1 --2- 172.21.15.40:0/1401336224 >> [v2:172.21.15.175:6818/1431736593,v1:172.21.15.175:6819/1431736593] conn(0x7f5c3007de30 0x7f5c30080250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:57.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.238+0000 7f5c51e00640 1 --2- 172.21.15.40:0/1401336224 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5c30077f70 0x7f5c3007a430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5c40000f60 tx=0x7f5c40000ed0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:57.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.238+0000 7f5c51400640 1 --2- 172.21.15.40:0/1401336224 >> [v2:172.21.15.175:6818/1431736593,v1:172.21.15.175:6819/1431736593] conn(0x7f5c3007de30 0x7f5c30080250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:57.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.239+0000 7f5c46000640 1 -- 172.21.15.40:0/1401336224 <== osd.6 v2:172.21.15.175:6818/1431736593 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c4800e1a0 con 0x7f5c3007de30 2024-09-11T00:27:57.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.252+0000 7f5c54800640 1 -- 172.21.15.40:0/1401336224 --> [v2:172.21.15.175:6818/1431736593,v1:172.21.15.175:6819/1431736593] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5c4c06f3e0 con 0x7f5c3007de30 2024-09-11T00:27:57.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.253+0000 7f5c46000640 1 -- 172.21.15.40:0/1401336224 <== osd.6 v2:172.21.15.175:6818/1431736593 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5c4c06f3e0 con 0x7f5c3007de30 2024-09-11T00:27:57.255 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T00:27:57.255 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T00:27:57.255 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T00:27:57.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.253+0000 7f5c54800640 1 -- 172.21.15.40:0/1401336224 >> [v2:172.21.15.175:6818/1431736593,v1:172.21.15.175:6819/1431736593] conn(0x7f5c3007de30 msgr2=0x7f5c30080250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:57.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.253+0000 7f5c54800640 1 --2- 172.21.15.40:0/1401336224 >> [v2:172.21.15.175:6818/1431736593,v1:172.21.15.175:6819/1431736593] conn(0x7f5c3007de30 0x7f5c30080250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.253+0000 7f5c54800640 1 -- 172.21.15.40:0/1401336224 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5c30077f70 msgr2=0x7f5c3007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:57.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.253+0000 7f5c54800640 1 --2- 172.21.15.40:0/1401336224 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f5c30077f70 0x7f5c3007a430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5c40000f60 tx=0x7f5c40000ed0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.253+0000 7f5c54800640 1 -- 172.21.15.40:0/1401336224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c4c0c5ab0 msgr2=0x7f5c4c15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:57.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.253+0000 7f5c54800640 1 --2- 172.21.15.40:0/1401336224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c4c0c5ab0 0x7f5c4c15c070 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5c48036040 tx=0x7f5c48033c30 comp rx=0 tx=0).stop 2024-09-11T00:27:57.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.253+0000 7f5c52800640 1 -- 172.21.15.40:0/1401336224 reap_dead start 2024-09-11T00:27:57.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.253+0000 7f5c54800640 1 -- 172.21.15.40:0/1401336224 shutdown_connections 2024-09-11T00:27:57.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.253+0000 7f5c54800640 1 -- 172.21.15.40:0/1401336224 >> 172.21.15.40:0/1401336224 conn(0x7f5c4c0cf950 msgr2=0x7f5c4c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:57.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.253+0000 7f5c54800640 1 -- 172.21.15.40:0/1401336224 shutdown_connections 2024-09-11T00:27:57.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.254+0000 7f5c54800640 1 -- 172.21.15.40:0/1401336224 wait complete. 2024-09-11T00:27:57.269 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-11T00:27:57.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.429+0000 7f5760a00640 1 -- 172.21.15.40:0/237985561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f575c15c3b0 msgr2=0x7f575c15ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:57.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.429+0000 7f5760a00640 1 --2- 172.21.15.40:0/237985561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f575c15c3b0 0x7f575c15ba60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5748009830 tx=0x7f574802a5c0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.429+0000 7f5760a00640 1 -- 172.21.15.40:0/237985561 shutdown_connections 2024-09-11T00:27:57.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.429+0000 7f5760a00640 1 --2- 172.21.15.40:0/237985561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f575c15c3b0 0x7f575c15ba60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.429+0000 7f5760a00640 1 -- 172.21.15.40:0/237985561 >> 172.21.15.40:0/237985561 conn(0x7f575c0cfbb0 msgr2=0x7f575c0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:57.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.429+0000 7f5760a00640 1 -- 172.21.15.40:0/237985561 shutdown_connections 2024-09-11T00:27:57.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.429+0000 7f5760a00640 1 -- 172.21.15.40:0/237985561 wait complete. 2024-09-11T00:27:57.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.430+0000 7f5760a00640 1 Processor -- start 2024-09-11T00:27:57.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.431+0000 7f5760a00640 1 -- start start 2024-09-11T00:27:57.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.432+0000 7f5760a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f575c0cb060 0x7f575c0c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:57.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.432+0000 7f5760a00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f575c15c3b0 0x7f575c14ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:57.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.432+0000 7f5760a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f575c15e100 0x7f575c15c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:57.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.432+0000 7f5760a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f575c073cf0 con 0x7f575c15e100 2024-09-11T00:27:57.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.432+0000 7f5760a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f575c073b70 con 0x7f575c0cb060 2024-09-11T00:27:57.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.432+0000 7f5760a00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f575c073e70 con 0x7f575c15c3b0 2024-09-11T00:27:57.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.432+0000 7f575a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f575c15e100 0x7f575c15c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:57.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.432+0000 7f575a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f575c15e100 0x7f575c15c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35852/0 (socket says 172.21.15.40:35852) 2024-09-11T00:27:57.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.432+0000 7f575a800640 1 -- 172.21.15.40:0/4216667469 learned_addr learned my addr 172.21.15.40:0/4216667469 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:57.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.432+0000 7f5759400640 1 --2- 172.21.15.40:0/4216667469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f575c15c3b0 0x7f575c14ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:57.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.432+0000 7f5759e00640 1 --2- 172.21.15.40:0/4216667469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f575c0cb060 0x7f575c0c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:57.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.432+0000 7f575a800640 1 -- 172.21.15.40:0/4216667469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f575c15c3b0 msgr2=0x7f575c14ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:57.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.432+0000 7f575a800640 1 --2- 172.21.15.40:0/4216667469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f575c15c3b0 0x7f575c14ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.432+0000 7f575a800640 1 -- 172.21.15.40:0/4216667469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f575c0cb060 msgr2=0x7f575c0c36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:57.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.432+0000 7f575a800640 1 --2- 172.21.15.40:0/4216667469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f575c0cb060 0x7f575c0c36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.432+0000 7f575a800640 1 -- 172.21.15.40:0/4216667469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c0c53c0 con 0x7f575c15e100 2024-09-11T00:27:57.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.432+0000 7f5759400640 1 --2- 172.21.15.40:0/4216667469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f575c15c3b0 0x7f575c14ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:27:57.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.432+0000 7f5759e00640 1 --2- 172.21.15.40:0/4216667469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f575c0cb060 0x7f575c0c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:27:57.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.433+0000 7f575a800640 1 --2- 172.21.15.40:0/4216667469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f575c15e100 0x7f575c15c830 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f575400c730 tx=0x7f575400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:57.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.433+0000 7f5752000640 1 -- 172.21.15.40:0/4216667469 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754003b70 con 0x7f575c15e100 2024-09-11T00:27:57.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.433+0000 7f5752000640 1 -- 172.21.15.40:0/4216667469 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5754003d10 con 0x7f575c15e100 2024-09-11T00:27:57.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.433+0000 7f5760a00640 1 -- 172.21.15.40:0/4216667469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575c0c5660 con 0x7f575c15e100 2024-09-11T00:27:57.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.433+0000 7f5752000640 1 -- 172.21.15.40:0/4216667469 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57540052d0 con 0x7f575c15e100 2024-09-11T00:27:57.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.433+0000 7f5760a00640 1 -- 172.21.15.40:0/4216667469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f575c0c5c20 con 0x7f575c15e100 2024-09-11T00:27:57.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.434+0000 7f5760a00640 1 -- 172.21.15.40:0/4216667469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f575c0cf9d0 con 0x7f575c15e100 2024-09-11T00:27:57.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.435+0000 7f5752000640 1 -- 172.21.15.40:0/4216667469 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5754005470 con 0x7f575c15e100 2024-09-11T00:27:57.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.436+0000 7f5752000640 1 --2- 172.21.15.40:0/4216667469 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f573c077f70 0x7f573c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:57.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.436+0000 7f5752000640 1 -- 172.21.15.40:0/4216667469 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f57540998c0 con 0x7f575c15e100 2024-09-11T00:27:57.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.437+0000 7f5759e00640 1 --2- 172.21.15.40:0/4216667469 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f573c077f70 0x7f573c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:57.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.437+0000 7f5759e00640 1 --2- 172.21.15.40:0/4216667469 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f573c077f70 0x7f573c07a430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f574c000f60 tx=0x7f574c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:57.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.440+0000 7f5752000640 1 -- 172.21.15.40:0/4216667469 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f575c0cf9d0 con 0x7f575c15e100 2024-09-11T00:27:57.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.636+0000 7f5760a00640 1 -- 172.21.15.40:0/4216667469 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f575c0747b0 con 0x7f573c077f70 2024-09-11T00:27:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.637+0000 7f5752000640 1 -- 172.21.15.40:0/4216667469 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f575c0747b0 con 0x7f573c077f70 2024-09-11T00:27:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 6 to deep-scrub 2024-09-11T00:27:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.640+0000 7f5760a00640 1 -- 172.21.15.40:0/4216667469 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f573c077f70 msgr2=0x7f573c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.640+0000 7f5760a00640 1 --2- 172.21.15.40:0/4216667469 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f573c077f70 0x7f573c07a430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f574c000f60 tx=0x7f574c009040 comp rx=0 tx=0).stop 2024-09-11T00:27:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.640+0000 7f5760a00640 1 -- 172.21.15.40:0/4216667469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f575c15e100 msgr2=0x7f575c15c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.640+0000 7f5760a00640 1 --2- 172.21.15.40:0/4216667469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f575c15e100 0x7f575c15c830 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f575400c730 tx=0x7f575400cb30 comp rx=0 tx=0).stop 2024-09-11T00:27:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.640+0000 7f5760a00640 1 -- 172.21.15.40:0/4216667469 shutdown_connections 2024-09-11T00:27:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.640+0000 7f5760a00640 1 --2- 172.21.15.40:0/4216667469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f575c15e100 0x7f575c15c830 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.640+0000 7f5760a00640 1 --2- 172.21.15.40:0/4216667469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f575c15c3b0 0x7f575c14ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.640+0000 7f5760a00640 1 --2- 172.21.15.40:0/4216667469 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f573c077f70 0x7f573c07a430 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.640+0000 7f5760a00640 1 --2- 172.21.15.40:0/4216667469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f575c0cb060 0x7f575c0c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.640+0000 7f5760a00640 1 -- 172.21.15.40:0/4216667469 >> 172.21.15.40:0/4216667469 conn(0x7f575c0cfbb0 msgr2=0x7f575c15b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.640+0000 7f5760a00640 1 -- 172.21.15.40:0/4216667469 shutdown_connections 2024-09-11T00:27:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.640+0000 7f5760a00640 1 -- 172.21.15.40:0/4216667469 wait complete. 2024-09-11T00:27:57.657 INFO:tasks.ceph:Scrubbing osd.7 2024-09-11T00:27:57.657 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-11T00:27:57.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.820+0000 7f046ea00640 1 -- 172.21.15.40:0/72653147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04680aee80 msgr2=0x7f04680cda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:57.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.821+0000 7f046ea00640 1 --2- 172.21.15.40:0/72653147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04680aee80 0x7f04680cda60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f04680cf830 tx=0x7f045402a4d0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.821+0000 7f046ea00640 1 -- 172.21.15.40:0/72653147 shutdown_connections 2024-09-11T00:27:57.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.821+0000 7f046ea00640 1 --2- 172.21.15.40:0/72653147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04680723d0 0x7f04680ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.821+0000 7f046ea00640 1 --2- 172.21.15.40:0/72653147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04680aee80 0x7f04680cda60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.821+0000 7f046ea00640 1 --2- 172.21.15.40:0/72653147 >> v2:172.21.15.175:3300/0 conn(0x7f04681614e0 0x7f04680cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.821+0000 7f046ea00640 1 -- 172.21.15.40:0/72653147 >> 172.21.15.40:0/72653147 conn(0x7f04680cf950 msgr2=0x7f04680cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:57.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.821+0000 7f046ea00640 1 -- 172.21.15.40:0/72653147 shutdown_connections 2024-09-11T00:27:57.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.821+0000 7f046ea00640 1 -- 172.21.15.40:0/72653147 wait complete. 2024-09-11T00:27:57.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.822+0000 7f046ea00640 1 Processor -- start 2024-09-11T00:27:57.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.822+0000 7f046ea00640 1 -- start start 2024-09-11T00:27:57.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.823+0000 7f046ea00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04680723d0 0x7f04681f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:57.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.823+0000 7f046ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04680aee80 0x7f0468154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:57.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.823+0000 7f046ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04681614e0 0x7f0468156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:57.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.823+0000 7f046ea00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f04680ae140 con 0x7f04680aee80 2024-09-11T00:27:57.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.823+0000 7f046ea00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f04680adfc0 con 0x7f04681614e0 2024-09-11T00:27:57.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.823+0000 7f046ea00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f04680ae2c0 con 0x7f04680723d0 2024-09-11T00:27:57.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.824+0000 7f0467400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04680aee80 0x7f0468154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:57.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.824+0000 7f0467400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04680aee80 0x7f0468154fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39862/0 (socket says 172.21.15.40:39862) 2024-09-11T00:27:57.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.824+0000 7f0467400640 1 -- 172.21.15.40:0/1897780689 learned_addr learned my addr 172.21.15.40:0/1897780689 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:57.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.824+0000 7f046ca00640 1 --2- 172.21.15.40:0/1897780689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04681614e0 0x7f0468156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:57.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.824+0000 7f0467e00640 1 --2- 172.21.15.40:0/1897780689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04680723d0 0x7f04681f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:57.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.824+0000 7f0467400640 1 -- 172.21.15.40:0/1897780689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04680723d0 msgr2=0x7f04681f5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:57.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.824+0000 7f0467400640 1 --2- 172.21.15.40:0/1897780689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04680723d0 0x7f04681f5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.824+0000 7f0467400640 1 -- 172.21.15.40:0/1897780689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04681614e0 msgr2=0x7f0468156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:57.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.824+0000 7f0467400640 1 --2- 172.21.15.40:0/1897780689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04681614e0 0x7f0468156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.824+0000 7f0467400640 1 -- 172.21.15.40:0/1897780689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04680b0c10 con 0x7f04680aee80 2024-09-11T00:27:57.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.825+0000 7f0467400640 1 --2- 172.21.15.40:0/1897780689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04680aee80 0x7f0468154fd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0454009850 tx=0x7f0454003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:57.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.825+0000 7f045fe00640 1 -- 172.21.15.40:0/1897780689 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045403f070 con 0x7f04680aee80 2024-09-11T00:27:57.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.825+0000 7f045fe00640 1 -- 172.21.15.40:0/1897780689 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04540047a0 con 0x7f04680aee80 2024-09-11T00:27:57.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.825+0000 7f045fe00640 1 -- 172.21.15.40:0/1897780689 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0454035030 con 0x7f04680aee80 2024-09-11T00:27:57.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.825+0000 7f046ea00640 1 -- 172.21.15.40:0/1897780689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04680b0ef0 con 0x7f04680aee80 2024-09-11T00:27:57.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.825+0000 7f046ea00640 1 -- 172.21.15.40:0/1897780689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0468158ce0 con 0x7f04680aee80 2024-09-11T00:27:57.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.826+0000 7f046ea00640 1 -- 172.21.15.40:0/1897780689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f04680ad870 con 0x7f04680aee80 2024-09-11T00:27:57.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.827+0000 7f045fe00640 1 -- 172.21.15.40:0/1897780689 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0454004bb0 con 0x7f04680aee80 2024-09-11T00:27:57.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.828+0000 7f045fe00640 1 --2- 172.21.15.40:0/1897780689 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0448077f70 0x7f044807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:57.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.828+0000 7f045fe00640 1 -- 172.21.15.40:0/1897780689 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f04540bac90 con 0x7f04680aee80 2024-09-11T00:27:57.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.828+0000 7f045fe00640 1 --2- 172.21.15.40:0/1897780689 >> [v2:172.21.15.175:6802/3300317000,v1:172.21.15.175:6803/3300317000] conn(0x7f044807de30 0x7f0448080250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:57.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.828+0000 7f045fe00640 1 -- 172.21.15.40:0/1897780689 --> [v2:172.21.15.175:6802/3300317000,v1:172.21.15.175:6803/3300317000] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0448080900 con 0x7f044807de30 2024-09-11T00:27:57.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.828+0000 7f045fe00640 1 -- 172.21.15.40:0/1897780689 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f04540c02a0 con 0x7f04680aee80 2024-09-11T00:27:57.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.829+0000 7f0467e00640 1 --2- 172.21.15.40:0/1897780689 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0448077f70 0x7f044807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:57.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.829+0000 7f046ca00640 1 --2- 172.21.15.40:0/1897780689 >> [v2:172.21.15.175:6802/3300317000,v1:172.21.15.175:6803/3300317000] conn(0x7f044807de30 0x7f0448080250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:57.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.830+0000 7f046ca00640 1 --2- 172.21.15.40:0/1897780689 >> [v2:172.21.15.175:6802/3300317000,v1:172.21.15.175:6803/3300317000] conn(0x7f044807de30 0x7f0448080250 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:57.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.830+0000 7f0467e00640 1 --2- 172.21.15.40:0/1897780689 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0448077f70 0x7f044807a430 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f045800bb50 tx=0x7f045800b2e0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:57.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.830+0000 7f045fe00640 1 -- 172.21.15.40:0/1897780689 <== osd.7 v2:172.21.15.175:6802/3300317000 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0448080900 con 0x7f044807de30 2024-09-11T00:27:57.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.844+0000 7f046ea00640 1 -- 172.21.15.40:0/1897780689 --> [v2:172.21.15.175:6802/3300317000,v1:172.21.15.175:6803/3300317000] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f04680c6760 con 0x7f044807de30 2024-09-11T00:27:57.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.844+0000 7f045fe00640 1 -- 172.21.15.40:0/1897780689 <== osd.7 v2:172.21.15.175:6802/3300317000 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f04680c6760 con 0x7f044807de30 2024-09-11T00:27:57.846 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T00:27:57.846 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T00:27:57.846 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T00:27:57.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.845+0000 7f046ea00640 1 -- 172.21.15.40:0/1897780689 >> [v2:172.21.15.175:6802/3300317000,v1:172.21.15.175:6803/3300317000] conn(0x7f044807de30 msgr2=0x7f0448080250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:57.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.845+0000 7f046ea00640 1 --2- 172.21.15.40:0/1897780689 >> [v2:172.21.15.175:6802/3300317000,v1:172.21.15.175:6803/3300317000] conn(0x7f044807de30 0x7f0448080250 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.845+0000 7f046ea00640 1 -- 172.21.15.40:0/1897780689 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0448077f70 msgr2=0x7f044807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:57.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.845+0000 7f046ea00640 1 --2- 172.21.15.40:0/1897780689 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f0448077f70 0x7f044807a430 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f045800bb50 tx=0x7f045800b2e0 comp rx=0 tx=0).stop 2024-09-11T00:27:57.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.845+0000 7f046ea00640 1 -- 172.21.15.40:0/1897780689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04680aee80 msgr2=0x7f0468154fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:57.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.845+0000 7f046ea00640 1 --2- 172.21.15.40:0/1897780689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04680aee80 0x7f0468154fd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0454009850 tx=0x7f0454003910 comp rx=0 tx=0).stop 2024-09-11T00:27:57.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.845+0000 7f046ca00640 1 -- 172.21.15.40:0/1897780689 reap_dead start 2024-09-11T00:27:57.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.845+0000 7f046ea00640 1 -- 172.21.15.40:0/1897780689 shutdown_connections 2024-09-11T00:27:57.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.845+0000 7f046ea00640 1 -- 172.21.15.40:0/1897780689 >> 172.21.15.40:0/1897780689 conn(0x7f04680cf950 msgr2=0x7f046806f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:57.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.845+0000 7f046ea00640 1 -- 172.21.15.40:0/1897780689 shutdown_connections 2024-09-11T00:27:57.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:57.845+0000 7f046ea00640 1 -- 172.21.15.40:0/1897780689 wait complete. 2024-09-11T00:27:57.861 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-11T00:27:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.023+0000 7f9889600640 1 -- 172.21.15.40:0/3912799463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9868004020 msgr2=0x7f9868004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.023+0000 7f9889600640 1 --2- 172.21.15.40:0/3912799463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9868004020 0x7f9868004800 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9870009b20 tx=0x7f9868005830 comp rx=0 tx=0).stop 2024-09-11T00:27:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.023+0000 7f9888c00640 1 -- 172.21.15.40:0/3912799463 reap_dead start 2024-09-11T00:27:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.023+0000 7f9889600640 1 -- 172.21.15.40:0/3912799463 shutdown_connections 2024-09-11T00:27:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.023+0000 7f9889600640 1 -- 172.21.15.40:0/3912799463 >> 172.21.15.40:0/3912799463 conn(0x7f98840cf770 msgr2=0x7f98840cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.023+0000 7f9889600640 1 -- 172.21.15.40:0/3912799463 shutdown_connections 2024-09-11T00:27:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.023+0000 7f9889600640 1 -- 172.21.15.40:0/3912799463 wait complete. 2024-09-11T00:27:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.025+0000 7f9889600640 1 Processor -- start 2024-09-11T00:27:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.025+0000 7f9889600640 1 -- start start 2024-09-11T00:27:58.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.026+0000 7f9889600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9868004020 0x7f98840c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:58.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.026+0000 7f9889600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98840c6840 0x7f988414bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:58.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.026+0000 7f9889600640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98840cdee0 0x7f98840ce360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:58.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.026+0000 7f9889600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f988406e890 con 0x7f9868004020 2024-09-11T00:27:58.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.026+0000 7f9889600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f98840b5760 con 0x7f98840c6840 2024-09-11T00:27:58.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.026+0000 7f9889600640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f988406ea10 con 0x7f98840cdee0 2024-09-11T00:27:58.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.026+0000 7f9883e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9868004020 0x7f98840c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:58.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.026+0000 7f9883e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9868004020 0x7f98840c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39886/0 (socket says 172.21.15.40:39886) 2024-09-11T00:27:58.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.026+0000 7f9883e00640 1 -- 172.21.15.40:0/404137820 learned_addr learned my addr 172.21.15.40:0/404137820 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:58.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.026+0000 7f9888c00640 1 --2- 172.21.15.40:0/404137820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98840cdee0 0x7f98840ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:58.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.026+0000 7f9883400640 1 --2- 172.21.15.40:0/404137820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98840c6840 0x7f988414bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:58.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.027+0000 7f9883e00640 1 -- 172.21.15.40:0/404137820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98840cdee0 msgr2=0x7f98840ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:58.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.027+0000 7f9883e00640 1 --2- 172.21.15.40:0/404137820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98840cdee0 0x7f98840ce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:58.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.027+0000 7f9883e00640 1 -- 172.21.15.40:0/404137820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98840c6840 msgr2=0x7f988414bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:58.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.027+0000 7f9883e00640 1 --2- 172.21.15.40:0/404137820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98840c6840 0x7f988414bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:58.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.027+0000 7f9883e00640 1 -- 172.21.15.40:0/404137820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98840c30e0 con 0x7f9868004020 2024-09-11T00:27:58.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.027+0000 7f9883e00640 1 --2- 172.21.15.40:0/404137820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9868004020 0x7f98840c9770 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9874011b10 tx=0x7f9874009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:58.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.027+0000 7f987be00640 1 -- 172.21.15.40:0/404137820 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987401e070 con 0x7f9868004020 2024-09-11T00:27:58.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.027+0000 7f987be00640 1 -- 172.21.15.40:0/404137820 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9874004050 con 0x7f9868004020 2024-09-11T00:27:58.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.027+0000 7f987be00640 1 -- 172.21.15.40:0/404137820 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987400fea0 con 0x7f9868004020 2024-09-11T00:27:58.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.027+0000 7f9889600640 1 -- 172.21.15.40:0/404137820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98840c33c0 con 0x7f9868004020 2024-09-11T00:27:58.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.027+0000 7f9889600640 1 -- 172.21.15.40:0/404137820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98840c3980 con 0x7f9868004020 2024-09-11T00:27:58.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.028+0000 7f9889600640 1 -- 172.21.15.40:0/404137820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98840ce8a0 con 0x7f9868004020 2024-09-11T00:27:58.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.029+0000 7f987be00640 1 -- 172.21.15.40:0/404137820 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f98740035f0 con 0x7f9868004020 2024-09-11T00:27:58.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.030+0000 7f987be00640 1 --2- 172.21.15.40:0/404137820 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9864077fa0 0x7f986407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:58.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.030+0000 7f987be00640 1 -- 172.21.15.40:0/404137820 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f987409a5a0 con 0x7f9868004020 2024-09-11T00:27:58.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.031+0000 7f9883400640 1 --2- 172.21.15.40:0/404137820 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9864077fa0 0x7f986407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:58.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.032+0000 7f9883400640 1 --2- 172.21.15.40:0/404137820 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9864077fa0 0x7f986407a460 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9870035000 tx=0x7f98700046c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:58.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.035+0000 7f987be00640 1 -- 172.21.15.40:0/404137820 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f98740044a0 con 0x7f9868004020 2024-09-11T00:27:58.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.231+0000 7f9889600640 1 -- 172.21.15.40:0/404137820 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f98840aff60 con 0x7f9864077fa0 2024-09-11T00:27:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.232+0000 7f987be00640 1 -- 172.21.15.40:0/404137820 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f98840aff60 con 0x7f9864077fa0 2024-09-11T00:27:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 7 to deep-scrub 2024-09-11T00:27:58.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.234+0000 7f9889600640 1 -- 172.21.15.40:0/404137820 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9864077fa0 msgr2=0x7f986407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:58.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.234+0000 7f9889600640 1 --2- 172.21.15.40:0/404137820 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9864077fa0 0x7f986407a460 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9870035000 tx=0x7f98700046c0 comp rx=0 tx=0).stop 2024-09-11T00:27:58.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.234+0000 7f9889600640 1 -- 172.21.15.40:0/404137820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9868004020 msgr2=0x7f98840c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:58.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.234+0000 7f9889600640 1 --2- 172.21.15.40:0/404137820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9868004020 0x7f98840c9770 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9874011b10 tx=0x7f9874009e90 comp rx=0 tx=0).stop 2024-09-11T00:27:58.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.234+0000 7f9889600640 1 -- 172.21.15.40:0/404137820 shutdown_connections 2024-09-11T00:27:58.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.234+0000 7f9889600640 1 --2- 172.21.15.40:0/404137820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98840cdee0 0x7f98840ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:58.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.234+0000 7f9889600640 1 --2- 172.21.15.40:0/404137820 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f9864077fa0 0x7f986407a460 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:58.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.234+0000 7f9889600640 1 --2- 172.21.15.40:0/404137820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98840c6840 0x7f988414bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:58.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.234+0000 7f9889600640 1 --2- 172.21.15.40:0/404137820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9868004020 0x7f98840c9770 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:58.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.234+0000 7f9889600640 1 -- 172.21.15.40:0/404137820 >> 172.21.15.40:0/404137820 conn(0x7f98840cf770 msgr2=0x7f98840cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:58.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.234+0000 7f9889600640 1 -- 172.21.15.40:0/404137820 shutdown_connections 2024-09-11T00:27:58.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.234+0000 7f9889600640 1 -- 172.21.15.40:0/404137820 wait complete. 2024-09-11T00:27:58.252 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:27:58.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.409+0000 7fc533200640 1 -- 172.21.15.40:0/3430740656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc52c0cb420 msgr2=0x7fc52c06f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:58.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.409+0000 7fc533200640 1 --2- 172.21.15.40:0/3430740656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc52c0cb420 0x7fc52c06f020 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc524005fd0 tx=0x7fc52402a940 comp rx=0 tx=0).stop 2024-09-11T00:27:58.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.409+0000 7fc533200640 1 -- 172.21.15.40:0/3430740656 shutdown_connections 2024-09-11T00:27:58.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.409+0000 7fc533200640 1 --2- 172.21.15.40:0/3430740656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc52c0cb420 0x7fc52c06f020 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:58.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.409+0000 7fc533200640 1 -- 172.21.15.40:0/3430740656 >> 172.21.15.40:0/3430740656 conn(0x7fc52c0cfbb0 msgr2=0x7fc52c0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:58.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.409+0000 7fc533200640 1 -- 172.21.15.40:0/3430740656 shutdown_connections 2024-09-11T00:27:58.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.409+0000 7fc533200640 1 -- 172.21.15.40:0/3430740656 wait complete. 2024-09-11T00:27:58.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.411+0000 7fc533200640 1 Processor -- start 2024-09-11T00:27:58.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.411+0000 7fc533200640 1 -- start start 2024-09-11T00:27:58.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.412+0000 7fc533200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc52c0cb420 0x7fc52c0b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:58.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.412+0000 7fc533200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc52c0cc180 0x7fc52c15e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:58.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.412+0000 7fc533200640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc52c15bcc0 0x7fc52c15e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:58.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.412+0000 7fc533200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc52c06f560 con 0x7fc52c0cb420 2024-09-11T00:27:58.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.412+0000 7fc533200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc52c15f9d0 con 0x7fc52c0cc180 2024-09-11T00:27:58.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.412+0000 7fc533200640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc52c06f6e0 con 0x7fc52c15bcc0 2024-09-11T00:27:58.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.412+0000 7fc52be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc52c0cb420 0x7fc52c0b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:58.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.412+0000 7fc52be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc52c0cb420 0x7fc52c0b03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39900/0 (socket says 172.21.15.40:39900) 2024-09-11T00:27:58.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.412+0000 7fc52be00640 1 -- 172.21.15.40:0/3962885821 learned_addr learned my addr 172.21.15.40:0/3962885821 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:27:58.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.412+0000 7fc531200640 1 --2- 172.21.15.40:0/3962885821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc52c15bcc0 0x7fc52c15e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:58.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.412+0000 7fc523400640 1 --2- 172.21.15.40:0/3962885821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc52c0cc180 0x7fc52c15e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:58.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.413+0000 7fc52be00640 1 -- 172.21.15.40:0/3962885821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc52c15bcc0 msgr2=0x7fc52c15e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:58.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.413+0000 7fc52be00640 1 --2- 172.21.15.40:0/3962885821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc52c15bcc0 0x7fc52c15e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:58.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.413+0000 7fc52be00640 1 -- 172.21.15.40:0/3962885821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc52c0cc180 msgr2=0x7fc52c15e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:58.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.413+0000 7fc52be00640 1 --2- 172.21.15.40:0/3962885821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc52c0cc180 0x7fc52c15e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:58.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.413+0000 7fc52be00640 1 -- 172.21.15.40:0/3962885821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc52c0c5980 con 0x7fc52c0cb420 2024-09-11T00:27:58.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.413+0000 7fc52be00640 1 --2- 172.21.15.40:0/3962885821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc52c0cb420 0x7fc52c0b03f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00c410 tx=0x7fc51c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:58.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.413+0000 7fc528c00640 1 -- 172.21.15.40:0/3962885821 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc51c011790 con 0x7fc52c0cb420 2024-09-11T00:27:58.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.413+0000 7fc528c00640 1 -- 172.21.15.40:0/3962885821 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc51c017070 con 0x7fc52c0cb420 2024-09-11T00:27:58.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.413+0000 7fc528c00640 1 -- 172.21.15.40:0/3962885821 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc51c011ca0 con 0x7fc52c0cb420 2024-09-11T00:27:58.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.413+0000 7fc533200640 1 -- 172.21.15.40:0/3962885821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc52c0c3780 con 0x7fc52c0cb420 2024-09-11T00:27:58.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.413+0000 7fc533200640 1 -- 172.21.15.40:0/3962885821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc52c0c3d40 con 0x7fc52c0cb420 2024-09-11T00:27:58.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.414+0000 7fc533200640 1 -- 172.21.15.40:0/3962885821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc52c06fb90 con 0x7fc52c0cb420 2024-09-11T00:27:58.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.416+0000 7fc528c00640 1 -- 172.21.15.40:0/3962885821 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc51c01c460 con 0x7fc52c0cb420 2024-09-11T00:27:58.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.416+0000 7fc528c00640 1 --2- 172.21.15.40:0/3962885821 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc508077f70 0x7fc50807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:58.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.417+0000 7fc528c00640 1 -- 172.21.15.40:0/3962885821 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fc51c099880 con 0x7fc52c0cb420 2024-09-11T00:27:58.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.417+0000 7fc523400640 1 --2- 172.21.15.40:0/3962885821 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc508077f70 0x7fc50807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:58.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.418+0000 7fc523400640 1 --2- 172.21.15.40:0/3962885821 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc508077f70 0x7fc50807a430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0cb2c0 tx=0x7fc514009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:58.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.421+0000 7fc528c00640 1 -- 172.21.15.40:0/3962885821 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc51c062610 con 0x7fc52c0cb420 2024-09-11T00:27:58.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.610+0000 7fc533200640 1 -- 172.21.15.40:0/3962885821 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc52c0ce4e0 con 0x7fc508077f70 2024-09-11T00:27:58.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.611+0000 7fc528c00640 1 -- 172.21.15.40:0/3962885821 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13340 (secure 0 0 0) 0x7fc52c0ce4e0 con 0x7fc508077f70 2024-09-11T00:27:58.613 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:27:58.613 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T00:27:58.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.614+0000 7fc533200640 1 -- 172.21.15.40:0/3962885821 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc508077f70 msgr2=0x7fc50807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:58.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.614+0000 7fc533200640 1 --2- 172.21.15.40:0/3962885821 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc508077f70 0x7fc50807a430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0cb2c0 tx=0x7fc514009040 comp rx=0 tx=0).stop 2024-09-11T00:27:58.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.614+0000 7fc533200640 1 -- 172.21.15.40:0/3962885821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc52c0cb420 msgr2=0x7fc52c0b03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:58.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.614+0000 7fc533200640 1 --2- 172.21.15.40:0/3962885821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc52c0cb420 0x7fc52c0b03f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00c410 tx=0x7fc51c00c8d0 comp rx=0 tx=0).stop 2024-09-11T00:27:58.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.614+0000 7fc533200640 1 -- 172.21.15.40:0/3962885821 shutdown_connections 2024-09-11T00:27:58.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.614+0000 7fc533200640 1 --2- 172.21.15.40:0/3962885821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc52c15bcc0 0x7fc52c15e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:58.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.614+0000 7fc533200640 1 --2- 172.21.15.40:0/3962885821 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fc508077f70 0x7fc50807a430 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:58.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.614+0000 7fc533200640 1 --2- 172.21.15.40:0/3962885821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc52c0cc180 0x7fc52c15e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:58.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.614+0000 7fc533200640 1 --2- 172.21.15.40:0/3962885821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc52c0cb420 0x7fc52c0b03f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:58.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.614+0000 7fc533200640 1 -- 172.21.15.40:0/3962885821 >> 172.21.15.40:0/3962885821 conn(0x7fc52c0cfbb0 msgr2=0x7fc52c0cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:58.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.614+0000 7fc533200640 1 -- 172.21.15.40:0/3962885821 shutdown_connections 2024-09-11T00:27:58.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:27:58.614+0000 7fc533200640 1 -- 172.21.15.40:0/3962885821 wait complete. 2024-09-11T00:27:58.631 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-09-11T00:27:57.842646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224948,"kb_used_data":4552,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749772,"statfs":{"total":773094113280,"available":772863766528,"internally_reserved":0,"allocated":4661248,"data_stored":2537656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002450"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":144,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:27:47.863976+0000","last_change":"2024-09-11T00:23:38.923873+0000","last_active":"2024-09-11T00:27:47.863976+0000","last_peered":"2024-09-11T00:27:47.863976+0000","last_clean":"2024-09-11T00:27:47.863976+0000","last_became_active":"2024-09-11T00:23:38.920629+0000","last_became_peered":"2024-09-11T00:23:38.920629+0000","last_unstale":"2024-09-11T00:27:47.863976+0000","last_undegraded":"2024-09-11T00:27:47.863976+0000","last_fullsized":"2024-09-11T00:27:47.863976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:23:37.844553+0000","last_clean_scrub_stamp":"2024-09-11T00:23:37.844553+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.533941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1028096,"data_stored":759983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":169615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":169615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":169615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":434176,"data_stored":169615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":169615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":434176,"data_stored":169615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542200,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1028096,"data_stored":759983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:27:58.634 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T00:23:37.844553+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=23, tm_sec=37, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=0, tm_min=27, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T00:27:58.634 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T00:28:13.440 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:28:13.445 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:28:18.635 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:28:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.807+0000 7f98dee00640 1 -- 172.21.15.40:0/1534739948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98d815bcc0 msgr2=0x7f98d80cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:28:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.807+0000 7f98dee00640 1 --2- 172.21.15.40:0/1534739948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98d815bcc0 0x7f98d80cb420 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009830 tx=0x7f98c802a560 comp rx=0 tx=0).stop 2024-09-11T00:28:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.807+0000 7f98dee00640 1 -- 172.21.15.40:0/1534739948 shutdown_connections 2024-09-11T00:28:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.807+0000 7f98dee00640 1 --2- 172.21.15.40:0/1534739948 >> v2:172.21.15.175:3300/0 conn(0x7f98d806f920 0x7f98d80cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.807+0000 7f98dee00640 1 --2- 172.21.15.40:0/1534739948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98d815bcc0 0x7f98d80cb420 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.807+0000 7f98dee00640 1 -- 172.21.15.40:0/1534739948 >> 172.21.15.40:0/1534739948 conn(0x7f98d80cfbb0 msgr2=0x7f98d80cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:28:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.807+0000 7f98dee00640 1 -- 172.21.15.40:0/1534739948 shutdown_connections 2024-09-11T00:28:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.807+0000 7f98dee00640 1 -- 172.21.15.40:0/1534739948 wait complete. 2024-09-11T00:28:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.809+0000 7f98dee00640 1 Processor -- start 2024-09-11T00:28:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.809+0000 7f98dee00640 1 -- start start 2024-09-11T00:28:18.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.810+0000 7f98dee00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98d806f920 0x7f98d80cd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:28:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.810+0000 7f98dee00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98d80cba70 0x7f98d80c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:28:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.810+0000 7f98dee00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98d815bcc0 0x7f98d80b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:28:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.810+0000 7f98dee00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f98d815f940 con 0x7f98d815bcc0 2024-09-11T00:28:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.810+0000 7f98dee00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f98d815f7c0 con 0x7f98d806f920 2024-09-11T00:28:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.810+0000 7f98dee00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f98d80ca910 con 0x7f98d80cba70 2024-09-11T00:28:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.810+0000 7f98dce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98d815bcc0 0x7f98d80b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:28:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.810+0000 7f98dce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98d815bcc0 0x7f98d80b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48702/0 (socket says 172.21.15.40:48702) 2024-09-11T00:28:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.810+0000 7f98dce00640 1 -- 172.21.15.40:0/2300511944 learned_addr learned my addr 172.21.15.40:0/2300511944 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:28:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.810+0000 7f98d7e00640 1 --2- 172.21.15.40:0/2300511944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98d806f920 0x7f98d80cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:28:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.810+0000 7f98d7400640 1 --2- 172.21.15.40:0/2300511944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98d80cba70 0x7f98d80c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:28:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.810+0000 7f98dce00640 1 -- 172.21.15.40:0/2300511944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98d80cba70 msgr2=0x7f98d80c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:28:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.810+0000 7f98dce00640 1 --2- 172.21.15.40:0/2300511944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98d80cba70 0x7f98d80c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.810+0000 7f98dce00640 1 -- 172.21.15.40:0/2300511944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98d806f920 msgr2=0x7f98d80cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:28:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.810+0000 7f98dce00640 1 --2- 172.21.15.40:0/2300511944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98d806f920 0x7f98d80cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.810+0000 7f98dce00640 1 -- 172.21.15.40:0/2300511944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d81f81d0 con 0x7f98d815bcc0 2024-09-11T00:28:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.810+0000 7f98d7400640 1 --2- 172.21.15.40:0/2300511944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98d80cba70 0x7f98d80c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:28:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.811+0000 7f98dce00640 1 --2- 172.21.15.40:0/2300511944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98d815bcc0 0x7f98d80b4390 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f98d000eaa0 tx=0x7f98d000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:28:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.811+0000 7f98cfe00640 1 -- 172.21.15.40:0/2300511944 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d000cd50 con 0x7f98d815bcc0 2024-09-11T00:28:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.811+0000 7f98cfe00640 1 -- 172.21.15.40:0/2300511944 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98d0004b20 con 0x7f98d815bcc0 2024-09-11T00:28:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.811+0000 7f98cfe00640 1 -- 172.21.15.40:0/2300511944 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d0005020 con 0x7f98d815bcc0 2024-09-11T00:28:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.811+0000 7f98dee00640 1 -- 172.21.15.40:0/2300511944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d81f84b0 con 0x7f98d815bcc0 2024-09-11T00:28:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.811+0000 7f98dee00640 1 -- 172.21.15.40:0/2300511944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d81f8a70 con 0x7f98d815bcc0 2024-09-11T00:28:18.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.812+0000 7f98dee00640 1 -- 172.21.15.40:0/2300511944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98d81f8cb0 con 0x7f98d815bcc0 2024-09-11T00:28:18.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.813+0000 7f98cfe00640 1 -- 172.21.15.40:0/2300511944 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f98d000f040 con 0x7f98d815bcc0 2024-09-11T00:28:18.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.814+0000 7f98cfe00640 1 --2- 172.21.15.40:0/2300511944 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f98b8077f70 0x7f98b807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:28:18.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.814+0000 7f98cfe00640 1 -- 172.21.15.40:0/2300511944 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f98d0099ff0 con 0x7f98d815bcc0 2024-09-11T00:28:18.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.815+0000 7f98d7e00640 1 --2- 172.21.15.40:0/2300511944 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f98b8077f70 0x7f98b807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:28:18.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.815+0000 7f98d7e00640 1 --2- 172.21.15.40:0/2300511944 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f98b8077f70 0x7f98b807a430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f98c8034000 tx=0x7f98c8004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:28:18.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:18.819+0000 7f98cfe00640 1 -- 172.21.15.40:0/2300511944 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f98d0016030 con 0x7f98d815bcc0 2024-09-11T00:28:19.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.010+0000 7f98dee00640 1 -- 172.21.15.40:0/2300511944 --> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f98d80cf1b0 con 0x7f98b8077f70 2024-09-11T00:28:19.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.011+0000 7f98cfe00640 1 -- 172.21.15.40:0/2300511944 <== mgr.4115 v2:172.21.15.175:6800/422726646 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13344 (secure 0 0 0) 0x7f98d80cf1b0 con 0x7f98b8077f70 2024-09-11T00:28:19.013 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:28:19.013 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T00:28:19.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.013+0000 7f98dee00640 1 -- 172.21.15.40:0/2300511944 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f98b8077f70 msgr2=0x7f98b807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:28:19.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.013+0000 7f98dee00640 1 --2- 172.21.15.40:0/2300511944 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f98b8077f70 0x7f98b807a430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f98c8034000 tx=0x7f98c8004730 comp rx=0 tx=0).stop 2024-09-11T00:28:19.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.013+0000 7f98dee00640 1 -- 172.21.15.40:0/2300511944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98d815bcc0 msgr2=0x7f98d80b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:28:19.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.013+0000 7f98dee00640 1 --2- 172.21.15.40:0/2300511944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98d815bcc0 0x7f98d80b4390 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f98d000eaa0 tx=0x7f98d000ef60 comp rx=0 tx=0).stop 2024-09-11T00:28:19.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.013+0000 7f98dee00640 1 -- 172.21.15.40:0/2300511944 shutdown_connections 2024-09-11T00:28:19.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.013+0000 7f98dee00640 1 --2- 172.21.15.40:0/2300511944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98d815bcc0 0x7f98d80b4390 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.013+0000 7f98dee00640 1 --2- 172.21.15.40:0/2300511944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98d80cba70 0x7f98d80c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.013+0000 7f98dee00640 1 --2- 172.21.15.40:0/2300511944 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7f98b8077f70 0x7f98b807a430 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.013+0000 7f98dee00640 1 --2- 172.21.15.40:0/2300511944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98d806f920 0x7f98d80cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.013+0000 7f98dee00640 1 -- 172.21.15.40:0/2300511944 >> 172.21.15.40:0/2300511944 conn(0x7f98d80cfbb0 msgr2=0x7f98d80af830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:28:19.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.013+0000 7f98dee00640 1 -- 172.21.15.40:0/2300511944 shutdown_connections 2024-09-11T00:28:19.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.013+0000 7f98dee00640 1 -- 172.21.15.40:0/2300511944 wait complete. 2024-09-11T00:28:19.030 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":172,"stamp":"2024-09-11T00:28:17.846685+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224936,"kb_used_data":4552,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749784,"statfs":{"total":773094113280,"available":772863778816,"internally_reserved":0,"allocated":4661248,"data_stored":2537656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002322"},"pg_stats":[{"pgid":"1.0","version":"38'74","reported_seq":154,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T00:27:59.162290+0000","last_change":"2024-09-11T00:27:59.162290+0000","last_active":"2024-09-11T00:27:59.162290+0000","last_peered":"2024-09-11T00:27:59.162290+0000","last_clean":"2024-09-11T00:27:59.162290+0000","last_became_active":"2024-09-11T00:23:38.920629+0000","last_became_peered":"2024-09-11T00:23:38.920629+0000","last_unstale":"2024-09-11T00:27:59.162290+0000","last_undegraded":"2024-09-11T00:27:59.162290+0000","last_fullsized":"2024-09-11T00:27:59.162290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'74","last_scrub_stamp":"2024-09-11T00:27:59.162194+0000","last_deep_scrub":"38'74","last_deep_scrub_stamp":"2024-09-11T00:27:59.162194+0000","last_clean_scrub_stamp":"2024-09-11T00:27:59.162194+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:44.219568+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509499,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1028096,"data_stored":759983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509500,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":169615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":169615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":169615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":434176,"data_stored":169615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":169615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":434176,"data_stored":169615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542204,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1028096,"data_stored":759983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:28:19.031 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-11T00:28:19.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.184+0000 7fadf7000640 1 -- 172.21.15.40:0/1266069183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadf015dfd0 msgr2=0x7fadf00ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:28:19.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.184+0000 7fadf7000640 1 --2- 172.21.15.40:0/1266069183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadf015dfd0 0x7fadf00ca7b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fade4009830 tx=0x7fade402a510 comp rx=0 tx=0).stop 2024-09-11T00:28:19.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.184+0000 7fadf7000640 1 -- 172.21.15.40:0/1266069183 shutdown_connections 2024-09-11T00:28:19.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.184+0000 7fadf7000640 1 --2- 172.21.15.40:0/1266069183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadf006e3e0 0x7fadf00cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.184+0000 7fadf7000640 1 --2- 172.21.15.40:0/1266069183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadf015dfd0 0x7fadf00ca7b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.184+0000 7fadf7000640 1 -- 172.21.15.40:0/1266069183 >> 172.21.15.40:0/1266069183 conn(0x7fadf0073f60 msgr2=0x7fadf0074370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:28:19.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.184+0000 7fadf7000640 1 -- 172.21.15.40:0/1266069183 shutdown_connections 2024-09-11T00:28:19.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.184+0000 7fadf7000640 1 -- 172.21.15.40:0/1266069183 wait complete. 2024-09-11T00:28:19.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.186+0000 7fadf7000640 1 Processor -- start 2024-09-11T00:28:19.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.186+0000 7fadf7000640 1 -- start start 2024-09-11T00:28:19.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.187+0000 7fadf7000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadf0068c80 0x7fadf00c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:28:19.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.187+0000 7fadf7000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadf006e3e0 0x7fadf01f7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:28:19.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.187+0000 7fadf7000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadf015dfd0 0x7fadf00c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:28:19.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.187+0000 7fadf7000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fadf0074c00 con 0x7fadf0068c80 2024-09-11T00:28:19.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.187+0000 7fadf7000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fadf0074a80 con 0x7fadf015dfd0 2024-09-11T00:28:19.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.187+0000 7fadf7000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fadf0074d80 con 0x7fadf006e3e0 2024-09-11T00:28:19.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.187+0000 7fadf5c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadf0068c80 0x7fadf00c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:28:19.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.187+0000 7fadf5c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadf0068c80 0x7fadf00c3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48716/0 (socket says 172.21.15.40:48716) 2024-09-11T00:28:19.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.187+0000 7fadf5c00640 1 -- 172.21.15.40:0/876786547 learned_addr learned my addr 172.21.15.40:0/876786547 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:28:19.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.188+0000 7fadf6600640 1 --2- 172.21.15.40:0/876786547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadf015dfd0 0x7fadf00c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:28:19.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.188+0000 7fadf5200640 1 --2- 172.21.15.40:0/876786547 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadf006e3e0 0x7fadf01f7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:28:19.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.188+0000 7fadf5c00640 1 -- 172.21.15.40:0/876786547 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadf006e3e0 msgr2=0x7fadf01f7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:28:19.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.188+0000 7fadf5c00640 1 --2- 172.21.15.40:0/876786547 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadf006e3e0 0x7fadf01f7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.188+0000 7fadf5c00640 1 -- 172.21.15.40:0/876786547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadf015dfd0 msgr2=0x7fadf00c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:28:19.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.188+0000 7fadf5c00640 1 --2- 172.21.15.40:0/876786547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadf015dfd0 0x7fadf00c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.188+0000 7fadf5c00640 1 -- 172.21.15.40:0/876786547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf015cc80 con 0x7fadf0068c80 2024-09-11T00:28:19.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.188+0000 7fadf5200640 1 --2- 172.21.15.40:0/876786547 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadf006e3e0 0x7fadf01f7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:28:19.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.188+0000 7fadf5c00640 1 --2- 172.21.15.40:0/876786547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadf0068c80 0x7fadf00c3c50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fade4009950 tx=0x7fade4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:28:19.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.188+0000 7faded600640 1 -- 172.21.15.40:0/876786547 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4031d60 con 0x7fadf0068c80 2024-09-11T00:28:19.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.188+0000 7faded600640 1 -- 172.21.15.40:0/876786547 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fade4033e10 con 0x7fadf0068c80 2024-09-11T00:28:19.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.188+0000 7faded600640 1 -- 172.21.15.40:0/876786547 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4033310 con 0x7fadf0068c80 2024-09-11T00:28:19.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.188+0000 7fadf7000640 1 -- 172.21.15.40:0/876786547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf014d910 con 0x7fadf0068c80 2024-09-11T00:28:19.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.188+0000 7fadf7000640 1 -- 172.21.15.40:0/876786547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf014e1b0 con 0x7fadf0068c80 2024-09-11T00:28:19.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.190+0000 7fadf7000640 1 -- 172.21.15.40:0/876786547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf00cc5c0 con 0x7fadf0068c80 2024-09-11T00:28:19.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.191+0000 7faded600640 1 -- 172.21.15.40:0/876786547 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fade404b030 con 0x7fadf0068c80 2024-09-11T00:28:19.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.191+0000 7faded600640 1 --2- 172.21.15.40:0/876786547 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fadd0077fa0 0x7fadd007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:28:19.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.192+0000 7faded600640 1 -- 172.21.15.40:0/876786547 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fade40baa40 con 0x7fadf0068c80 2024-09-11T00:28:19.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.192+0000 7fadf5200640 1 --2- 172.21.15.40:0/876786547 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fadd0077fa0 0x7fadd007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:28:19.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.193+0000 7fadf5200640 1 --2- 172.21.15.40:0/876786547 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fadd0077fa0 0x7fadd007a460 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fadf01e8810 tx=0x7faddc009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:28:19.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.196+0000 7faded600640 1 -- 172.21.15.40:0/876786547 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fade403f030 con 0x7fadf0068c80 2024-09-11T00:28:19.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.392+0000 7fadf7000640 1 -- 172.21.15.40:0/876786547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fadf00cce10 con 0x7fadf0068c80 2024-09-11T00:28:19.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.396+0000 7faded600640 1 -- 172.21.15.40:0/876786547 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v30)=0 v30) ==== 123+0+0 (secure 0 0 0) 0x7fade40837a0 con 0x7fadf0068c80 2024-09-11T00:28:19.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.396+0000 7faded600640 1 -- 172.21.15.40:0/876786547 <== mon.0 v2:172.21.15.40:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fade40c0080 con 0x7fadf0068c80 2024-09-11T00:28:19.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.398+0000 7fadf7000640 1 -- 172.21.15.40:0/876786547 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fadd0077fa0 msgr2=0x7fadd007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:28:19.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.398+0000 7fadf7000640 1 --2- 172.21.15.40:0/876786547 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fadd0077fa0 0x7fadd007a460 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fadf01e8810 tx=0x7faddc009040 comp rx=0 tx=0).stop 2024-09-11T00:28:19.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.398+0000 7fadf7000640 1 -- 172.21.15.40:0/876786547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadf0068c80 msgr2=0x7fadf00c3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:28:19.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.398+0000 7fadf7000640 1 --2- 172.21.15.40:0/876786547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadf0068c80 0x7fadf00c3c50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fade4009950 tx=0x7fade4033c20 comp rx=0 tx=0).stop 2024-09-11T00:28:19.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.399+0000 7fadf7000640 1 -- 172.21.15.40:0/876786547 shutdown_connections 2024-09-11T00:28:19.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.399+0000 7fadf7000640 1 --2- 172.21.15.40:0/876786547 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fadd0077fa0 0x7fadd007a460 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.399+0000 7fadf7000640 1 --2- 172.21.15.40:0/876786547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadf015dfd0 0x7fadf00c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.399+0000 7fadf7000640 1 --2- 172.21.15.40:0/876786547 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadf006e3e0 0x7fadf01f7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.399+0000 7fadf7000640 1 --2- 172.21.15.40:0/876786547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadf0068c80 0x7fadf00c3c50 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.399+0000 7fadf7000640 1 -- 172.21.15.40:0/876786547 >> 172.21.15.40:0/876786547 conn(0x7fadf0073f60 msgr2=0x7fadf00ca560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:28:19.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.399+0000 7fadf7000640 1 -- 172.21.15.40:0/876786547 shutdown_connections 2024-09-11T00:28:19.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.399+0000 7fadf7000640 1 -- 172.21.15.40:0/876786547 wait complete. 2024-09-11T00:28:19.416 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T00:28:19.416 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T00:28:19.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.574+0000 7fd00da00640 1 -- 172.21.15.40:0/1582457619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0080cba70 msgr2=0x7fd0080cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:28:19.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.574+0000 7fd00da00640 1 --2- 172.21.15.40:0/1582457619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0080cba70 0x7fd0080cbe90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009830 tx=0x7fcff002a510 comp rx=0 tx=0).stop 2024-09-11T00:28:19.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.574+0000 7fd00da00640 1 -- 172.21.15.40:0/1582457619 shutdown_connections 2024-09-11T00:28:19.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.574+0000 7fd00da00640 1 --2- 172.21.15.40:0/1582457619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0080cba70 0x7fd0080cbe90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.574+0000 7fd00da00640 1 --2- 172.21.15.40:0/1582457619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd00815bcc0 0x7fd0080cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.574+0000 7fd00da00640 1 -- 172.21.15.40:0/1582457619 >> 172.21.15.40:0/1582457619 conn(0x7fd0080cfbb0 msgr2=0x7fd0080cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:28:19.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.574+0000 7fd00da00640 1 -- 172.21.15.40:0/1582457619 shutdown_connections 2024-09-11T00:28:19.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.574+0000 7fd00da00640 1 -- 172.21.15.40:0/1582457619 wait complete. 2024-09-11T00:28:19.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.576+0000 7fd00da00640 1 Processor -- start 2024-09-11T00:28:19.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.576+0000 7fd00da00640 1 -- start start 2024-09-11T00:28:19.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.577+0000 7fd00da00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0080ca200 0x7fd0081f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:28:19.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.577+0000 7fd00da00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0080cba70 0x7fd00815aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:28:19.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.577+0000 7fd00da00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd00815bcc0 0x7fd0081e7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:28:19.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.577+0000 7fd00da00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd0080727e0 con 0x7fd0080ca200 2024-09-11T00:28:19.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.577+0000 7fd00da00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd00815f9d0 con 0x7fd00815bcc0 2024-09-11T00:28:19.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.577+0000 7fd00da00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd0080cadc0 con 0x7fd0080cba70 2024-09-11T00:28:19.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.577+0000 7fd006a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0080ca200 0x7fd0081f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:28:19.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.577+0000 7fd006a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0080ca200 0x7fd0081f83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48740/0 (socket says 172.21.15.40:48740) 2024-09-11T00:28:19.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.577+0000 7fd006a00640 1 -- 172.21.15.40:0/1139987841 learned_addr learned my addr 172.21.15.40:0/1139987841 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T00:28:19.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.577+0000 7fcffe000640 1 --2- 172.21.15.40:0/1139987841 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0080cba70 0x7fd00815aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:28:19.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.577+0000 7fd007400640 1 --2- 172.21.15.40:0/1139987841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd00815bcc0 0x7fd0081e7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:28:19.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.577+0000 7fd006a00640 1 -- 172.21.15.40:0/1139987841 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0080cba70 msgr2=0x7fd00815aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:28:19.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.577+0000 7fd006a00640 1 --2- 172.21.15.40:0/1139987841 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0080cba70 0x7fd00815aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.577+0000 7fd006a00640 1 -- 172.21.15.40:0/1139987841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd00815bcc0 msgr2=0x7fd0081e7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:28:19.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.577+0000 7fd006a00640 1 --2- 172.21.15.40:0/1139987841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd00815bcc0 0x7fd0081e7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.577+0000 7fd006a00640 1 -- 172.21.15.40:0/1139987841 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0080c7fe0 con 0x7fd0080ca200 2024-09-11T00:28:19.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.578+0000 7fd006a00640 1 --2- 172.21.15.40:0/1139987841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0080ca200 0x7fd0081f83e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcff800d740 tx=0x7fcff800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:28:19.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.578+0000 7fcfff400640 1 -- 172.21.15.40:0/1139987841 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff8017070 con 0x7fd0080ca200 2024-09-11T00:28:19.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.578+0000 7fcfff400640 1 -- 172.21.15.40:0/1139987841 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fcff8009d40 con 0x7fd0080ca200 2024-09-11T00:28:19.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.578+0000 7fcfff400640 1 -- 172.21.15.40:0/1139987841 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff80106c0 con 0x7fd0080ca200 2024-09-11T00:28:19.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.578+0000 7fd00da00640 1 -- 172.21.15.40:0/1139987841 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0080c82c0 con 0x7fd0080ca200 2024-09-11T00:28:19.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.578+0000 7fd00da00640 1 -- 172.21.15.40:0/1139987841 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0080c8880 con 0x7fd0080ca200 2024-09-11T00:28:19.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.579+0000 7fd00da00640 1 -- 172.21.15.40:0/1139987841 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd00806fae0 con 0x7fd0080ca200 2024-09-11T00:28:19.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.580+0000 7fcfff400640 1 -- 172.21.15.40:0/1139987841 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcff8010860 con 0x7fd0080ca200 2024-09-11T00:28:19.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.581+0000 7fcfff400640 1 --2- 172.21.15.40:0/1139987841 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fcfe4077f70 0x7fcfe407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:28:19.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.581+0000 7fcfff400640 1 -- 172.21.15.40:0/1139987841 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fcff8099fa0 con 0x7fd0080ca200 2024-09-11T00:28:19.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.582+0000 7fcffe000640 1 --2- 172.21.15.40:0/1139987841 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fcfe4077f70 0x7fcfe407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:28:19.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.583+0000 7fcffe000640 1 --2- 172.21.15.40:0/1139987841 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fcfe4077f70 0x7fcfe407a430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcff0034000 tx=0x7fcff00046c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:28:19.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.585+0000 7fcfff400640 1 -- 172.21.15.40:0/1139987841 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcff8062d00 con 0x7fd0080ca200 2024-09-11T00:28:19.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.818+0000 7fd00da00640 1 -- 172.21.15.40:0/1139987841 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0080cf450 con 0x7fd0080ca200 2024-09-11T00:28:19.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.818+0000 7fcfff400640 1 -- 172.21.15.40:0/1139987841 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+3917 (secure 0 0 0) 0x7fcff8062600 con 0x7fd0080ca200 2024-09-11T00:28:19.820 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T00:28:19.820 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":18,"btime":"2024-09-11T00:27:45:826131+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2499570202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2499570202},{"type":"v1","addr":"172.21.15.40:6835","nonce":2499570202}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4885,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2232689934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2232689934},{"type":"v1","addr":"172.21.15.175:6836","nonce":2232689934}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/4012257321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":4012257321},{"type":"v1","addr":"172.21.15.175:6837","nonce":4012257321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/4254173798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4254173798},{"type":"v1","addr":"172.21.15.40:6834","nonce":4254173798}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[]} 2024-09-11T00:28:19.821 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 18 2024-09-11T00:28:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.821+0000 7fd00da00640 1 -- 172.21.15.40:0/1139987841 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fcfe4077f70 msgr2=0x7fcfe407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:28:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.821+0000 7fd00da00640 1 --2- 172.21.15.40:0/1139987841 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fcfe4077f70 0x7fcfe407a430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcff0034000 tx=0x7fcff00046c0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.821+0000 7fd00da00640 1 -- 172.21.15.40:0/1139987841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0080ca200 msgr2=0x7fd0081f83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:28:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.821+0000 7fd00da00640 1 --2- 172.21.15.40:0/1139987841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0080ca200 0x7fd0081f83e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcff800d740 tx=0x7fcff800dc00 comp rx=0 tx=0).stop 2024-09-11T00:28:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.821+0000 7fd00da00640 1 -- 172.21.15.40:0/1139987841 shutdown_connections 2024-09-11T00:28:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.821+0000 7fd00da00640 1 --2- 172.21.15.40:0/1139987841 >> [v2:172.21.15.175:6800/422726646,v1:172.21.15.175:6801/422726646] conn(0x7fcfe4077f70 0x7fcfe407a430 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.821+0000 7fd00da00640 1 --2- 172.21.15.40:0/1139987841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd00815bcc0 0x7fd0081e7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.821+0000 7fd00da00640 1 --2- 172.21.15.40:0/1139987841 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0080cba70 0x7fd00815aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.821+0000 7fd00da00640 1 --2- 172.21.15.40:0/1139987841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0080ca200 0x7fd0081f83e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:28:19.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.821+0000 7fd00da00640 1 -- 172.21.15.40:0/1139987841 >> 172.21.15.40:0/1139987841 conn(0x7fd0080cfbb0 msgr2=0x7fd0080af9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:28:19.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.821+0000 7fd00da00640 1 -- 172.21.15.40:0/1139987841 shutdown_connections 2024-09-11T00:28:19.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T00:28:19.821+0000 7fd00da00640 1 -- 172.21.15.40:0/1139987841 wait complete. 2024-09-11T00:28:19.838 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-11T00:28:19.838 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-11T00:28:19.838 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T00:28:19.838 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:28:19.851 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T00:28:19.851 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T00:28:19.852 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:28:19.906 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T00:28:19.906 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T00:28:19.906 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:28:19.923 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T00:28:19.923 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T00:28:19.923 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:28:19.980 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T00:28:19.980 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-11T00:28:19.980 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-11T00:28:19.980 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:28:20.019 INFO:tasks.ceph.osd.0:Stopped 2024-09-11T00:28:20.019 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-11T00:28:20.020 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:28:20.111 INFO:tasks.ceph.osd.1:Stopped 2024-09-11T00:28:20.111 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T00:28:20.112 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:28:20.160 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T00:28:20.161 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-11T00:28:20.161 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:28:20.209 INFO:tasks.ceph.osd.3:Stopped 2024-09-11T00:28:20.209 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-11T00:28:20.210 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:28:20.261 INFO:tasks.ceph.osd.4:Stopped 2024-09-11T00:28:20.262 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-11T00:28:20.262 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:28:20.308 INFO:tasks.ceph.osd.5:Stopped 2024-09-11T00:28:20.308 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-11T00:28:20.308 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:28:20.355 INFO:tasks.ceph.osd.6:Stopped 2024-09-11T00:28:20.355 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-11T00:28:20.356 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:28:20.406 INFO:tasks.ceph.osd.7:Stopped 2024-09-11T00:28:20.406 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-11T00:28:20.407 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-11T00:28:20.407 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:28:20.472 INFO:tasks.ceph.mgr.y:Stopped 2024-09-11T00:28:20.472 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-11T00:28:20.472 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:28:20.541 INFO:tasks.ceph.mgr.x:Stopped 2024-09-11T00:28:20.541 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-11T00:28:20.541 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T00:28:20.541 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:28:20.561 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T00:28:20.561 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-11T00:28:20.562 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:28:20.579 INFO:tasks.ceph.mon.b:Stopped 2024-09-11T00:28:20.580 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-11T00:28:20.580 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:28:20.639 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-11T00:28:20.639 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-11T00:28:20.639 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-11T00:28:20.640 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-11T00:28:20.640 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-11T00:28:20.640 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-11T00:28:20.640 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-11T00:28:20.640 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-11T00:28:20.640 INFO:tasks.ceph.mon.c:Stopped 2024-09-11T00:28:20.640 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-11T00:28:20.640 DEBUG:teuthology.orchestra.run.smithi040:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-11T00:28:20.724 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T00:28:20.725 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-11T00:28:20.966 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T00:28:20.967 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-11T00:28:21.077 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T00:28:21.077 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-11T00:28:21.173 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T00:28:21.174 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-11T00:28:21.272 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi175.front.sepia.ceph.com 2024-09-11T00:28:21.272 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-11T00:28:21.401 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi175.front.sepia.ceph.com 2024-09-11T00:28:21.402 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-11T00:28:21.507 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi175.front.sepia.ceph.com 2024-09-11T00:28:21.508 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-11T00:28:21.608 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi175.front.sepia.ceph.com 2024-09-11T00:28:21.609 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-11T00:28:21.707 INFO:tasks.ceph:Archiving mon data... 2024-09-11T00:28:21.708 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899841/data/mon.a.tgz 2024-09-11T00:28:21.708 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2024-09-11T00:28:21.744 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.9NulFJUjgQ 2024-09-11T00:28:21.745 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.9NulFJUjgQ 2024-09-11T00:28:21.935 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.9NulFJUjgQ 2024-09-11T00:28:22.029 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.9NulFJUjgQ is 322KB 2024-09-11T00:28:22.128 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.9NulFJUjgQ 2024-09-11T00:28:22.163 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899841/data/mon.b.tgz 2024-09-11T00:28:22.163 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-09-11T00:28:22.199 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.WyYTWigDIT 2024-09-11T00:28:22.199 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.WyYTWigDIT 2024-09-11T00:28:22.393 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.WyYTWigDIT 2024-09-11T00:28:22.487 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.WyYTWigDIT is 433KB 2024-09-11T00:28:22.578 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.WyYTWigDIT 2024-09-11T00:28:22.612 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899841/data/mon.c.tgz 2024-09-11T00:28:22.613 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-09-11T00:28:22.688 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.MRa4CBaqRv 2024-09-11T00:28:22.689 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.MRa4CBaqRv 2024-09-11T00:28:22.868 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.MRa4CBaqRv 2024-09-11T00:28:22.961 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.MRa4CBaqRv is 432KB 2024-09-11T00:28:23.065 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.MRa4CBaqRv 2024-09-11T00:28:23.315 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-11T00:28:23.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T00:28:23.321 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T00:28:23.448 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T00:28:23.483 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T00:28:23.483 INFO:tasks.ceph:Archiving crash dumps... 2024-09-11T00:28:23.485 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899841/remote/smithi040/crash 2024-09-11T00:28:23.486 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T00:28:23.546 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899841/remote/smithi175/crash 2024-09-11T00:28:23.547 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T00:28:23.601 INFO:tasks.ceph:Shutting down logrotate 2024-09-11T00:28:23.602 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:28:23.606 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T00:28:23.687 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-11T00:28:23.743 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-11T00:28:23.798 INFO:tasks.ceph:Compressing logs... 2024-09-11T00:28:23.798 DEBUG:teuthology.orchestra.run.smithi040:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T00:28:23.802 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T00:28:23.852 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-11T00:28:23.853 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36601.log 2024-09-11T00:28:23.854 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105237.log 2024-09-11T00:28:23.855 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45568.log 2024-09-11T00:28:23.855 INFO:teuthology.orchestra.run.smithi040.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36601.log.gz 2024-09-11T00:28:23.855 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46581.log 2024-09-11T00:28:23.856 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35940.log 2024-09-11T00:28:23.856 INFO:teuthology.orchestra.run.smithi040.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.105237.log.gz 2024-09-11T00:28:23.858 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45568.log: gzip 87.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.45568.log.gz --verbose 2024-09-11T00:28:23.858 INFO:teuthology.orchestra.run.smithi040.stderr: -- /var/log/ceph/ceph-client.admin.47415.log 2024-09-11T00:28:23.858 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42245.log 2024-09-11T00:28:23.858 INFO:teuthology.orchestra.run.smithi040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46581.log.gz 2024-09-11T00:28:23.859 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-11T00:28:23.859 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36100.log 2024-09-11T00:28:23.859 INFO:teuthology.orchestra.run.smithi175.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.35940.log.gz 2024-09-11T00:28:23.859 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-11T00:28:23.859 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36020.log 2024-09-11T00:28:23.860 INFO:teuthology.orchestra.run.smithi175.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36100.log.gz 2024-09-11T00:28:23.860 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-11T00:28:23.862 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47625.log 2024-09-11T00:28:23.862 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47415.log.gz 2024-09-11T00:28:23.863 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45415.log 2024-09-11T00:28:23.863 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42245.log.gz 2024-09-11T00:28:23.863 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46708.log 2024-09-11T00:28:23.863 INFO:teuthology.orchestra.run.smithi040.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47625.log.gz 2024-09-11T00:28:23.863 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36326.log 2024-09-11T00:28:23.863 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45415.log.gz 2024-09-11T00:28:23.863 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47373.log 2024-09-11T00:28:23.863 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46708.log.gz 2024-09-11T00:28:23.868 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36326.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36326.log.gz 2024-09-11T00:28:23.868 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43299.log 2024-09-11T00:28:23.868 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47541.log 2024-09-11T00:28:23.868 INFO:teuthology.orchestra.run.smithi040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47373.log.gz 2024-09-11T00:28:23.868 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104433.log 2024-09-11T00:28:23.868 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43299.log.gz 2024-09-11T00:28:23.868 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43304.log 2024-09-11T00:28:23.868 INFO:teuthology.orchestra.run.smithi040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47541.log.gz 2024-09-11T00:28:23.869 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.104433.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104433.log.gz 2024-09-11T00:28:23.869 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42626.log 2024-09-11T00:28:23.869 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104620.log 2024-09-11T00:28:23.869 INFO:teuthology.orchestra.run.smithi040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43304.log.gz 2024-09-11T00:28:23.871 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36020.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T00:28:23.871 INFO:teuthology.orchestra.run.smithi175.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36020.log.gz 2024-09-11T00:28:23.871 INFO:teuthology.orchestra.run.smithi175.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-11T00:28:23.871 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35820.log 2024-09-11T00:28:23.871 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-11T00:28:23.871 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35820.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T00:28:23.871 INFO:teuthology.orchestra.run.smithi175.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35820.log.gz 2024-09-11T00:28:23.871 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35860.log 2024-09-11T00:28:23.871 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41499.log 2024-09-11T00:28:23.871 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35860.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.35860.log.gz 2024-09-11T00:28:23.872 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-11T00:28:23.872 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.1.41499.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-11T00:28:23.872 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.1.41499.log.gz 2024-09-11T00:28:23.872 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T00:28:23.872 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41955.log 2024-09-11T00:28:23.872 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35900.log 2024-09-11T00:28:23.874 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41905.log 2024-09-11T00:28:23.874 INFO:teuthology.orchestra.run.smithi040.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.42626.log.gz 2024-09-11T00:28:23.874 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.104620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105363.log 2024-09-11T00:28:23.874 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104620.log.gz 2024-09-11T00:28:23.874 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41905.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41905.log.gz 2024-09-11T00:28:23.875 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45820.log 2024-09-11T00:28:23.875 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41598.log 2024-09-11T00:28:23.875 INFO:teuthology.orchestra.run.smithi040.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.105363.log.gz 2024-09-11T00:28:23.875 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41516.log 2024-09-11T00:28:23.875 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45820.log.gz 2024-09-11T00:28:23.875 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41598.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-11T00:28:23.875 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41598.log.gz 2024-09-11T00:28:23.875 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42119.log 2024-09-11T00:28:23.875 INFO:teuthology.orchestra.run.smithi040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41516.log.gz 2024-09-11T00:28:23.875 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45247.log 2024-09-11T00:28:23.879 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41402.log 2024-09-11T00:28:23.879 INFO:teuthology.orchestra.run.smithi040.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42119.log.gz 2024-09-11T00:28:23.879 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45247.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45247.log.gz 2024-09-11T00:28:23.879 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46920.log 2024-09-11T00:28:23.879 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104704.log 2024-09-11T00:28:23.879 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41402.log.gz 2024-09-11T00:28:23.879 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46920.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46920.log.gz 2024-09-11T00:28:23.880 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105489.log 2024-09-11T00:28:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.3.41955.log: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T00:28:23.881 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.3.41955.log.gz 2024-09-11T00:28:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35900.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.35900.log.gz 2024-09-11T00:28:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-11T00:28:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-11T00:28:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36060.log 2024-09-11T00:28:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mgr.x.log: 93.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-11T00:28:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36060.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36060.log.gz 2024-09-11T00:28:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-11T00:28:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35980.log 2024-09-11T00:28:23.884 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.104704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104247.log 2024-09-11T00:28:23.884 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104704.log.gz 2024-09-11T00:28:23.884 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105489.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105489.log.gz 2024-09-11T00:28:23.884 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36081.log 2024-09-11T00:28:23.884 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.104247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45289.log 2024-09-11T00:28:23.884 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104247.log.gz 2024-09-11T00:28:23.884 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36081.log.gz 2024-09-11T00:28:23.884 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46191.log 2024-09-11T00:28:23.884 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41682.log 2024-09-11T00:28:23.884 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45289.log.gz 2024-09-11T00:28:23.885 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.35980.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.35980.log.gz 2024-09-11T00:28:23.886 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46750.log 2024-09-11T00:28:23.886 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46191.log.gz 2024-09-11T00:28:23.886 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41682.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41682.log.gz 2024-09-11T00:28:23.886 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41321.log 2024-09-11T00:28:23.887 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45205.log 2024-09-11T00:28:23.887 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46750.log.gz 2024-09-11T00:28:23.888 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41321.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41321.log.gz 2024-09-11T00:28:23.888 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105405.log 2024-09-11T00:28:23.888 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36390.log 2024-09-11T00:28:23.889 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45205.log.gz 2024-09-11T00:28:23.889 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104331.log 2024-09-11T00:28:23.890 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105405.log.gz 2024-09-11T00:28:23.891 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46539.log 2024-09-11T00:28:23.891 INFO:teuthology.orchestra.run.smithi040.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36390.log.gz 2024-09-11T00:28:23.892 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.104331.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104331.log.gz 2024-09-11T00:28:23.892 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43589.log 2024-09-11T00:28:23.893 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44495.log 2024-09-11T00:28:23.893 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46539.log.gz 2024-09-11T00:28:23.894 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43589.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43589.log.gz 2024-09-11T00:28:23.894 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46458.log 2024-09-11T00:28:23.895 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41863.log 2024-09-11T00:28:23.895 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44495.log.gz 2024-09-11T00:28:23.896 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46458.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46458.log.gz 2024-09-11T00:28:23.896 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104577.log 2024-09-11T00:28:23.897 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36566.log 2024-09-11T00:28:23.897 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41863.log.gz 2024-09-11T00:28:23.898 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.104577.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104577.log.gz 2024-09-11T00:28:23.898 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43547.log 2024-09-11T00:28:23.899 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36618.log 2024-09-11T00:28:23.899 INFO:teuthology.orchestra.run.smithi040.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36566.log.gz 2024-09-11T00:28:23.900 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43547.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43547.log.gz 2024-09-11T00:28:23.900 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45373.log 2024-09-11T00:28:23.901 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37139.log 2024-09-11T00:28:23.901 INFO:teuthology.orchestra.run.smithi040.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36618.log.gz 2024-09-11T00:28:23.902 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45373.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45373.log.gz 2024-09-11T00:28:23.902 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42954.log 2024-09-11T00:28:23.903 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.37139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105027.log 2024-09-11T00:28:23.903 INFO:teuthology.orchestra.run.smithi040.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.37139.log.gz 2024-09-11T00:28:23.904 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42954.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42954.log.gz 2024-09-11T00:28:23.904 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36535.log 2024-09-11T00:28:23.906 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105741.log 2024-09-11T00:28:23.906 INFO:teuthology.orchestra.run.smithi040.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.105027.log.gz 2024-09-11T00:28:23.906 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36535.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36535.log.gz 2024-09-11T00:28:23.907 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47691.log 2024-09-11T00:28:23.907 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42077.log 2024-09-11T00:28:23.907 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105741.log.gz 2024-09-11T00:28:23.908 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47691.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47691.log.gz 2024-09-11T00:28:23.909 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41951.log 2024-09-11T00:28:23.909 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44344.log 2024-09-11T00:28:23.910 INFO:teuthology.orchestra.run.smithi040.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42077.log.gz 2024-09-11T00:28:23.910 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41951.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41951.log.gz 2024-09-11T00:28:23.911 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42973.log 2024-09-11T00:28:23.911 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.0.44344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105657.log 2024-09-11T00:28:23.912 INFO:teuthology.orchestra.run.smithi040.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.0.44344.log.gz 2024-09-11T00:28:23.913 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105615.log 2024-09-11T00:28:23.913 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42973.log.gz 2024-09-11T00:28:23.913 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105657.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105657.log.gz 2024-09-11T00:28:23.914 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41993.log 2024-09-11T00:28:23.914 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105615.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T00:28:23.915 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105615.log.gz 2024-09-11T00:28:23.916 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41993.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41993.log.gz 2024-09-11T00:28:23.916 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105573.log 2024-09-11T00:28:23.916 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47015.log 2024-09-11T00:28:23.917 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105573.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.105573.log.gz 2024-09-11T00:28:23.917 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T00:28:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45646.log 2024-09-11T00:28:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104985.log 2024-09-11T00:28:23.918 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47015.log.gz 2024-09-11T00:28:23.920 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45646.log: gzip -5 --verbose 87.6% -- -- replaced with /var/log/ceph/ceph-client.admin.45646.log.gz 2024-09-11T00:28:23.920 INFO:teuthology.orchestra.run.smithi040.stderr: /var/log/ceph/ceph-client.admin.36348.log 2024-09-11T00:28:23.920 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.104985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45762.log 87.2% 2024-09-11T00:28:23.920 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.104985.log.gz 2024-09-11T00:28:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36348.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36348.log.gz 2024-09-11T00:28:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42968.log 2024-09-11T00:28:23.922 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47079.log 2024-09-11T00:28:23.922 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45762.log.gz 2024-09-11T00:28:23.923 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42968.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42968.log.gz 2024-09-11T00:28:23.923 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42371.log 2024-09-11T00:28:23.924 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104517.log 2024-09-11T00:28:23.924 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47079.log.gz 2024-09-11T00:28:23.925 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42035.log 2024-09-11T00:28:23.925 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42371.log.gz 2024-09-11T00:28:23.926 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.104517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41726.log 2024-09-11T00:28:23.926 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.104517.log.gz 2024-09-11T00:28:23.926 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42035.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42035.log.gz 2024-09-11T00:28:23.926 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45897.log 2024-09-11T00:28:23.927 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41726.log: gzip -5 --verbose 87.7% -- -- replaced with /var/log/ceph/ceph-client.admin.41726.log.gz /var/log/ceph/ceph-client.admin.47331.log 2024-09-11T00:28:23.927 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-09-11T00:28:23.928 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45897.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45897.log.gz 2024-09-11T00:28:23.928 INFO:teuthology.orchestra.run.smithi040.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42962.log 2024-09-11T00:28:23.929 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42967.log 2024-09-11T00:28:23.929 INFO:teuthology.orchestra.run.smithi040.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47331.log.gz 2024-09-11T00:28:23.930 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42962.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.42962.log.gz 2024-09-11T00:28:23.930 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43200.log 2024-09-11T00:28:23.931 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42967.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42967.log.gz 2024-09-11T00:28:23.931 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46336.log 2024-09-11T00:28:23.932 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43200.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43200.log.gz 2024-09-11T00:28:23.932 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42637.log 2024-09-11T00:28:23.933 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46336.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46336.log.gz 2024-09-11T00:28:23.933 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46876.log 2024-09-11T00:28:23.934 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42637.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42637.log.gz 2024-09-11T00:28:23.934 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43305.log 2024-09-11T00:28:23.935 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46876.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46876.log.gz 2024-09-11T00:28:23.935 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42972.log 2024-09-11T00:28:23.936 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43305.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43305.log.gz 2024-09-11T00:28:23.936 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36274.log 2024-09-11T00:28:23.937 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47499.log 2024-09-11T00:28:23.937 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42972.log.gz 2024-09-11T00:28:23.938 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104373.log 2024-09-11T00:28:23.938 INFO:teuthology.orchestra.run.smithi040.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36274.log.gz 2024-09-11T00:28:23.938 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43505.log 2024-09-11T00:28:23.939 INFO:teuthology.orchestra.run.smithi040.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47499.log.gz 2024-09-11T00:28:23.939 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.104373.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104373.log.gz 2024-09-11T00:28:23.939 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36843.log 2024-09-11T00:28:23.941 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43505.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43505.log.gz 2024-09-11T00:28:23.941 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-11T00:28:23.941 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36843.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36843.log.gz 2024-09-11T00:28:23.941 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46149.log 2024-09-11T00:28:23.942 INFO:teuthology.orchestra.run.smithi175.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-11T00:28:23.942 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36152.log 2024-09-11T00:28:23.943 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46149.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46149.log.gz 2024-09-11T00:28:23.944 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47121.log 2024-09-11T00:28:23.945 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37045.log 2024-09-11T00:28:23.945 INFO:teuthology.orchestra.run.smithi040.stderr: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.36152.log.gz 2024-09-11T00:28:23.946 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47121.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47121.log.gz 2024-09-11T00:28:23.946 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104662.log 2024-09-11T00:28:23.947 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.37045.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.37045.log.gz 2024-09-11T00:28:23.947 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47163.log 2024-09-11T00:28:23.948 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.104662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42455.log 2024-09-11T00:28:23.948 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104662.log.gz 2024-09-11T00:28:23.949 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47163.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47163.log.gz 2024-09-11T00:28:23.949 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43673.log 2024-09-11T00:28:23.950 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42455.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42455.log.gz 2024-09-11T00:28:23.951 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105699.log 2024-09-11T00:28:23.951 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47247.log 2024-09-11T00:28:23.952 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105699.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43673.log.gz 2024-09-11T00:28:23.953 INFO:teuthology.orchestra.run.smithi040.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.105699.log.gz 2024-09-11T00:28:23.953 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43307.log 2024-09-11T00:28:23.954 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47247.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47247.log.gz 2024-09-11T00:28:23.954 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45939.log 2024-09-11T00:28:23.955 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45053.log 2024-09-11T00:28:23.955 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43307.log.gz 2024-09-11T00:28:23.956 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45939.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45939.log.gz 2024-09-11T00:28:23.956 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105279.log 2024-09-11T00:28:23.958 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45331.log 2024-09-11T00:28:23.958 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45053.log.gz 2024-09-11T00:28:23.959 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105279.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.105279.log.gz 2024-09-11T00:28:23.959 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45688.log 2024-09-11T00:28:23.960 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43715.log 2024-09-11T00:28:23.960 INFO:teuthology.orchestra.run.smithi040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45331.log.gz 2024-09-11T00:28:23.961 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43631.log 2024-09-11T00:28:23.961 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45688.log.gz 2024-09-11T00:28:23.962 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43715.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43715.log.gz 2024-09-11T00:28:23.962 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-11T00:28:23.963 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41640.log 2024-09-11T00:28:23.963 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43631.log.gz 2024-09-11T00:28:23.964 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43309.log 2024-09-11T00:28:23.965 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67166.log 2024-09-11T00:28:23.965 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41640.log.gz 2024-09-11T00:28:23.967 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46107.log 2024-09-11T00:28:23.967 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43309.log.gz 2024-09-11T00:28:23.968 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.67166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36616.log 2024-09-11T00:28:23.968 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67166.log.gz 2024-09-11T00:28:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105111.log 2024-09-11T00:28:23.969 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46107.log.gz 2024-09-11T00:28:23.970 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42629.log 2024-09-11T00:28:23.970 INFO:teuthology.orchestra.run.smithi040.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36616.log.gz 2024-09-11T00:28:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43301.log 2024-09-11T00:28:23.971 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105111.log.gz 2024-09-11T00:28:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105069.log 2024-09-11T00:28:23.973 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42629.log.gz 2024-09-11T00:28:23.974 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42635.log 2024-09-11T00:28:23.974 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43301.log.gz 2024-09-11T00:28:23.975 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46293.log 2024-09-11T00:28:23.975 INFO:teuthology.orchestra.run.smithi040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105069.log.gz 2024-09-11T00:28:23.977 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67693.log 2024-09-11T00:28:23.977 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42635.log.gz 2024-09-11T00:28:23.978 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46293.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-11T00:28:23.978 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46293.log.gz 2024-09-11T00:28:23.979 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.67693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41821.log 2024-09-11T00:28:23.979 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67693.log.gz 2024-09-11T00:28:23.980 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104746.log 2024-09-11T00:28:23.981 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43308.log 2024-09-11T00:28:23.981 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41821.log.gz 2024-09-11T00:28:23.983 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.104746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36557.log 2024-09-11T00:28:23.983 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104746.log.gz 2024-09-11T00:28:23.984 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43308.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43308.log.gz 2024-09-11T00:28:23.985 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36557.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36557.log.gz 2024-09-11T00:28:23.985 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105447.log 2024-09-11T00:28:23.987 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105195.log 2024-09-11T00:28:23.988 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105447.log: 87.0%gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-11T00:28:23.988 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105447.log.gz 2024-09-11T00:28:23.989 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105195.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.105195.log.gz 2024-09-11T00:28:23.992 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42634.log 2024-09-11T00:28:23.993 INFO:teuthology.orchestra.run.smithi040.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-11T00:28:23.993 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104943.log 2024-09-11T00:28:23.995 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45163.log 2024-09-11T00:28:23.995 INFO:teuthology.orchestra.run.smithi040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42634.log.gz 2024-09-11T00:28:23.996 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.104943.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.104943.log.gz 2024-09-11T00:28:23.997 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45163.log: 93.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-11T00:28:23.997 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45163.log.gz 2024-09-11T00:28:23.997 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46792.log 2024-09-11T00:28:23.998 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42203.log 2024-09-11T00:28:23.998 INFO:teuthology.orchestra.run.smithi175.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-11T00:28:23.999 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46792.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46792.log.gz 2024-09-11T00:28:23.999 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42287.log 2024-09-11T00:28:24.000 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42203.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T00:28:24.001 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42203.log.gz 2024-09-11T00:28:24.002 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36230.log 2024-09-11T00:28:24.002 INFO:teuthology.orchestra.run.smithi040.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.42287.log.gz 2024-09-11T00:28:24.003 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43757.log 2024-09-11T00:28:24.004 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36230.log: 86.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T00:28:24.004 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45011.log 2024-09-11T00:28:24.004 INFO:teuthology.orchestra.run.smithi040.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.36230.log.gz 2024-09-11T00:28:24.005 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47583.log 2024-09-11T00:28:24.005 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43757.log.gz 2024-09-11T00:28:24.006 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45011.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45011.log.gz 2024-09-11T00:28:24.006 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42161.log 2024-09-11T00:28:24.008 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46666.log 2024-09-11T00:28:24.008 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47583.log.gz 2024-09-11T00:28:24.010 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42161.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.42161.log.gz 2024-09-11T00:28:24.010 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46233.log 2024-09-11T00:28:24.011 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44907.log 2024-09-11T00:28:24.011 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46666.log.gz 2024-09-11T00:28:24.012 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105321.log 2024-09-11T00:28:24.012 INFO:teuthology.orchestra.run.smithi040.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.46233.log.gz 2024-09-11T00:28:24.013 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.2.44907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42971.log 2024-09-11T00:28:24.013 INFO:teuthology.orchestra.run.smithi040.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-11T00:28:24.013 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.2.44907.log.gz 2024-09-11T00:28:24.014 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36186.log 2024-09-11T00:28:24.015 INFO:teuthology.orchestra.run.smithi040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105321.log.gz 2024-09-11T00:28:24.015 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42971.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.42971.log.gz 2024-09-11T00:28:24.015 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41770.log 2024-09-11T00:28:24.017 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36186.log: 76.9% -- replaced with /var/log/ceph/ceph-client.admin.36186.log.gz 2024-09-11T00:28:24.017 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42628.log 2024-09-11T00:28:24.017 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36061.log 2024-09-11T00:28:24.018 INFO:teuthology.orchestra.run.smithi040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41770.log.gz 2024-09-11T00:28:24.019 INFO:teuthology.orchestra.run.smithi175.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-11T00:28:24.019 INFO:teuthology.orchestra.run.smithi175.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-11T00:28:24.022 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105153.log 2024-09-11T00:28:24.022 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42628.log.gz 2024-09-11T00:28:24.022 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36061.log.gz 2024-09-11T00:28:24.022 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45981.log 2024-09-11T00:28:24.023 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42413.log 2024-09-11T00:28:24.023 INFO:teuthology.orchestra.run.smithi040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105153.log.gz 2024-09-11T00:28:24.023 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45981.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45981.log.gz 2024-09-11T00:28:24.023 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47969.log 2024-09-11T00:28:24.026 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42413.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42413.log.gz 2024-09-11T00:28:24.026 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36434.log 2024-09-11T00:28:24.026 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.0.47969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46065.log 2024-09-11T00:28:24.026 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36434.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36434.log.gz 2024-09-11T00:28:24.027 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30011.log 2024-09-11T00:28:24.027 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46065.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46065.log.gz 2024-09-11T00:28:24.027 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105531.log 2024-09-11T00:28:24.030 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.tmp-client.admin.30011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105813.log 2024-09-11T00:28:24.031 INFO:teuthology.orchestra.run.smithi040.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30011.log.gz 2024-09-11T00:28:24.031 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46023.log 2024-09-11T00:28:24.031 INFO:teuthology.orchestra.run.smithi040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105531.log.gz 2024-09-11T00:28:24.031 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105813.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105813.log.gz 2024-09-11T00:28:24.031 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36608.log 2024-09-11T00:28:24.031 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46964.log 2024-09-11T00:28:24.031 INFO:teuthology.orchestra.run.smithi040.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.0.47969.log.gz 2024-09-11T00:28:24.031 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46023.log.gz 2024-09-11T00:28:24.034 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36608.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36608.log.gz 2024-09-11T00:28:24.034 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47289.log 2024-09-11T00:28:24.034 INFO:teuthology.orchestra.run.smithi040.stderr:gzip/var/log/ceph/ceph-client.admin.46964.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.105895.log 2024-09-11T00:28:24.034 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46964.log.gz 2024-09-11T00:28:24.034 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47289.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47289.log.gz 2024-09-11T00:28:24.034 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47457.log 2024-09-11T00:28:24.036 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43799.log 2024-09-11T00:28:24.036 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105895.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105895.log.gz 2024-09-11T00:28:24.036 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47457.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47457.log.gz 2024-09-11T00:28:24.037 INFO:teuthology.orchestra.run.smithi175.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-11T00:28:24.039 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45510.log 2024-09-11T00:28:24.039 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105853.log 2024-09-11T00:28:24.039 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43799.log: /var/log/ceph/ceph-client.admin.45510.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45510.log.gz 2024-09-11T00:28:24.039 INFO:teuthology.orchestra.run.smithi040.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43799.log.gz 2024-09-11T00:28:24.039 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42622.log 2024-09-11T00:28:24.039 INFO:teuthology.orchestra.run.smithi040.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-11T00:28:24.039 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.105853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42329.log 2024-09-11T00:28:24.040 INFO:teuthology.orchestra.run.smithi175.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-11T00:28:24.041 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105853.log.gz 2024-09-11T00:28:24.041 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43901.log 2024-09-11T00:28:24.041 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42622.log.gz 2024-09-11T00:28:24.041 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104901.log 2024-09-11T00:28:24.041 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42329.log.gz 2024-09-11T00:28:24.042 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43901.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.43901.log.gz -5 2024-09-11T00:28:24.042 INFO:teuthology.orchestra.run.smithi040.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36592.log 2024-09-11T00:28:24.043 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.104901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46834.log 2024-09-11T00:28:24.043 INFO:teuthology.orchestra.run.smithi040.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.104901.log.gz 2024-09-11T00:28:24.044 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36592.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36592.log.gzgzip 2024-09-11T00:28:24.044 INFO:teuthology.orchestra.run.smithi040.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46624.log 2024-09-11T00:28:24.045 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42959.log 2024-09-11T00:28:24.045 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46834.log.gz 2024-09-11T00:28:24.046 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42636.log 87.4% 2024-09-11T00:28:24.046 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46624.log.gz 2024-09-11T00:28:24.048 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46378.log 2024-09-11T00:28:24.048 INFO:teuthology.orchestra.run.smithi040.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42959.log.gz 2024-09-11T00:28:24.048 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47205.log 2024-09-11T00:28:24.049 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42636.log.gz 2024-09-11T00:28:24.049 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46378.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-11T00:28:24.050 INFO:teuthology.orchestra.run.smithi040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46378.log.gz 2024-09-11T00:28:24.050 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47205.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-11T00:28:24.051 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47205.log.gz 2024-09-11T00:28:24.051 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104289.log 2024-09-11T00:28:24.052 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104475.log 2024-09-11T00:28:24.054 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.104289.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104289.log.gz 2024-09-11T00:28:24.055 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.104475.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104475.log.gz 2024-09-11T00:28:24.062 INFO:teuthology.orchestra.run.smithi175.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-11T00:28:24.062 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-09-11T00:28:24.063 INFO:teuthology.orchestra.run.smithi175.stderr:real 0m0.228s 2024-09-11T00:28:24.063 INFO:teuthology.orchestra.run.smithi175.stderr:user 0m0.957s 2024-09-11T00:28:24.063 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m0.173s 2024-09-11T00:28:24.070 INFO:teuthology.orchestra.run.smithi040.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-11T00:28:24.107 INFO:teuthology.orchestra.run.smithi040.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-11T00:28:24.209 INFO:teuthology.orchestra.run.smithi040.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-11T00:28:24.212 INFO:teuthology.orchestra.run.smithi040.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-11T00:28:24.215 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-09-11T00:28:24.215 INFO:teuthology.orchestra.run.smithi040.stderr:real 0m0.385s 2024-09-11T00:28:24.215 INFO:teuthology.orchestra.run.smithi040.stderr:user 0m0.916s 2024-09-11T00:28:24.216 INFO:teuthology.orchestra.run.smithi040.stderr:sys 0m0.532s 2024-09-11T00:28:24.216 INFO:tasks.ceph:Archiving logs... 2024-09-11T00:28:24.217 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899841/remote/smithi040/log 2024-09-11T00:28:24.218 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T00:28:24.516 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899841/remote/smithi175/log 2024-09-11T00:28:24.517 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T00:28:24.700 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T00:28:24.731 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T00:28:24.731 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T00:28:24.736 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T00:28:24.853 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T00:28:24.862 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T00:28:24.862 DEBUG:teuthology.orchestra.run.smithi040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:28:24.866 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:28:24.895 INFO:teuthology.orchestra.run.smithi040.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:28:24.899 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:28:24.902 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:28:24.902 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2024-09-11T00:28:24.902 INFO:teuthology.orchestra.run.smithi040.stdout:^* hv01.front.sepia.ceph.com 3 6 377 14 -625us[ -631us] +/- 46ms 2024-09-11T00:28:24.902 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 15 +913us[ +908us] +/- 59ms 2024-09-11T00:28:24.902 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 -181us[ -187us] +/- 88ms 2024-09-11T00:28:24.902 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:28:24.906 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:28:24.906 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-09-11T00:28:24.906 INFO:teuthology.orchestra.run.smithi175.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 -598us[ -537us] +/- 46ms 2024-09-11T00:28:24.906 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 17 +933us[ +993us] +/- 59ms 2024-09-11T00:28:24.906 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 -167us[ -107us] +/- 88ms 2024-09-11T00:28:24.906 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:28:24.907 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T00:28:24.916 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T00:28:24.916 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T00:28:24.924 DEBUG:teuthology.orchestra.run.smithi040:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T00:28:25.062 DEBUG:teuthology.orchestra.run.smithi175:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T00:28:25.174 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T00:28:25.235 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:28:25.235 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T00:28:25.295 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:28:25.295 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T00:28:25.304 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T00:28:25.314 INFO:teuthology.task.internal:Duration was 756.188769 seconds 2024-09-11T00:28:25.314 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T00:28:25.323 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T00:28:25.323 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T00:28:25.327 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T00:28:25.411 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:28:25.413 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:28:25.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-11T00:28:25.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-11T00:28:25.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-11T00:28:25.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-11T00:28:25.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-11T00:28:25.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-11T00:28:25.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-11T00:28:25.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-11T00:28:25.809 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T00:28:25.810 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T00:28:25.810 DEBUG:teuthology.orchestra.run.smithi040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T00:28:25.859 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-09-11T00:28:25.859 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T00:28:25.907 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T00:28:25.907 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T00:28:25.912 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T00:28:25.971 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T00:28:25.971 DEBUG:teuthology.orchestra.run.smithi040:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T00:28:25.975 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T00:28:26.119 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T00:28:26.127 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T00:28:26.128 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T00:28:26.184 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T00:28:26.240 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T00:28:26.249 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:28:26.254 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:28:26.320 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = core 2024-09-11T00:28:26.325 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-09-11T00:28:26.357 DEBUG:teuthology.orchestra.run.smithi040:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:28:26.390 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:28:26.391 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:28:26.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:28:26.424 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T00:28:26.433 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T00:28:26.433 DEBUG:teuthology.misc:Transferring archived files from smithi040:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899841/remote/smithi040 2024-09-11T00:28:26.434 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T00:28:26.497 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899841/remote/smithi175 2024-09-11T00:28:26.498 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T00:28:26.560 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T00:28:26.560 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T00:28:26.564 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T00:28:26.599 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T00:28:26.610 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T00:28:26.610 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T00:28:26.642 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T00:28:26.642 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T00:28:26.647 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T00:28:26.678 INFO:teuthology.orchestra.run.smithi040.stdout: 393233 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 11 00:28 /home/ubuntu/cephtest 2024-09-11T00:28:26.678 INFO:teuthology.orchestra.run.smithi040.stdout: 524598 4 d--------- 2 ubuntu ubuntu 4096 Sep 11 00:24 /home/ubuntu/cephtest/mnt.0 2024-09-11T00:28:26.678 INFO:teuthology.orchestra.run.smithi040.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-11T00:28:26.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:28:26.680 INFO:teuthology.orchestra.run.smithi040.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-11T00:28:26.680 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-11T00:28:26.682 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T00:28:26.693 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T00:28:26.703 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi040 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-11T00:28:26.706 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/acls} duration: 756.188768863678 failure_reason: 'Command failed on smithi040 with status 1: ''find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest''' flavor: default mon.a-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a mon.b-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a owner: scheduled_hyelloji@teuthology status: fail success: false 2024-09-11T00:28:26.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T00:28:26.719 INFO:teuthology.orchestra.run.smithi175.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 00:28 /home/ubuntu/cephtest 2024-09-11T00:28:26.800 INFO:teuthology.run:FAIL